Professional Documents
Culture Documents
Reporting Problems
May, 2014
This procedure explains how to add EMC I/O modules to the Data Movers (DMs) in a
VNX5300 system. The resulting Data Mover I/O module configuration must be uniform
across each Data Mover in the system or failover group, therefore you must add the same
I/O module to each Data Mover in the system or the failover group.
CAUTION
Electrostatic discharge (ESD) can damage equipment and impair electrical circuitry.
Always follow ESD prevention procedures when removing and replacing I/O modules.
Note
This procedure uses the terms blade and Data Mover interchangeably to refer to the same
logical hardware component composed of a CPU module, power/cooling modules, and I/O
modules.
For additional details on the locations of orderable parts, and their part number labels,
refer to the parts location guide for your specific VNX model. EMC posts and maintains
parts location guides online on the Related Documents section of https://
MyDocs.emc.com/VNX. On the Related Documents page, under the VNX Hardware Parts
heading, click on the desired guide.
l Before you begin........................................................................................................ 2
l Preparing your site for an upgrade..............................................................................6
l Installing the upgrade.............................................................................................. 13
l Finishing up............................................................................................................. 20
Before you begin
Before you begin this maintenance activity, refer to the component handling instructions.
You should also review the entire procedure prior to beginning any maintenance activity
on the system.
CAUTION
These procedures are not a substitute for the use of an ESD kit. Follow them only in the
event of an emergency.
l Before touching any unit, touch a bare (unpainted) metal surface of the enclosure.
l Before removing any unit from its antistatic bag, place one hand firmly on a bare
metal surface of the enclosure, and at the same time, pick up the unit while it is still
sealed in the antistatic bag. Once you have done this, do not move around the room
or touch other furnishings, personnel, or surfaces until you have installed the unit
2
Adding an I/O Module to a Data Mover
l When you remove a unit from the antistatic bag, avoid touching any electronic
components and circuits on it.
l If you must move around the room or touch other surfaces before installing a unit,
first place the unit back in the antistatic bag. When you are ready again to install the
unit, repeat these procedures.
CAUTION
For a module that must be installed into a slot in an enclosure, examine the rear
connectors on the module for any damage before attempting its installation.
l Store a CRU in the antistatic bag and the specially designed shipping container in
which you received it. Use the antistatic bag and special shipping container when you
need to return the CRU.
CAUTION
A sudden jar, drop, or even a moderate vibration can permanently damage some
sensitive FRUs.
CAUTION
Some CRUs have the majority of their weight in the rear of the component. Ensure that
the back end of the CRU is supported while installing or removing it. Dropping a CRU
could result in personal injury or damage to the equipment.
Upgrade overview
Review the requirements and prerequisites that must be met before adding and
configuring additional I/O modules to the Data Movers.
In this upgrade procedure you will add one or more I/O module to each of the system
Data Movers.
l All hardware and software components in the VNX system must be installed,
configured, and operating properly prior to initiating the upgrade tasks. If any faults
are present, work to correct those issues.
l All new I/O modules to be installed during this upgrade must be available for
installation.
Upgrade overview 3
l Each Data Mover in the system will be upgraded during this procedure, one at a time.
Note
If one or more Data Movers do not participate in the failover group, you are not
required to add an I/O module to these Data Movers. Be aware that a Data Mover
cannot enter into a primary/standby relationship with a peer Data Mover that does
not share its I/O module configuration.
Refer to Identifying available Data Mover I/O module slots on page 4 to verify valid I/O
module types.
Note
Do not use this procedure to replace or swap I/O modules that are already present.
Refer to the Parts Location Guides for the VNX Series systems on the Related Documents
page on https://mydocs.emc.com/VNX/. These guides include details about each I/O
module type, their part numbers, and part number locations.
Number Data Mover Number required Data Mover Number optional Data Mover slots
supported slots per Data Mover slot per Data Mover
Storage per Data
system Mover
VNX5300 3 slot 0 - slot 2 1 slot 0 2 slot 1 - slot 2
Note
Always install I/O modules in sets within a system or failover group. All Data Movers in a
system or failover group must have the same type of I/O modules in the same slots. Slot
0 in each Data Mover is reserved for connections to the storage array and for optional
tape backup devices. The other available slots can contain any type of network I/O
module that is supported for the system.
The following types of optional network I/O modules, shown in Figure 1 on page 5, are
available for Data Mover enclosure upgrades:
Note
If your are attempting to add an I/O module that requires a minimum VNX OE version
higher than the current version on your VNX, you must upgrade the VNX OE prior to
attempting the upgrade. For additional information on updating system software, go to
https://mydocs.emc.com/VNX/. Under VNX tasks, select Update VNX software. Select
appropriate settings for your configuration to generate a customized procedure to update
the VNX OE for your system.
4
Adding an I/O Module to a Data Mover
l 1-Gb/s Ethernet with two 10/100/1000 copper ports and two optical ports; labeled 1
GbE on the latch handle
l 1-Gb/s Ethernet module with four 10/100/1000 copper ports; labeled 1 GbE on the
latch handle
l 10-Gb/s Ethernet module with two RJ-45 ports; labeled 10 GbE BaseT on the latch
handle
Note
10-Gb/s Ethernet RJ-45 module requires VNX OE for File version 7.1 or greater.
l 10-Gb/s Ethernet module with two optical/Active Twin-Ax ports; labeled 10 GbE v3 on
the latch handle
Note
10-Gb/s Ethernet optical/Active Twin-Ax module requires VNX OE for File version 7.1
or greater.
Table 2 on page 5 lists the I/O modules available for the system and the number of
each module that is standard and/or optional.
Figure 1 Data Mover network I/O modules
1
cge-x-2 fge-x-2
2
cge-x-1 cge-x-1
1
fxg-x-0
cge-x-0 cge-x-0
0
0
Upgrade overview 5
Table 2 I/O modules limits per Data Mover (continued)
Note
Note
Use the following steps to disable Connect Home and email notification.
6
Adding an I/O Module to a Data Mover
Serial port
2. Open a terminal emulation program (For example, HyperTerminal or PuTTy) and use
the following settings to create a serial connection to CS 0:
l Bits per second: 19200
l Data bits: 8
l Parity: None
l Stop bits: 1
l Flow control: None
l Emulation: Auto Detect
l Telnet terminal ID: ANSI
3. Login as nasadmin.
4. Become the root user:
$ su root
Password:
3. Verify that the email notification service has stopped (is not enabled):
# /nas/bin/nas_emailuser -info
Note
Perform the following steps to determine the failover status of the Data Movers:
Procedure
1. Log in to CS 0 as nasadmin. Change to the root user by entering the following
command:
su root
2. Enter the following command to determine the Data Mover failover status:
# /nas/bin/nas_server -info -all
Sample output:
id = 1
name = server_2.faulted.server_3
acl = 0
type = standby
slot = 2
member_of =
standbyfor= server_2
status :
defined = out_of_service
actual = online, ready
id = 2
name = server_2
acl = 0
type = nas
slot = 3
member_of =
standby = server_2.faulted.server_3, policy=manual
status :
defined = enabled
actual = online, ready
8
Adding an I/O Module to a Data Mover
Note
If the type field is listed as nas, the Data Mover is a primary Data Mover. If the type
field is listed as standby, the Data Mover is a standby Data Mover. The standby field
lists which Data Mover is the standby for the primary Data Mover. The standbyfor
field lists the primary Data Mover for which the Data Mover is the standby.
3. If the name field indicates that a primary Data Mover is faulted and has failed over to
its standby, you will need to perform a restore on that primary Data Mover. Enter the
following command:
# /nas/bin/server_standby<server_name> -restore mover
Sample output:
4. Record the failover configuration in Table 3 on page 9. You will need this
information to recreate the failover relationships at the end of the upgrade.
server_3
Note
If the system has fewer Data Movers that the maximum number allowed, you will not
use all the rows in this table.
It is not required that you correct the Warnings or Information notifications at this time,
though it is recommended that these notifications be reviewed.
Note
If the secondary CS is currently acting as the primary CS, you will need to failback and
then continue to power down the secondary CS.
Note
The above command assumes that the system uses the default values for its internal
networking. If the system uses non-default values in its internal networking, use the
non-default internal IP address for CS 1 in the SSH command.
4. Exit the SSH session with CS1 to return to the session on CS0:
# exit
Note
If you do not exit the SSH session on CS1 before it powers down the SSH session will
become unresponsive. Close the terminal emulator program and reopen a connection
with the primary CS using the settings provided earlier in the procedure.
5. Verify that the secondary CS has powered off by monitoring the system reason codes:
# watch /nasmcd/getreason
10
Adding an I/O Module to a Data Mover
Note
Expect output for a two Control Station and two Data Mover system with CS1 powered
off:
6. After the secondary CS powers down, disconnect its power cable from the power
distribution panel (PDP).
Results
The secondary CS has been halted and powered off. Continue to the next section.
Note
You will manually recreate the failover relationships using the configuration
information recorded in Table 3 on page 9 after installing and configuring the new I/O
modules.
l stopping NAS services
l editing the DM 2 slicsignature (only required when upgrading a single-Data Mover
VNX)
Note
Sample Output:
server_2 : done
2. Repeat step 1 on page 11 for each failover relationship that needs to be deleted.
Note
If upgrading an I/O module in a single Data Mover system, prior to stopping NAS
service, run:
# /nas/bin/server_cpu <server_name> -q now
CAUTION
Stopping the NAS service will disrupt service on the system. Any process initiated by
the Control Station or any commands run from the /nas directory will be inhibited. Do
not to attempt to run this command while working in the /nas directory. Additionally,
after stopping NAS service, Unisphere and its alerts will be disabled until NAS service
is enabled later in this procedure.
Note
This command can take several minutes to complete. Wait until it completes before
proceeding to the next step.
# mount /nas
# mount /nbsnas
# mount /nas/dos
5. For single-Data Mover systems only, remove the I/O module signature used for
validation when the Data Mover boots:
a. Edit /nas/server/slot _2/device file and remove the line starting with
"slicsignature validate=....... Save the edited file.
Example Device File:
In the example below, remove the line
slicsignature validate=132613
b. Enter:
# export NAS_DB=/nas
c. Enter:
# /nas/sbin/build_config /nas/server/slot_2 /nas/dos/slot_2
12
Adding an I/O Module to a Data Mover
10/1
00/1
000
3
2
1
0
1
0
0
10/100/1000
10/100/1000
Once the button remains in, the I/O module is fully seated.
If the button springs back, gently push the module farther into the Data Mover, then
push the button again. If the button still does not rest flush with its handle, remove
the module and repeat steps 2 on page 13 and 3 on page 13 to install the module.
4. Repeat steps 1 on page 13 and 3 on page 13 for any other new I/O modules to be
installed into this Data Mover. Do not add new I/O modules to any other system Data
Movers at this time.
5. Run the following command to reboot the Data Mover:
# /nas/bin/server_cpu <server_name> -reboot now
Where <server_name> is the name of the Data Mover where the new I/O module is
installed.
If you deleted a failover relationships earlier, the Data Mover will reboot to Reason
Code 14. If no failover were removed, the Data Mover will reboot to Reason Code 4.
For single-Data Mover systems only, the Data Mover will reboot to Reason Code 4, not
14.
Note
For multi-Data Mover systems with failover configured, when the Reason Code for Data
Mover reaches 14, use ctrl + c to end the getreason monitoring. This will take
approximately 4-7 minutes.
# watch /nasmcd/sbin/getreason
Sample Output:
14
Adding an I/O Module to a Data Mover
5- slot_2 contacted
14- slot_3 hardware misconfigured
where <slot_number> is the Data Mover to be configured. This command can take up to
20 minutes per Data Mover to complete.
For example:
# /nasmcd/sbin/setup_slot -i 3
8. Run the following command to verify that the new I/O modules are listed in the
system inventory:
# /nasmcd/sbin/t2vpd -s <slot_number>
SLOT_3 RESUME_INFORMATION_IO_MODULE_1:
EMC_PART_NUMBER="303-081-103B "
EMC_ARTWORK_REVISION=" "
EMC_ASSEMBLY_REVISION="B08"
EMC_SERIAL_NUMBER="CF2C6092400023 "
VENDOR_NAME=" "
LOCATION_OF_MANUFACTURE="HOPKINTON, MA,
USA "
YEAR_OF_MANUFACTURE="2009"
MONTH_OF_MANUFACTURE="7 "
DAY_OF_MONTH_OF_MANUFACTURE="21"
ASSEMBLY_NAME="10GBE 2-PORT OPTICAL SLIC "
Note
Note
# watch /nasmcd/sbin/getreason
Sample Output:
Note
These non-EMC supplied public Ethernet cables should be hanging loose in the
cabinet. The other ends of these cables connect to the public network.
2. Connect the public LAN cables to the appropriate ports on the newly installed I/O
modules within the Data Mover.
Note
For successful Data Mover failover, you must establish identical network connections
for the primary and secondary Data Movers within a failover group.
16
Adding an I/O Module to a Data Mover
Sample Output:
server_2 : done
2. Verify that the Data Mover shows Reason Code 5, which indicates that the reboot is
complete:
# /nasmcd/sbin/getreason -s <slot_number>
Each Data Mover designated as standby will display their type as standby.
Results
The failover configuration has been restored. Go to the next task.
Powering up CS 1
If this is a dual-Control Station system, power up the secondary Control Station.
Otherwise, skip to the next task.
Procedure
1. Locate and re-connect the power cable of CS 1 to the PDP.
Figure 5 Location of CS Power Socket
Power socket
2. From CS 0, verify that CS 1, slot_1, is at Reason Code 11 before continuing to the next
step:
# watch /nasmcd/sbin/getreason
Powering up CS 1 17
Note
It is not required that you correct the Warnings or Information notifications at this time,
though it is recommended that these notifications be reviewed.
CRU failures
If the nas_checkup command returned a failed component, or the fault LED on the
component or DME is still lit, do the following:
Procedure
1. Wait one minute to see if the fault LED turns off. The component may take a few
seconds to turn off the LED.
2. If the fault LED remains lit, check that the component is properly inserted.
3. Open Unisphere using the following URL:
https://<control_station>
4. Use the drop-down list at the top left of the Dashboard to select the system.
5. Select System > Hardware > Hardware for File to view information about the hardware
components.
6. Check the system inventory for faulted hardware components.
7. Check the /nas/log/sys_log file using the following command to identify if the
CRU error is cleared and the LED has not turned off yet.
Note
Logging is only active when NAS service is running. If the NAS service is stopped the
following will be displayed as the last line in the log file:
Note
The sys_log file will contain error messages that relate to the CRU.
Example:
18
Adding an I/O Module to a Data Mover
Note
If the variable after the argument -tail in this command is blank, the output will
stream by quickly causing you to miss any error messages.
where <DM_enclosure_id> is the ID number of the DME containing the new component.
Example:
9. If you cannot identify the reason the CRU was unsuccessful, go to Support.emc.com >
Support > Service Center to get help. From Service Center, select one of the presented
options to request support.
Note
In all situations, you must have a valid login ID and password. If you do not have one,
you will need to register for one.
2. From the Connect Home configuration, determine the connections that are enabled:
# /nas/sbin/nas_connecthome -i
# /nas/sbin/nas_connecthome -t -email_1
or
# /nas/sbin/nas_connecthome -t -email_2
# /nas/sbin/nas_connecthome -t -https
or
# /nas/sbin/nas_connecthome -t -modem_1
4. Verify email notifications is configured:
# /nas/bin/nas_emailuser -info
If the Recipient Address(es) field is empty, email notifications has not been
configured and does not need to be enabled. If you want to configure email
notifications, use the /nas/bin/nas_emailuser command or Unisphere to
configure it.
If the Recipient Address(es) field is populated, email notifications was enabled. Re-
enable email notifications:
c. Test the configuration and verify that the configured Recipient Address(es)
received the test email:
# /nas/bin/nas_emailuser -test
Finishing up
Cable management is the most visual aspect of a hardware procedure. However, cable
management is often overlooked because it can be time consuming.
All Data Mover cables should be properly dressed so as not to interfere with each other or
other pieces of equipment. Use local practices to ensure that the cables attached to your
Data Mover are properly dressed.
To finish up:
Procedure
1. Dress and secure all cables so as to not disturb the cabling of other components when
you remove a replaceable unit (CRU or FRU).
Note
Typically, all cables come with the cable label clips attached to the cable. If the cables
do not have the cable label clips, attach them now.
2. Close out the terminal logging session and disconnect the management console from
the primary CS.
Your comments
Your suggestions will help us continue to improve the accuracy, organization, and overall
quality of the user publications.
20
Adding an I/O Module to a Data Mover
techpubcomments@EMC.com
Your comments 21
Copyright 2011-2014 EMC Corporation . All rights reserved. Published in USA.
EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without
notice.
The information in this publication is provided as is. EMC Corporation makes no representations or warranties of any kind with
respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a
particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable software
license.
EMC, EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the United States and other countries.
All other trademarks used herein are the property of their respective owners.
For the most up-to-date regulatory document for your product line, go to EMC Online Support (https://support.emc.com).
22