You are on page 1of 14

EIS Installation Checklist for SAN Switch

Cisco 95xx

Customer
Sun Order Number:
CASE Number:
Technician:
Version EIS-DVD:
Date:

• It is assumed that the installation is carried out with the help of the current
EIS-DVD. See http://EIS/eisdvd for current information and status.
• The idea behind this checklist is to help the installer achieve a "good" installation.
• It is assumed that the installer has attended the appropriate training classes.
• It is assumed that any Sun server/storage (to which the switch will be attached) has
been installed according to the appropriate EIS installation checklist.
• This checklist can either be used when installing a new switch with storage (in
conjunction with appropriate server checklist) or just ArrayStart when adding a
storage.
• It is not intended that this checklist be handed over to the customer.
• The installation must have been prepared using the WINGS (Workflow
Information Gathering System).

SWITCH Serial# DomainID


Cisco 9509
Cisco 9513

Task Comment Check

PREPARATION
Site Audit complete? WINGS

System-Preparation complete?
Review latest FIN/FCO information. See EIS-web “Installation URLs”

Verify supported configuration. https://extranet.stortek.com/interop/interop

Statement-of-Installation signed?

Sun Internal and Approved Partners Only Page 1 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check

UNPACKING
Delivery complete?
Collect all software CDs. Store carefully!

Allow the system to acclimatise (power Refer to EIS standard “Acclimatisation of


off) at the customer site. Sun Servers & Storage”
Unpack outside data center to ensure no Collect packing material together for
contamination/dust is released inside disposal.
customer's controlled environment.
Verify all packing material has been Fans & air vents must be free to operate.
removed, i.e. nothing is blocked.
Collect documentation CDs. Give to customer during handover.

ASSEMBLY/CABLING
Review the official and latest revision of http://www.cisco.com/en/US/products/hw/
the documentation. ps4159/tsd_products_support_category_ho
me.html
Note the serial numbers. SNs are located on the front (port-side) on a
small sticker.

Mount switch in rack, if applicable. http://www.cisco.com/en/US/products/hw/


ps4159/tsd_products_support_category_ho
me.html
Connect switch to fibre cable.
Provide power to the switch. Note that the customer's electrician is
responsible for connecting the power lines
to the in-house power grid.
Check all components and power-on.

Sun Internal and Approved Partners Only Page 2 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check

INITIAL SWITCH SETTINGS


Establish serial communication with the Windows: HyperTerminal:
switch: • bits per second: 9600
• data bits: 8
• parity: none
• stop bits: 1
• flow control: none
Solaris: #tip -9600 /dev/term/a
Login administration Default username and password: admin /
admin
If prompted and desired, passwords should
be changed to meet customer requirements.
To change user passwords manually:
switch#config terminal
switch(config)#user admin password
<password>

Sun Internal and Approved Partners Only Page 3 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check
Utilize the guided setup to configure initial Switch# setup
settings and parameters of the switch. This
--- Basic System Configuration Dialog ----
configuration dialog allows for settings such as
the Ethernet management port, NTP server, and This setup utility will guide you through the
the switchname to be configured as per the basic configuration of the system. Setup
customer's specifications. configures only enough connectivity for
management of the system.
The example to the right does not configure
SNMP or NTP. Please configure any of desired *Note: setup is mainly used for configuring
parameters to the customer specifications. the system initially, ie when no
configuration is present. So setup always
The default settings for the last four parameters
assumes system defaults and not the current
are recommended best practices.
system configuration values.
• Default interface state as shut keeps devices
Press Enter at anytime to skip a dialog. Use
from automatically logging into the switch.
ctrl-c at anytime to skip the remaining
Ports must be manually enabled. dialogs.
• Default Zone policy as deny ensures that Would you like to enter the basic
devices that aren't specifically zoned will not configuration dialog (yes/no): y
accidently see each other. The only Create another login account (yes/no) [n]: n
exception to this best practice is when the Configure read-only SNMP community
switch will set up in a FICON environment. string (yes/no) [n]: n
The default zone policy must be allow for Configure read-write SNMP community
the switch to be managed by CUP. string (yes/no) [n]: n
Enter the switch name : <switchname>
Continue with Out-of-band (mgmt0)
management configuration? (yes/no) [y]: y
Mgmt0 IP address : <ipaddress>
Mgmt0 IP netmask : <netmask>
Configure the default gateway? (yes/no) [y]:
y
IP address of the default gateway :
<gateway>
Configure advanced IP options? (yes/no)
[n]: n
Enable the telnet service? (yes/no) [y]: y
Enable the ssh service? (yes/no) [n]: n
Configure the ntp server? (yes/no) [n]: n
Configure default switchport interface state
(shut/noshut) [shut]:
Configure default switchport trunk mode
(on/off/auto) [on]:
Configure default zone policy (permit/deny)
[deny]:
Enable full zoneset distribution? (yes/no)
[n]: y
The following configuration will be
applied:
switchname mds9120
interface mgmt0
ip address 129.80.10.10 255.255.255.128
no shutdown
ip default-gateway 129.80.10.254
telnet server enable
system default switchport shutdown
system default switchport trunk mode on
no zone default-zone permit vsan 1-4093
zoneset distribute full vsan 1-4093
Would you like to edit the configuration?
(yes/no) [n]: n
Use this configuration and save it? (yes/no)
Sun Internal and Approved Partners Only Page 4 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check
MANUALLY SETTING INITIAL SWITCH PARAMETERS
* Each subsequent examples shows the configuration being saved. If multiple parameters are to be
configured manually, the configuration only has to be saved once at the end. The command used to save
the configuration is copy running-config startup-config or simply copy run start.
Configure and show current Ethernet settings switch# config t
(mgmt0).
Enter configuration commands, one per
line. End with CNTL/Z.
mds9509(config)# interface mgmt0
switch(config-if)# ip address <IP
Address> <Netmask>
switch(config-if)# no shut
switch(config-if)# exit
switch(config)# ip default-gateway
<gateway IP>
switch(config)# exit
switch# copy run start
To show what the interface is currently set
to:
switch# show interface mgmt0
mgmt0 is up
Hardware is FastEthernet
Address is 0013.1957.4cfe
Internet address is 129.80.10.10/25
MTU 1500 bytes, BW 100 Mbps full
Duplex
234341 packets input, 17404175 bytes
0 multicast frames, 0 compressed
0 input errors, 0 frame, 0 overrun 0 fifo
52582 packets output, 45765135 bytes, 0
underruns
0 output errors, 0 collisions, 0 fifo
0 carrier errors
Switch Name. switch# config t
switch(config)# switch name <name>
switch(config)# exit
switch# copy run start
switch# show switchname
Setting a persistent Domain ID. switch# config t
switch(config)# fcdomain domain
<domainID#> static vsan <vsan#>
switch(config)# exit
switch# copy run start
NTP Server configuration. switch# config t
switch(config)# ntp server <NTP IP
address>
switch(config)# exit
switch# copy run start

Sun Internal and Approved Partners Only Page 5 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check
Syslogd logging server configuration. switch# config t
switch(config)# logging server <IP
address>
switch(config) exit
switch# copy run start
The facility for logging to the server can be
changed from the default of local7 by
adding the optional facility parameter to the
logging server configuration line.
Type logging server <IP Address>
facility ? for further details.
Timezone switch# config t
switch(config)# clock timezone
NameofTimezone Hoursoffset
MinOffset
The hour and minute offset are in regards to
UTC.
Eastern = -5
Central = -6
Mountain = -7
Pacific = -8
Example: switch(config)# clock timezone
MST -7 0
Date and Time switch# clock set hh:mm:ss dd
MonthInWords yyyy

example: mds9509# clock set 21:05:30 7


November 2006
Tue Nov 7 21:05:30 MST 2006
*note that there is no leading zero for the
day, and the time uses a 24 hour clock.

Sun Internal and Approved Partners Only Page 6 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check

FIRMWARE (SAN-OS) ADMINISTRATION


Verify which model of supervisor cards are switch# show module
present in the director. Mod Ports Module-Type Model Status
Firmware versions are specific to the version of
supervisor card.
1 16 1/2 Gbps FC Module DS-X9016 ok
Also, take note of which module is the standby. 2 32 1/2 Gbps FC Module DS-X9032 ok
This information will be needed shortly.
3 8 IP Storage Services Module
DS-X9308-SMIP ok
4 16 2x1GE IPS
14x1/2Gbps FC Module DS-X9302-14K9 ok
5 0 Supervisor/Fabric-2
DS-X9530-SF2-K9 active *
6 0 Supervisor/Fabric-2
DS-X9530-SF2-K9 ha-standby

The example above shows Supervisor 2


cards and should use Supervisor 2 firmware
Check the version of firmware currently running switch# show version
on the switch.
Cisco Storage Area Networking Operating
The kickstart and system versions listed are the System (SAN-OS) Software
version of SAN-OS on the switch.
TAC support: http://www.cisco.com/tac
The image files listed designate sf2 or supervisor
Copyright (c) 2002-2006, Cisco Systems,
2 version of firmware.
Inc. All rights reserved. The copyrights to
There is other information given by this certain works contained herein are owned
command such as hardware information and the by other third parties and are used and
switch uptime (not shown). distributed under license. Some parts of this
software are covered under the GNU Public
License.
A copy of the license is available at:
http://www.gnu.org/licenses/gpl.html.
Software
BIOS: version 1.1.0
loader: version 1.2(2)
kickstart: version 3.0(3)
system: version 3.0(3)
BIOS compile time: 10/24/03
kickstart image file is: bootflash:/m9500-
sf2ek9-kickstart-mz.3.0.3.bin
kickstart compile time: 9/15/2006
10:00:00 [10/01/2006 21:45:42]
system image file is: bootflash:/m9500-
sf2ek9-mz.3.0.3.bin
system compile time: 9/15/2006
10:00:00 [10/01/2006 22:02:16]
switch kernel uptime is 2 days 22 hours
40 minute(s) 42 second(s)

Sun Internal and Approved Partners Only Page 7 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check
If necessary upgrade the firmware version to the The firmware distribution method
latest supported version. currently under discussion.
Currently these patches are not on EIS-DVD due • MDS 9509/9513: Patches 126484-02
to space limitations. for SAN-OS v3.1(2) Supervisor-1
cards, 126485-02 for SAN-OS v3.1(2)
Supervisor-2 cards.

SUN alert ID 102788: DST Changes May


Affect Switch Products,see see
http://www.cisco.com/warp/public/63/dst_r
ecommendations.pdf

SUN alert ID 102776: Cisco MDS 9000


FC Generation 1 Port Module May Fail
Following a Firmware Upgrade or Service
Procedure.

Sun Internal and Approved Partners Only Page 8 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check

VSAN CONFIGURATION
A VSAN is just as the name suggests a virtual switch# show vsan membership
SAN. This is different from zoning. Having
vsan 1 interfaces:
multiple VSANs in a Cisco fabric is similar (in
communication aspects) to having multiple fc1/1 fc1/2 fc1/3 fc1/4 fc1/5 fc1/6 fc1/7 fc1/8 fc1/9
fc1/10 fc1/11 fc1/12 fc1/13 fc1/14 fc1/15 fc1/16 fc2/1
physical SANs. fc2/2 fc2/3 fc2/4 fc2/5 fc2/6 fc2/7 fc2/8 fc2/9
fc2/10 fc2/11 fc2/12 fc2/13 fc2/14 fc2/15 fc2/16 fc2/17
In the basic Cisco configuration (without the fc2/18 fc2/19 fc2/20 fc2/21 fc2/22 fc2/23 fc2/24 fc2/25
added licenses to perform Inter-VSAN routing) it fc2/26 fc2/27 fc2/28 fc2/29 fc2/30 fc2/31 fc2/32 fc4/1
fc4/2 fc4/3 fc4/4 fc4/5 fc4/6 fc4/7 fc4/8 fc4/9 fc4/10
is important to make sure all devices that are to fc4/11 fc4/12 fc4/13 fc4/14
communicate with each other exist in the same
VSAN.
vsan 4094(isolated_vsan) interfaces:
By default all ports on the switch are designated
as members of VSAN 1. Creating any additional
VSANs is optional and is not required for basic switch#
Cisco fabric functionality.
Warning – Communication between devices in
different VSANs is not possible without
additional enterprise licensing enabling Inter-
VSAN-routing.
To create additional VSANs: switch# config t
(OPTIONAL) Enter configuration commands, one per
line. End with CNTL/Z.
switch#(config)# vsan database
This specific example creates VSAN 10. Also,
switch#(config-vsan-db)# vsan 10
each VSAN on a switch has its own domain id. switch(config-vsan-db)# exit
To assign it a static domain ID, it must be
switch(config)# fcdomain domain
designated specifically (as shown). The <domainID#> static vsan 10
allowable range of VSANs that can be be created
switch(config)# fcdomain restart vsan 10
range from 2-4093. switch(config)# exit
switch# show vsan
If the domain id is going to be changed, it is vsan 1 information
necessary to restart the vsan fcdomain. Once the
name:VSAN0001 state:active
fcdomain is restarted, the current domain and interoperability mode:default
configured domain should both reflect the
loadbalancing:src-id/dst-id/oxid
desired domain id. operational state:down
vsan 10 information
Once again, the copy run start command at the name:VSAN0010 state:active
end saves the configuration, if multiple changes
interoperability mode:default
to the configuration are to be done, this loadbalancing:src-id/dst-id/oxid
command doesn't need to be done until the end of
operational state:down
all changes.
vsan 4094:isolated_vsan
switch# show fcdomain
VSAN 10
The local switch is the Principal Switch.
Local switch run time information:
State: Stable
Local switch WWN:
20:14:00:0d:ec:12:e6:01
Running fabric name:
20:14:00:0d:ec:12:e6:01
Running priority: 128

Sun Internal and Approved Partners Only Page 9 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check
Current domain ID: 0x0a(10)
Local switch configuration information:
State: Enabled
FCID persistence: Enabled
Auto-reconfiguration: Disabled
Contiguous-allocation: Disabled
Configured fabric name:
20:01:00:05:30:00:28:df
Optimize Mode: Disabled
Configured priority: 128
Configured domain ID: 0x0a(10)
(static)

Principal switch run time information:


Running priority: 128
switch# copy run start
To add interface ports to a specific VSAN switch# config t
Enter configuration commands, one per
line. End with CNTL/Z.
(OPTIONAL)
switch#(config)# vsan database
This example shows two ports fc2/1 and fc2/4
placed into an already existing VSAN 10. switch(config-vsan-db)# vsan 10 interface
fc2/1
switch(config-vsan-db)# vsan 10 interface
fc2/4
switch(config-vsan-db)# do show vsan
membership
vsan 1 interfaces:
fc1/1 fc1/2 fc1/3 fc1/4 fc1/5 fc1/6 fc1/7 fc1/8
fc1/9 fc1/10 fc1/11 fc1/12 fc1/13 fc1/14 fc1/15 fc1/16
fc2/2 fc2/3 fc2/5 fc2/6 fc2/7 fc2/8 fc2/9 fc2/10
fc2/11 fc2/12 fc2/13 fc2/14 fc2/15 fc2/16 fc2/17
fc2/18 fc2/19 fc2/20 fc2/21 fc2/22 fc2/23 fc2/24
fc2/25 fc2/26 fc2/27 fc2/28 fc2/29 fc2/30 fc2/31
fc2/32 fc4/1 fc4/2 fc4/3 fc4/4 fc4/5 fc4/6 fc4/7
fc4/8 fc4/9 fc4/10 fc4/11 fc4/12 fc4/13 fc4/14

vsan 10 interfaces:
fc2/1 fc2/4

vsan 4094(isolated_vsan) interfaces:


switch(config-vsan-db)# end
switch# copy run start

Sun Internal and Approved Partners Only Page 10 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check

ZONING CONFIGURATION
To create an alias: switch# config t
Aliases that are created must be assigned to a switch(config)# fcalias name
specific VSAN. If no other VSANs were created <aliasName> vsan <vsan#>
the default VSAN 1 must be designated.
switch(config-fcalias)# member <type>
Aliases can be created using any of the following <value>
types:
Example:
1. pwwn (Port WWN of the end device)
switch(config)# fcalias name
2. fwwn (port WWN of the switch port) TapeDrive10 vsan 10
3. fcid (Fabric id of the device in 0xhhhhhh switch(config-fcalias)# member pwwn
format) 50:01:04:f0:12:67:45:ab
switch(config-fcalias)# end
To show all currently defined aliases:
switch# show fcalias
To save configuration once completed:
switch# copy run start
To create a Zone and add members: switch# config t
Zones that are created must be assigned to a switch(config)# zone name <ZoneName>
specific VSAN. vsan <vsan#>
If no other VSANs were created the default switch(config-zone)# member <type>
VSAN 1 must be designated. <value>
Members can be added to the zones via a number port WWN example:
of different types. The following types are switch(config-zone)# member pwwn
allowed: 21:00:00:e0:8b:12:34:ab
1. pwwn (Port WWN of the end device) fcid example:
switch(config-zone)# member fcid
2. fwwn (port WWN of the switch port) 0x5e0001
3. fcid (Fabric id of the device in 0xhhhhhh
domain, port example:
format) switch(config-zone)# member domain-id
4. fcalias (alias created to designate a specific 2 portnumber 10
device) interface example:
5. domain-id # portnumber # (domain and switch(config-zone)# member interface
port of a switch) fc1/17
6. ipaddress (IP address, if applicable) switch(config-zone)# end
7. interface (Switch interface designation for a To show the zone members of all zones:
specific port) switch# show zone
zone name Zone1 vsan 10
fcid 0x5e0001
Save configuration once completed:
switch# copy run start

Sun Internal and Approved Partners Only Page 11 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check
To Create a Zoneset and add Zones to it: switch# config t
switch(config)# zoneset name
<ZonesetName> <vsan#>
Adding Zones to the Zoneset:
switch(config-zoneset)# member
<ZoneName>
switch(config-zoneset)# end
Save configuration once completed:
switch# copy run start
Activating / Deactivating a Zoneset switch# config t
The copy run start command to save the switch# zoneset activate name
running config to the startup config does not need <ZonesetName> vsan <vsan#>
to be issued after activating a zoneset, only after
to deactivate a zoneset:
changes to the zoneset.
switch# no zoneset activate name
<ZonesetName> vsan <vsan#>

Task Comment Check

CONFIGURATION/SWITCH LOG MANAGEMENT


Saving the current switch configuration settings switch#(config) end
switch# copy run start
This command can only be executed from the
main switch prompt. If at anything other than or
the main switch prompt either type do before the
switch#(config) do copy run start
command or end to get back to the main prompt.
copy run start is shorthand for copy running-
config startup-config
Saving the current switch settings off to a file via switch# copy startup-config
FTP or TFTP server. tftp://ipaddress/filename
If utilizing windows laptop to upgrade the TFTP Example:
firmware a third party FTP or TFTP server will
switch# copy startup-config
have to be installed and configured on the laptop.
tftp://10.10.10.86/configfile
Also, if saving the configuration to a windows
Trying to connect to tftp server......TFTP put
laptop, ensure that any firewall software (such as
blackice) is disabled otherwise the switch will not operation was successful
be able to communicate it. switch#
FTP Example:
switch# copy startup-config
ftp://129.147.43.86/test2
Enter username: ftpuser
Password:
switch#
Gathering technical support information into a switch# show tech-support details
file:
the information will scroll across the screen and
will need to be captured.

Sun Internal and Approved Partners Only Page 12 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check

FOR SUN/SPARC SERVERS WITHOUT SERVERSTART


These steps are only required if the switch is being added to an existing server, since a newly-
installed server (using the appropriate EIS checklist) will avoid the issues below.
Insert EIS-DVD into each host & run the Ensure that current explorer etc. are
setup-standard script: available.
cd ...sun/install
sh setup-standard.sh
Ensure that any missing SFS (San
Foundation Suite) packages are installed
by setup-standard.
Verify that the Solaris & SAN patches Run Griffon from EIS-DVD on a current
are current. explorer. If Griffon shows
missing/downrevved patches then consider
scheduling patch update as below.
If necessary, update the Solaris & SAN This assumes that a scheduled shutdown of
patches from the EIS-DVD and reboot. the host is possible.

The SAN patches are only separate for Solaris 8 Solaris patches: .../sun/patch/<Vn>.
& 9 – for Solaris 10 the SAN patches are part of Patches for SFS from EIS-DVD:
the Solaris set. • Solaris 8 & 9: .../sun/patch/SAN
• Solaris 8: .../sun/patch/SAN/8
• Solaris 9: .../sun/patch/SAN/9

Task Comment Check

HOST CONNECTION FOR SUN/SPARC SERVERS


Check if HBA Fcode is at required luxadm fcode -p
level.
Fcode patches are on EIS-DVD in
...sun/patch/firmware/FCODES.
See also file HBA.txt in same directory.

ACTIONS FOR SERVER ONLY


Verify that the OS can see the target #>cfgadm -al
devices.
Configure access to the relevant targets. #>cfgadm -c configure c [number(s)]

Review the dimensions and label if #>format


necessary.

Sun Internal and Approved Partners Only Page 13 of 14 V 1.2 Created: 22 Jun 07
Task Comment Check
VERIFICATION – PERFORM ONLY here for ArrayStart without ServerStart
Log into the switch(s), in a terminal window run:
#show tech-support details
Explorer does not yet capture Cisco switch data. CR 6527576 has been
created to get this functionality.
Run Griffon (from EIS-DVD) locally cd /cdrom/.../sun/tools
cd Griffon
to analyse the explorer output file. sh run-griffon.sh

Examine the results. Examine the resulting report:


If necessary repair & repeat more /tmp/griffon_report.txt
explorer/Griffon sequence.
Mail explorer file to:
EMEA: explorer-database-emea@sun.com
APAC: explorer-database-apac@sun.com
AMER: explorer-database-americas@sun.com
The explorer output file is normally in directory /opt/SUNWexplo/output with filename
explorer.<hostid>.<hostname>-<date>.tar.gz
If e-mail from customer site not possible please transport file to Sun office & send the e-mail
from there.
VERIFICATION – Perform Always
Connectivity verification Connected LEDs are on.

LUN verification LUN have been seen by the OS.

Fail over testing (for pair of switch Defined in the delivery documentation.
only)
INSTALLATION COMPLETION
Complete documentation and hand over WINGS
to customer.
Obtain customer sign-off for service WINGS
completion.

Copies of the checklists are available under http://EIS/checklists or on the EIS-DVD.

Comments & RFEs are welcome. Please use ServiceDesk (Search Problem/Service & enter "EIS")
or mail to EIS-DESK@sun.com if no SWAN access available – typically for a partner.

Sun Internal and Approved Partners Only Page 14 of 14 V 1.2 Created: 22 Jun 07