You are on page 1of 7


i am having MPIO on vio , i use lspath display 1 of the SAN disk in vio server.
# lspath -l hdisk12 -H -F "name parent connection path_id"
name parent connection path_id




how to explain connection and path_id
AIX: odmget examples
odmget -q"name=hdisk0" CuDv # get ODM object in the CuDv that describes
hdisk0 disk device
odmget -q"name=hdisk0 and attribute=pvid" CuAt # get ODM object that
stores the PVID
odmget -q"value3=hdisk0" CuDvDr # get major,minor number of special file
for hdisk0
odmget -q"name=rootvg" CuDep # query ODM class to identify all LVs that
belong to rootvg
odmget -q"parent=rootvg" CuDv # the same as previous command
Can be usefull when troubleshooting LVM related problems
User Rating:

/ 41

This article is based on a cheat sheet I use when setting up virtual scsi client
partitions. Just enough detail is provided to get the job done. The testing I leave
up to you!
The basis of setting up dual VIO servers will always be:

Setup First Virtual I/O Server
Test Virtual I/O setup
Setup Second Virtual I/O Server
Test Virtual I/O setup

Once the Virtual I/O Servers are prepared focus moves to the client partitions

* Test client stability In the following . Below I will switch back to padmin (note $ or # prompt for commands for padmin and root. Your adapter names may be different. or only one VIO server active.Do not run cfgmgr until AFTER the disks attributes have been set. Once the disks are not being used the following commands bring the disks and adapters offline (or into a defined state). The setup is based on a DS4300 SAN Storage server. If no clients are using the disks this is easy.e. Your attribute and interface names may be different. respectively). First. i. setup client. option is required when you cannot get the disks and/or adapters offlined (varyoffvg followed by several rmdev -l commands). And be sure to not use rmdev -d -l <device> as this just removes the device definition from the ODM and you have to restart.OR . not 4 parts. it is simple to get the disks setup for . Setup adapters This example is using an IBM DS4000 storage system. # rmdev -l dar0 -R # rmdev -l fscsi0 -R Update the adapter settings: # chdev -l fscsi0 -a fc_err_recov=fast_fail # chdev -l fscsi0 -a dyntrk=yes Setup Disks On my system the disks the first four disks are local and I have 8 LUNs that I want to make MPIO ready for the clients.* Setup client partition(s). Thus. But it is not just this one hints are provided on testing. with both VIO servers having the disks offline. When there are problems the first thing I check is whether the disk attribute reserve_setting has been set to none. make the changes to the ODM and reboot. Setting up Multiple Virtual I/O Servers(VIOS) The key issue is the LUNs exported from the SAN environment must always be available to any VIOS that is going to provide the LUN via the Virtual SCSI interfaceto Virtual SCSI client partitions (or client LPAR). To make an ODM change just add the parameter -P to the chdev -l commands below. otherwise you must get the client partition to varyoffvg the disks. The hdisk attribute that must be set on each VIOS for each LUN that will be used for a MPIO configuration isreserve_setting. but two parts: setup VIOS. For failover we also need setup the adapters. and usermdev -l to each disk/LUN. Note: to change any of these attributes the adapters and disks need to be in a defined state . reboot. Note: I have used the command oem_setup_env to switch from user padmin to root. The command cfgmgr will bring them back online with the new settings active. This second. make sure the disks are offline.

Finally.no_reserve. or loses connection with the SAN. The AIX installation sees the MPIO capability and install the drivers and creates the vpaths. The VX part is the most important that signifies that it is the same client partition (X == client partiion number). After AIX reboots there are few changes we want to make sure AIX recivers automatically incase one of the VIO servers goes offline. On the client For each LUN coming from the SAN do: # chdev -l hdiskX -a hcheck_mode=nonactive -a hcheck_interval=20 \ -a algorithm=failover -P As this is probably including your rootvg disks a reboot is required. . The easiest way to setup the client drivers is to just install it. # > > > > > for i in 4 5 6 7 8 9 10 11 do chdev -l hdisk$i -a pv=yes chdev -l hdisk$i -a reserve_policy=no_reserve chpv -C hdisk$i ## this "erases the disk so be careful! done Now I can activate the disks again using: # cfgmgr Setup Clients I assume you already know how to configure VSCI clients (you have already configured at least two VIO Servers!!) so I'll skip over the commands on the HMC for configuring the client partition.but before it is activated you need to map the LUNs available on the VIOS to the client. TheTY part signify the multiple paths. Once the client LPAR has been configured . $ mkvdev -vdev hdisk4 -vadapter vhost0 vtscsi0 Available You can verify the virtual target (vt) mapping using the command: $ lsmap -vadapter vhost 0 Repeat these commands on the other VIOS(s) and make sure they are all connected to the same VSCSI client (VX-TY). I make sure the client sees the disk as "clean". The TY is the Virtual I/O bus slot number and this will be different for each mapping. or modify on these disks. The command to do this is mkvdev. I also add that I want the VIO server to be aware of the pvid the clients put. Assuming that the VIOS are setup to have identical disk numbering any command you use on the first VIOS can be repeated on the second VIOS.

Path Control Module). By default fail_over is set to algorithm.sddpcm.fcp.ibm2105. Packaged as a kernel extension and multipathing module (PCM. No further configuration is required.53. without it puts it to define state) (The last path cannot be removed.mio.rte) -default PCM (MPIO): it comes with AIX (it is activated only if there are no SDD ODM definitions) -SDDPCM: SDD version which uses MPIO and has same commands as SDD (ODM def: devices. first change reservation policy and then algorithm: chdev -l hdiskX -a reserve_policy=no_reserve chdev -l hdiskX -a algorithm=round_robin smitty mpio mkpath -l hdiskX -p fscsiY add extra path that are attached to an adapter lspath lists paths (lspath -l hdisk46) lspath -l hdisk44 -H -F "name path_id parent connection status" shows many info chpath changing path state (enabbled. PCM is storage vendor supplied code that gets control from the device driver to handle the path management. With AIX and multipathing (on IBM storage) we have the following options: -classic SDD: (ODM definitions: ibm2105.disk. SDD driver: deviceis.2000000000000 deletes a path -------------------------------------------------Failed path handling: (there were Hitachi disks in Offline (E) state. To change it to round robin. Paths are discovered during system boot (cfgmgr) and disks are created from paths at the same time. but they were not unconfigured earlier) -lspath | grep -v Enab <-- . SDDPCM driver:devices.MPIO: Included as part of AIX at no charge. the command will fail if you try to remove the last path) rmpath -dl hdisk3 -p fscsi0 -w 50060e8000c3baf4.53.rte.rte.rte) MPIO is installed as part of the base OS.sdd. disabled) chpath -s enabled -l hdisk -p vscsi0 it will set the path to enabled status rmpath -dl hdiskX -p fcsiY dynamically remove all paths under a parent adapter (-d: deletes. Each storage device requires a PCM.

You cannot install SDD and SDDPCM together on a server. SDDPCM server daemon: SDDPCM has a server daemon running in the background: lssrc/stopsrc/startsrc -s pcmsrv psmsrv provides path-recovery function for SDDPCM devices these module added to the kernel: sddpcmke. (rmpath -dl hdisk0 -p vscsi0. The AIX MPIO device driver with the SDDPCM module enhances the data availability and I/O load balancing. multiple logical device instances are created for a physical LUN). the IBM System Storage SAN Volume Controller. and the IBM TotalStorage DS family. SDDPCM is loaded and becomes part of the AIX MPIO FCP (Fibre Channel Protocol) device driver.-rmpath -p fscsiX -d -cfgmgr -l fcsX -lspath | grep -v Enab -dlnkmgr view -lu -item -------------------------------------------------Change adapter setting online: rmpath -d -p vscsi0 <--removes all paths from adapt. Where only one logical device instance is created for a physical LUN you must install SDDPCM. When the supported devices are configured as MPIO-capable devices. sdduserke . it removes only specified path) rmdev -l vscsi0 <--puts adapter into defined state chdev -l vscsi0 -a vscsi_err_recov=fast_fail <--change adapter setting (if -P is used it will be activated after reboot) cfgmgr -l vscsi0 <--configure back adapter ------------------------------------------------------------------------------------------------------------------------------------------------- SDDPCM: SDDPCM is a loadable path control module designed to support the multipath configuration environment in the IBM TotalStorage Enterprise Storage Server. you should install SDD to get multipath support. When supported storage devices are configured as non-MPIO capable devices (that is.

pcmpath pcmpath query adapter shows adapter configuration pcmpath query version shows the version of the sddpcm pcmpath query device shows the sddpcm devices (pcmpath query device 44 <--shows only this device) pcmpath query essmap good overview pcmpath set device algorithm dynamically change the path selection algorithm pcmpath set device hc_mode dynamically chane the path health check mode pcmpath set device hc_interval dynamically change the path healthcheck time interval pcmpath set device M path N online/offline dynamically enable (online) or disable (offline) a path pcmpath set adapter N online/offline dynamically enable (online) or disable (offline) an adapter (SDDPCM resereves the last path of a device.07 2. Put all the Disabled path to Defined: -for i in `lspath | grep Dis | grep fscsiX| awk '{print$2}'`. it will fail if the device is using the last path) pcmquerypr reads and clear persisten reserve and registration keys pcmquerypr -vh /dev/hdisk30 to query and display the persistent reservation (-V verbose mode. If there are other paths still in Enabled or Failed state put them into Defined: .dlnkmgr): (this will put into Disabled state) -pcmpath set adapter 3 offline -dlnkmgr offline -hba 08. more details) pcmquerypr -rh /dev/hdisk30 release the persistent reservation if the device is reserved by the current host pcmquerypr -ch /dev/hdisk30 remove the persistent reservation and clear all reservation key registration pcmquerypr -ph /dev/hdisk30 remove the persistent reservation if the device is reserved by the other host pcmgenprkey SDDPCM MPIO devices ------------------------------------ set or clear the PR_key_value ODM attribute for all Change adapter settings (reconfigure paths): 1. If possible put the required adapter offline with the subsystem driver (pcmpath. done 3. do rmpath -l $i -p fscsiX.

Change the adapter settings -chdev -l fscsi1 -a dyntrk=yes -a fc_err_recov=fast_fail -chdev -l fcs1 -a init_link=pt2pt . Remove all devices from ODM from the mentioned adapter: -rmdev -Rl fcs2 -lsdev -p fscsi2 <--should not show the disks 5.-rmpath -l hdisk9 -p fscsi1 4.