Professional Documents
Culture Documents
Aix Odm For Mpio User Guide
Aix Odm For Mpio User Guide
User Guide
Issue 15
Date 2021-03-01
and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd.
All other trademarks and trade names mentioned in this document are the property of their respective
holders.
Notice
The purchased products, services and features are stipulated by the contract made between Huawei and
the customer. All or part of the products, services and features described in this document may not be
within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements,
information, and recommendations in this document are provided "AS IS" without warranties, guarantees
or representations of any kind, either express or implied.
The information in this document is subject to change without notice. Every effort has been made in the
preparation of this document to ensure accuracy of the contents, but all statements, information, and
recommendations in this document do not constitute a warranty of any kind, express or implied.
Website: https://e.huawei.com
Purpose
This document describes the AIX ODM for MPIO and explains how to configure
and manage AIX ODM for MPIO.
Intended Audience
This document is intended for:
Symbol Conventions
The symbols that may be found in this document are defined as follows.
Symbol Description
Conventions
The purchased products, services, and features are stipulated by the commercial
contract made between Huawei and the customer. All or partial products, services
and features described in this document may not be within the purchased scope or
the usage scope. Unless otherwise agreed by the contract, all statements,
information, and recommendations in this document are provided "AS IS" without
warranties, guarantees, or representations of any kind, either express or implied.
As part of an effort to improve and enhance the product performance and
capabilities, Huawei Technologies Co., Ltd. periodically releases revisions of the
hardware and software. Therefore, some functions described in this document may
not be supported by all versions of the software or hardware currently in use. For
the most up-to-date information about product features, refer to the product
release notes.
If a product does not function as described in this document, contact Huawei
technical support engineers.
Change History
Changes between document issues are cumulative. The latest document issue
contains all the changes made in earlier issues.
Issue 15 (2021-03-01)
This is the fifth official release.
Optimized some descriptions in documents.
Issue 14 (2021-01-10)
This is the fourteenth official release.
Optimized some descriptions in documents.
Issue 13 (2020-10-10)
This is the thirteenth official release.
Optimized some descriptions in documents.
Issue 12 (2020-06-30)
This is the twelfth official release.
Optimized some descriptions in documents.
Issue 11 (2019-02-26)
This is the eleventh official release.
Optimized some descriptions in documents.
Issue 10 (2019-01-30)
This is the tenth official release.
Issue 09 (2018-03-01)
This is the ninth official release.
Issue 08 (2017-12-14)
This is the eighth official release.
Issue 07 (2017-06-24)
This is the seventh official release.
Issue 06 (2017-03-30)
This is the sixth official release.
Issue 05 (2016-09-20)
This is the fifth official release.
Issue 04 (2016-05-20)
This is the fourth official release.
● Updated the AIX ODM for MPIO version to the latest one in the command
output.
● Added the description of the load balancing mode.
Issue 03 (2016-01-30)
This is the third official release.
Issue 02 (2015-10-20)
This is the second official release.
Issue 01 (2015-01-30)
This issue is the first official release.
Contents
7 FAQs..........................................................................................................................................29
7.1 What Are Known Bugs That Affect This Software and Corresponding Patches?........................................... 29
7.2 Modifying the Attributes of the fscsi Device............................................................................................................... 30
7.3 How Can I Set a Load Balancing Mode for a Disk?.................................................................................................. 32
7.4 How Can I Configuring the ReserveCheck and ReserveBreak Functions?.........................................................34
7.5 How Do I Use UltraPath for AIX to Replace AIX ODM for MPIO in SAN Boot Scenarios?......................... 35
7.6 How Do I Use System Commands to Query Detailed Information About a LUN? (Applicable to
odmcfg.fcp.MPIO.rte 2.1.8.1 and Later Versions).............................................................................................................. 36
7.7 How Do I Install AIX ODM for MPIO Using the NIM RTE Deployment Mode?.............................................. 38
1 Software Functions
The AIX ODM for MPIO software identifies and takes control of Huawei storage
devices, masks physical disks, and generates virtual disks, but it cannot switch
LUNs' owning controllers. AIX ODM for MPIO supports SAN Boot on controlled
Huawei storage devices.
2 Installation Preparation
Version Remarks
7100-00~7100-04 -
7200-00~7200-03 -
NOTE
For details about the AIX operating system version, see Huawei Storage
Interoperability Navigator.
You need to acquire root permission to install AIX ODM for MPIO.
Run the oslevel -s command to check the system version.
bash-3.00# oslevel -s
6100-07-00
2. Do not install UltraPath for AIX, AIX ODM for Non-MPIO, AIX ODM for MPIO,
or AIX ODM for MPIO_RTE before installing AIX ODM for MPIO. Run the
following commands to check whether UltraPath for AIX, AIX ODM for Non-
MPIO, AIX ODM for MPIO, and AIX ODM for MPIO_RTE have been installed.
NOTE
The following uses UltraPath for AIX, AIX ODM for Non-MPIO, and AIX ODM for MPIO
as an example.
● If UltraPath for AIX is installed, uninstall it by referring to "Uninstalling UltraPath"
in the OceanStor UltraPath for AIX User Guide.
● If AIX ODM for Non-MPIO is installed, uninstall it by referring to "Uninstalling AIX
ODM for Non-MPIO" in the AIX ODM for Non-MPIO User Guide.
● If AIX ODM for MPIO is installed, uninstall it by referring to "Uninstalling AIX ODM
for MPIO" in the AIX ODM for MPIO User Guide.
● If the AIX ODM for MPIO_RTE software has been installed, uninstall it by referring
to "Uninstalling AIX ODM for MPIO_RTE" in the AIX ODM for MPIO_RTE User
Guide.
– Run the lslpp -l U*.rte command to check whether UltraPath for AIX is
installed.
bash-3.00# lslpp -l U*.rte
Fileset Level State Description
----------------------------------------------------------------------------
Path: /usr/lib/objrepos
UltraPath.AIX.ppc_64.rte X.X.XXX.X COMMITTED UltraPath for AIX
NOTE
● For details about the AIX operating system version and VIOS version, see Huawei
Storage Interoperability Navigator.
Software Packages
Check whether you have prepared the required software packages. Table 2-1 lists
the software packages.
NOTICE
In the AIX operating system, the name of the directory where the installation
package resides cannot contain spaces. Otherwise, running installp fails.
Common virtual LUNs are virtual LUNs except virtual HyperMetro LUNs and virtual
migration LUNs.
Context
The space of /opt and /usr directories must be both larger than 10 MB.
NOTE
If the space of either of them is smaller than 10 MB, the software cannot be successfully
installed.
Procedure
Step 1 Run df -m to check the space of /opt and /usr directories.
bash-3.00# df -m
Filesystem MB blocks Free %Used Iused %Iused Mounted on
/dev/hd4 17152.00 10209.42 41% 67463 3% /
The free space of the /opt and /usr directories is 1091.34 MB and 9966.45 MB
respectively.
----End
Procedure
Step 1 Run lsdev -Cc disk to check whether the redundant disks are found.
# lsdev -Cc disk
hdisk0 Available 1Z-08-00-8,0 16 Bit LVD SCSI Disk Drive
hdisk1 Available 1Z-08-00-9,0 16 Bit LVD SCSI Disk Drive
hdisk2 Available 1A-08-02 Other FC SCSI Disk Drive
hdisk3 Available 1A-08-02 Other FC SCSI Disk Drive
hdisk4 Available 1A-08-02 Other FC SCSI Disk Drive
● 16 Bit LVD SCSI Disk Drive indicates a local disk on the application server.
● Other FC SCSI Disk Drive indicates a redundant physical disk detected by the
application server when UltraPath for AIX is not installed.
● hdisk0 and hdisk1 are local hard disks on the application server. hdisk2 to
hdisk4 are the redundant physical disks.
Step 2 Run the lscfg -vpl Name command to check the manufacturer's information of
redundant disks. If redundant disks of Huawei storage system exist, run the rmdev
-dl command to delete all redundant physical disks mapped from the storage
system to the application server. If redundant disks of Huawei storage do not exist,
skip this step. Checking the manufacturer's information of hdisk2 is used as an
example.
# lscfg -vpl hdisk2
hdisk2 U787B.001.DNWF39F-P1-C1-T1-W20180022A1073FDD-
L1000000000000 Huawei S5500T FC Disk Drive
Manufacturer................HUAWEI
Machine Type and Model......S5500T
...
PLATFORM SPECIFIC
Name: disk
Node: disk
Device Type: block
NOTICE
● Before running the rmdev -dl command to delete the disks, run the lspv
command to check whether the disks belong to a VG one by one. If a disk
belongs to a VG and is Active, run the varyoffvg command to deactivate the
VG.
● In the SAN Boot environment, you do not need to delete the system disk.
Command format:
rmdev -dl disk_name
Command description:
disk_name indicates the name of a redundant physical disk.
For example:
# rmdev -dl hdisk2
Command output:
hdisk2 deleted
----End
Procedure
Step 1 Run the lslv -m hd5 command to obtain the boot device of the current operating
system. In the following command output, the boot device is hdisk0.
# lslv -m hd5
hd5:N/A
LP PP1 PV1 PP2 PV2 PP3 PV3
0001 0001 hdisk0
Step 2 Run the bootinfo -b command to obtain the boot device of the current operating
system. In the following command output, the boot device is hdisk0.
# bootinfo -b
hdisk0
NOTE
The boot devices obtained by the lslv -m hd5 and bootinfo -b commands must be the
same.
● If the query result of the bootinfo -b command is empty, go to Step 3.
● If the query result of the bootinfo -b command is not empty, go to Step 4.
Step 3 Run the bootlist -m normal -o hdiskX command to configure the boot device
item. In the command, hdiskX is the boot device obtained in Step 1.
NOTE
After the configuration, restart the AIX operating system and go to Step 1 to perform the
check again.
NOTE
In the command output, the device number of ipldevice (22, 0) and that of rhdiskX (22, 0)
must be the same. If the device numbers are different, run the ln /dev/rhdiskX /dev/
ipldevice command to re-create a boot device link.
Step 5 Run the lsvg -p rootvg command to show the disk used by rootvg.
# lsvg -p rootvg
rootvg:
PV_NAME PV STATE TOTAL PPs FREE PPs FREE DISTRIBUTION
hdisk0 active 546 0 00..00..00..00..00
NOTE
Step 6 If there is more than one path between the host and the storage device,
redundant physical disks are generated. Then run the lspv command to check
whether there are repeated PVIDs.
# lspv
hdisk0 0001fa696441ac6d rootvg active
hdisk1 0001fa696441ac6d rootvg active
hdisk2 0001fa696441ac6d rootvg active
hdisk3 0001fa696441ac6d rootvg active
The PVIDs read from the same LUN are the same, so the rootvg states of these
physical disks are all active.
● If the lspv command output contains multiple repeated PVIDs, go to Step 7.
● If the lspv command output does not contain any repeated PVIDs, go to Step
8.
Step 7 Run the rmdev -dl hdiskX command to delete the redundant disks rather than
the boot device.
# rmdev -dl hdisk1
hdisk1 deleted
# rmdev -dl hdisk2
hdisk2 deleted
# rmdev -dl hdisk3
hdisk3 deleted
Step 8 Run the bosboot -v command to perform the bosboot command verification. If
the verification is successful, no command output is displayed.
# bosboot -v
#
----End
Procedure
Step 1 Run the lsdev -Cc driver|grep fscsi command to obtain the fscsi device in the
current system.
# lsdev -Cc driver|grep fscsi
fscsi0 Available 00-08-01 FC SCSI I/O Controller Protocol Device
fscsi1 Available 09-08-01 FC SCSI I/O Controller Protocol Device
----End
The AIX ODM for MPIO software enables the built-in MPIO of the AIX system to
identify and take over Huawei storage devices and allows SAN Boot to be
performed on Huawei storage devices that have been taken over. This chapter
describes the environment requirements and procedures for installing AIX ODM for
MPIO.
Prerequisites
The application server and storage system meet the operating requirements and
the software package has been prepared.
Procedure
Step 1 Log in to the application server as user root.
Step 2 Use the digital signature verification tool to verify the integrity of the software
package.
NOTE
Download the digital signature verification tool from Huawei technical support website
(https://support.huawei.com/enterprise for enterprises; https://support.huawei.com for
carriers) to verify the integrity of the software package. If the verification fails, contact
technical support engineers to obtain the secure software package.
Step 3 Optional: Check whether the AIX application server on which you want to install
AIX ODM for MPIO is based on the VIOS environment.
1. If the NPIV of the VIOS mechanism is used, AIX ODM for MPIO must be
installed on the client AIX partition.
2. If the vSCSI of the VIOS mechanism is used, AIX ODM for MPIO must be
installed on the VIOS partition. If you log in to the application server as user
padmin, run the oem_setup_env command to enter the oem mode of the
VIOS before the installation.
Step 4 Check whether UltraPath for AIX, AIX ODM for MPIO, or AIX ODM for Non-MPIO
has been installed. For details, see 2.1 Environment Requirements.
Step 5 Decompress the OceanStor_AIX_ODM.zip package on the Windows host. After
the decompression, the AIX_ODM folder is generated.
SUCCESSES
---------
Filesets listed in this section passed pre-installation verification
and will be installed.
Selected Filesets
-----------------
odmcfg.fcp.MPIO.rte X.X.X.X # MPIO Support for Disk Arrays
FILESET STATISTICS
------------------
1 Selected to be installed, of which:
1 Passed pre-installation verification
----
1 Total to be installed
NOTE: On a SAN network, set dyntrk of the HBAs to yes and fc_err_recov to fast_fail.
Finished processing all filesets. (Total time: 11 secs).
Summaries:
+-----------------------------------------------------------------------------+
Installation Summary
--------------------
Name Level Part Event Result
-------------------------------------------------------------------------------
odmcfg.fcp.MPIO.rte X.X.X.X USR APPLY SUCCESS
NOTE
● If the operations described in 2.5 Optional: Configuring an HBA Before Installing AIX
ODM for MPIO in the SAN Boot Environment have been performed, skip Step 10 and
go to Step 11.
● In SAN networking, set dyntrk to yes and fc_err_recov to fast_fail for the fscsi logical
device.
● Modify the HBAs connected to Huawei storage only, excluding unused ones.
● IBM has configuration requirements on the Fibre Channel network of an AIX system,
that is, the HBA attributes must be modified. This has nothing to do with the storage
system.
1. Run the lsattr -El fscsiX command to query attributes of the fscsi device
connected to Huawei storage. The following example shows attributes of the
fscsi device in a SAN network.
-bash-3.00# lsattr -El fscsi0
attach switch How this adapter is CONNECTED False
dyntrk yes Dynamic Tracking of FC Devices True
fc_err_recov fast_fail FC Fabric Event Error RECOVERY Policy True
scsi_id 0x10000 Adapter SCSI ID False
sw_fc_class 3 FC Class for Fabric True
2. For details about how to modify attributes of the fscsi device, see 7.2
Modifying the Attributes of the fscsi Device.
Step 11 Optional: In the SAN Boot environment, restart the application server.
----End
This chapter describes the procedure for upgrading AIX ODM for MPIO.
Prerequisites
● Services on the software-related disks have been stopped.
● The file system has been unmounted.
● All Huawei storage disks have been deleted.
NOTE
You do not need to delete system disks under the SAN Boot environment because the
SAN Boot system runs on Huawei storage and cannot be deleted.
Procedure
Step 1 Uninstall the software of the earlier version by referring to 5 Uninstalling AIX
ODM for MPIO.
Step 2 Install the software of the later version by referring to 3 Installing AIX ODM for
MPIO.
----End
Procedure
Step 1 Log in to the application server.
Step 2 Optional: Check whether the AIX application server on which you want to install
AIX ODM for MPIO is based on the VIOS environment.
1. If the NPIV of the VIOS mechanism is used, AIX ODM for MPIO must be
installed on the client AIX partition.
2. If the vSCSI of the VIOS mechanism is used, AIX ODM for MPIO must be
installed on the VIOS partition. If you log in to the application server as user
padmin, run the oem_setup_env command to enter the oem mode of the
VIOS before the installation.
● Run the lscfg -vpl name command to check whether the disks are Huawei
storage disks.
bash-3.00# lscfg -vpl hdisk2
hdisk2 U788C.001.AAB4099-P1-C14-C2-T1-W20080022A10BB2D5-L1000000000000 Other FC
SCSI Disk Drive
Manufacturer................HUAWEI
Machine Type and Model......S5500T
...
PLATFORM SPECIFIC
Name: disk
Node: disk
Device Type: block
NOTE
Step 4 Determine whether virtual disks need to be deleted. If no, skip this step. If yes, run
the rmdev -dl command to delete virtual disks.
NOTE
● In SAN Boot, run the rmdev -dl name command to delete virtual disks except system
disks.
● In non-SAN Boot, run the rmdev -dl name command to delete virtual disks.
bash-3.00# rmdev -dl hdisk2
hdisk2 deleted
NOTE
Before deleting virtual disks, confirm that no I/Os are being processed on the disks and the
virtual group to which the virtual disks belong is not activated. Otherwise, the virtual disks
cannot be successfully deleted.
Step 5 Check the name of the installed AIX ODM for MPIO software.
Run the lslpp -l odmcfg.fcp.MPIO.rte command to check the name of the
installed AIX ODM for MPIO software.
bash-3.00# lslpp -l odmcfg.fcp.MPIO.rte
Fileset Level State Description
----------------------------------------------------------------------------
Path: /usr/lib/objrepos
odmcfg.fcp.MPIO.rte X.X.X.X COMMITTED MPIO Support Disk Arrays
NOTE
SUCCESSES
---------
Filesets listed in this section passed pre-deinstall verification
and will be removed.
Selected Filesets
-----------------
odmcfg.fcp.MPIO.rte X.X.X.X # MPIO Support for Disk Arrays
FILESET STATISTICS
------------------
1 Selected to be deinstalled, of which:
1 Passed pre-deinstall verification
----
1 Total to be deinstalled
Installation Summary
--------------------
Name Level Part Event Result
-------------------------------------------------------------------------------
odmcfg.fcp.MPIO.rte X.X.X.X USR DEINSTALL SUCCESS
NOTE
Step 7 Optional: Restart the application server under the SAN Boot environment. Clear
residual ODM information following 6.1 Deleting Residual Information after the
AIX system is started. Otherwise, the AIX system may fail to be started during
subsequent installation of UltraPath for AIX.
----End
6 Troubleshooting
Procedure
Step 1 Check whether there are Huawei storage disks.
1. Check disks.
Run lsdev -Cc disk to check disks.
bash-3.00# lsdev -Cc disk
lsdev: 0514-521 Cannot find information in the predefined device
configuration database for the customized device hdisk2.
lsdev: 0514-521 Cannot find information in the predefined device
configuration database for the customized device hdisk3.
hdisk0 Available 06-08-01-5,0 16 Bit LVD SCSI Disk Drive
hdisk1 Available 06-08-01-8,0 16 Bit LVD SCSI Disk Drive
hdisk2 Available 01-08-01 N/A
hdisk3 Available 01-08-01 N/A
2. Check whether the disks that described as N/A are Huawei storage disks, as in
the example hdisk2.
Run lscfg -vpl name to check whether the disks are Huawei storage disks.
bash-3.00# lscfg -vpl hdisk2
0519-004 libodm: The specified search criteria is incorrectly formed.
Make sure the criteria contains only valid descriptor names and
the search values are correct.
hdisk2 U787B.001.DNWGM17-P1-C4-T1-W2210200BC71F822B-L1000000000000 n/a
Manufacturer................HUAWEI
Machine Type and Model......S5500T
...
PLATFORM SPECIFIC
Name: disk
Node: disk
Device Type: block
NOTE
diskname indicates the name of the disk that has residual information in CuAt.
bash-3.00# odmdelete -o CuAt -q"name=hdisk2"
0518-307 odmdelete: 7 objects deleted.
2. Delete the residual information from CuDv.
Run odmdelete -o CuDv -q"name=diskname" to delete the residual
information.
NOTE
diskname indicates the name of the disk that has residual information in CuDv.
bash-3.00# odmdelete -o CuDv -q"name=hdisk2"
0518-307 odmdelete: 1 objects deleted.
3. Delete the residual information from CuPath.
Run odmdelete -o CuPath -q"name=diskname" to delete the residual
information.
NOTE
diskname indicates the name of the disk that has residual information in CuPath.
bash-3.00# odmdelete -o CuPath -q"name=hdisk2"
0518-307 odmdelete: 2 objects deleted.
4. Delete the residual information from CuPathAt.
Run odmdelete -o CuPathAt -q"name=diskname" to delete the residual
information.
NOTE
diskname indicates the name of the disk that has residual information in CuPathAt.
bash-3.00# odmdelete -o CuPathAt -q"name=hdisk2"
0518-307 odmdelete: 4 objects deleted.
5. Delete the residual information from CuVPD.
Run odmdelete -o CuVPD -q"name=diskname" to delete the residual
information.
NOTE
diskname indicates the name of the disk that has residual information in CuVPD.
bash-3.00# odmdelete -o CuVPD -q"name=hdisk2"
0518-307 odmdelete: 1 objects deleted.
6. Delete the residual information from CuDvDr.
Run odmdelete -o CuDvDr -q value3=diskname to delete the residual
information.
NOTE
diskname indicates the name of the disk that has residual information in CuDvDr.
bash-3.00# odmdelete -o CuDvDr -q value3=hdisk2
0518-307 odmdelete: 1 objects deleted.
7. Run bosboot -a to update the boot image.
bash-3.00# bosboot -a
bosboot: Boot image is 53276 512 byte blocks.
Step 5 Add LUN mappings to an array and run the cfgmgr command on the host to scan
for disks to check whether disks are reported correctly. If disks are reported
correctly, the system environment is cleared successfully. Otherwise, contact
technical support engineers.
----End
Procedure
Step 1 Run the lsdev -Cc disk command to view disks.
bash-3.00# lsdev -Cc disk
hdisk0 Available 06-08-01-5,0 16 Bit LVD SCSI Disk Drive
hdisk1 Available 06-08-01-8,0 16 Bit LVD SCSI Disk Drive
hdisk2 Defined 01-08-01 Other FC SCSI Disk Drive
hdisk3 Defined 01-08-01 Other FC SCSI Disk Drive
hdisk4 Available 01-08-01 Other FC SCSI Disk Drive
hdisk5 Available 01-08-01 Other FC SCSI Disk Drive
In the command output, hdisk2 and hdisk3 are in the Defined state.
Step 2 Run the rmdev -dl disk_name command to delete the disks in the Defined state.
bash-3.00# rmdev -dl hdisk2
hdisk2 deleted
----End
Cause
1. In AIX system, each device corresponds to one physical address.
For example, a disk has the following physical address: U788C.001.AAB4099-
P1-C14-C2-T1-W20080022A10BB2D5-L0000000000000. In the address, the
target WWN (20080022A10BB2D5) on the disk array is included.
2. When the AIX system starts up, it will try to find the addresses of boot
devices.
If a target port is changed, for example, from 20080022A10BB2D5 to
20180022A10B848D, the physical address of this boot disk changes to U788C.
001.AAB4099-P1-C14-C2-T1-W20180022A10B848D-L0000000000000.
3. When the AIX system fails to find the boot disk, "No OS image was detected
by firmware" displays.
You view the following error messages through the serial port.
No OS image was detected by firmware.
At least one disk in the bootlist was not found yet.
Firmware is now retrying the entries in the bootlist.
Press ctrl-C to stop retrying.
Solutions
Solution 1: Insert the optical fibre back to the original port.
Solution 2: Use a serial port tool or HMC to go to SMS and manually select the
boot device to start the system.
14. - SAS Tape
(loc=U78AB.001.WZSJJTR-P1-D1 )
15. - SATA CD-ROM
(loc=U78AB.001.WZSJJTR-P3-D7 )
16. - SCSI 59 GB FC Harddisk
(loc=U78AB.001.WZSJJTR-P1-C4-T2-W20180022a10b848d-L0 )
NOTE
Alarm Information
None.
Possible Causes
During the software installation, the system runs the bosboot command to create
a boot image again. During the execution of bosboot, the boot logical volume
(hd5) of the boot disk will be accessed.
However, in a SAN Boot environment, if there are multiple paths between a host
and a storage array, one LUN will correspond to multiple disks. As a result, during
the execution of bosboot, the boot logical volume (hd5) of the boot disk cannot
be accessed.
The following two cases will cause the failure to access the boot logical volume
(hd5) of the boot disk, leading to the software installation failure.
● When the bootinfo -b command cannot query the boot disk
The bootinfo -b command cannot query the boot disk, and the bootlist -m
normal -o command cannot query the current boot disk.
# bootinfo -b
# bootlist -m normal -o
-
During the execution of bosboot, bootinfo -b is invoked to query the boot
disk. If the returned value is empty, the execution of bosboot -a that is used
to create a boot image fails.
If the command output of lspv indicates that rootvg resides only in one disk
and the other disks do not have a pvid.
# lspv
hdisk0 none None
hdisk1 none None
hdisk2 none None
hdisk3 00f991a3e6eae6bd rootvg active
NOTE
hdisk0 to hdisk3 are disks reported by the same LUN over four paths.
After redundant disks that do not have a pvid are deleted, the following command
output will be displayed.
# lspv
hdisk3 00f991a3e6eae6bd rootvg active
After bosboot -a that is used to create a boot image is executed, the following
incorrect command output will be displayed.
# bosboot -a
● When the command output of lslv -m hd5 indicates that the disk where hd5
resides is not the disk queried from the ODM configuration based on the pvid
lspv is first executed to check disk statuses. The pvids read from the same
LUN are the same. Therefore, rootvg in each disk is active.
# lspv
hdisk0 00f991a3e6eae6bd rootvg active
hdisk1 00f991a3e6eae6bd rootvg active
hdisk2 00f991a3e6eae6bd rootvg active
hdisk3 00f991a3e6eae6bd rootvg active
NOTE
hdisk0 to hdisk3 are disks reported by the same LUN over four paths. They have the same
pvid stored in the ODM configuration.
The bosboot command will use the lslv -m hd5 command to query the boot disk,
and compare it with the boot disk queried from the ODM configuration based on
the pvid. If the two disks are not the same one, the execution of bosboot will fail.
In this case, you can run lslv -m hd5 to check whether rootvg is running in
hdisk0.
# lslv -m hd5
hd5:N/A
LP PP1 PV1 PP2 PV2 PP3 PV3
0001 0001 hdisk0
NOTE
When the bosboot command is executed, the disk that is checked by PVID in ODM is
hdisk3. However, after lslv -m hd5 is used for the check, the logical volume resides on
hdisk0. The two disks are different. As a result, the bosboot command fails to be executed.
Procedure
● If the boot disk cannot be queried by running bootinfo -b, perform the
following steps.
a. Run lslv -m hd5 to obtain the current boot device.
In the following command output, the boot device is hdisk3.
# lslv -m hd5
hd5:N/A
LP PP1 PV1 PP2 PV2 PP3 PV3
01 0001 hdisk3
NOTE
Possible Causes
After the AIX operating system is installed using the SAN Boot method, a change
of physical paths may cause the AIX operating system to fail to start up in the
SAN Boot mode after being shut down.
Fault Diagnosis
1. In the AIX operating system, each device corresponds to one physical address.
For example, a disk has the following physical address:
U788C.001.AAB4099-P1-C14-C2-T1-W20080022A10BB2D5-L0000000000000
In this address, 20080022A10BB2D5 indicates the target WWN of the storage
array.
2. When the AIX operating system is starting up, it tries to find the address of
the boot device.
If a target port is changed, for example, from 20080022A10BB2D5 to
20180022A10B848D, the physical address of this boot disk changes to:
U788C.001.AAB4099-P1-C14-C2-T1-W20180022A10B848D-L0000000000000
3. When the AIX operating system fails to find the boot disk, the "No OS image
was detected by firmware" error message is displayed.
Procedure
Step 1 Log in to the serial port terminal by using the serial port or HMC, manually select
a proper boot device.
NOTE
Step 2 Run the bootlist -m normal -o hdiskX command to go to the system and modify
the system boot list.
----End
Possible Causes
Possible causes for failure in executing the bosboot command include:
● The operating system is booted from an EMC PowerPath device, namely, the
startup disk is hdiskpowerX.
● The boot device of the current operating system cannot be queried by running
bootinfo -b.
● The /dev/ipldevice file does not exist or the /dev/ipldevice file is inconsistent
with the boot disk.
● The PVID of the disk where hd5 belongs is not unique.
Procedure
Step 1 Run lslv -m hd5 to query the booth disk of the current operating system.
● As shown in the following example, the operating system is running on
hdisk8.
bash-3.00# lslv -m hd5
hd5:N/A
LP PP1 PV1 PP2 PV2 PP3 PV3
0001 0001 hdisk8
● As shown in the following example, the operating system is running on
hdiskpower1. In this case, run pprootdev fix to make the bosboot command
function properly.
bash-3.00# lslv -l hd5
hd5:N/A
PV COPIES IN BAND DISTRIBUTION
hdiskpower1 001:000:000 100% 001:000:000:000:000
bash-3.00# pprootdev fix
Step 2 Run bootinfo -b to query the boot disk of the current operating system.
● As shown in the following example, the boot disk of the current operating
system is hdisk8.
bash-3.00# bootinfo -b
hdisk8
● As shown in the following example, the boot disk of the current operating
system is null.
bash-3.00# bootinfo -b
bash-3.00#
In this case, run bootlist -m normal -o hdiskXX to configure the boot device.
In the command, hdiskXX indicates the boot disk obtained by running lslv -m
hd5. Then run shutdown -Fr to restart the operating system.
bash-3.00# bootlist -m normal -o hdisk8
hdisk8 blv=hd5
bash-3.00# shutdown -Fr
Step 4 Run ls -l /dev/ipldevice to check whether the /dev/ipldevice file matches with the
booth disk. If the /dev/ipldevice file is consistent with the primary and secondary
device numbers of the boot disk (13 and 3 respectively in the following example),
the /dev/ipldevice file matches with the boot disk.
bash-3.00# ls -l /dev/ipldevice
crw------- 2 root system 13, 3 May 13 14:57 /dev/ipldevice
bash-3.00# ls -l /dev/rhdisk8
crw------- 2 root system 13, 3 May 13 14:57 /dev/rhdisk8
The PVID is not unique, run rmdev -dl hdiskX to delete the non-boot disk.
Step 6 Specifying the device update boot mirror
ash-3.00# bosboot -ad /dev/ipldevice
----End
7 FAQs
Answer
The following describes the known system bugs that may cause SAN Boot failure
and corresponding patches:
● Bug description:
A REBOOT MAY RESULT IN RANDOM MPIO PATHS IN A MISSING STATE
● Patch information:
5300-08 maps to patch IZ66562; 5300-09 maps to patch IZ64005; 5300-10
maps to patch IZ64011; 5300-11 maps to patch IZ65325; 5300-12 maps to
Answer
There are three methods to modify the dyntrk and fc_err_recov parameters of the
fscsi device. Select a proper method based on actual conditions.
● Method 1
If the host can be restarted, use method 1 to modify the parameters.
a. Run the chdev -l fscsiX -a dyntrk=yes -P and chdev -l fscsiX -a
fc_err_recov=fast_fail -P commands to modify the attributes of all HBAs
that connect to switches.
-bash-3.00# chdev -l fscsi0 -a dyntrk=yes -P
fscsi0 changed
-bash-3.00# chdev -l fscsi0 -a fc_err_recov=fast_fail -P
fscsi0 changed
● Method 3
If the reported virtual disks of Huawei storage are connected to multiple fscsi
devices, use method 3 (no virtual disks need to be deleted). If there is only
one fscsi device connected to Huawei storage, use method 1 or 2.
a. Run the lspath command to confirm the fscsi device in use. In the
following figure, hdisk1 and hdisk2 are virtual disks of Huawei storage,
which are connected to fscsi0 and fscsi1.
-bash-3.00# lspath
Enabled hdisk0 scsi0
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
NOTE
The previous screen message indicates that hdisk1 and hdisk2 are virtual disks
of Huawei storage, and they are connected to fscsi0 and fscsi1.
b. Run the rmdev -l fscsi0 -R command to set the state of fscsi0 to defined.
-bash-3.00# rmdev -l fscsi0 -R
fscsi0 Defined
e. Run the lspath command to ensure that all disk paths are normal.
-bash-3.00# lspath
Enabled hdisk0 scsi0
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
f. Run the rmdev -l fscsi1 -R command to set the state of fscsi1 to defined.
-bash-3.00# rmdev -l fscsi1 -R
fscsi1 Defined
i. Run the lspath command to ensure that all disk paths are normal.
-bash-3.00# lspath
Enabled hdisk0 scsi0
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk1 fscsi0
Enabled hdisk2 fscsi0
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
Enabled hdisk1 fscsi1
Enabled hdisk2 fscsi1
Answer
The ODM software supports three load balancing modes: fail_over, round_robin,
and shortest_queue. For 31.0.RC16, the default mode is round_robin. For other
versions, the default mode is fail_over.
● The fail_over mode enables application servers to deliver I/Os over the
available path with the highest priority if the current path is marked as failed
or disabled.
NOTE
● The path priority depends on the value of the priority parameter. A smaller value of the
priority parameter indicates a higher priority. The value of the priority parameter
ranges from 1 to 255. If the value of the priority parameter is set to 1, the path priority
is the highest. If the value of the priority parameter is set to 255, the path priority is the
lowest.
● By default, the value of the priority parameter is 1.
● For the round_robin mode, when an application server delivers I/Os to a
storage system for the first time, the I/Os are transferred through path 1.
When the I/Os are delivered for the secondary time, path 2 is used. The paths
that will be used are deduced by analogy. Paths are used in turn to ensure
that each path is fully utilized.
● For the shortest_queue mode, when an application server delivers I/Os to a
storage system, the I/Os are transferred through a path that currently has the
fewest I/Os. If the transfer speed of a path is slow, the other paths whose
transfer speed is quick can be fully utilized.
NOTE
This mode can only be set in some operating systems that adopt the latest technologies.
For details, see the official website of IBM.
Answer
The odmget -q name = xxxx CuDv and smit hacmp commands are used to
configure the ReserveCheck and ReserveBreak functions. The name indicates
device name. If one node fails, another node automatically invokes ReserveCheck
and ReserveBreak to take over the resources on the failed node.
NOTE
Before configuring these functions, ensure that the HACMP software has been installed.
Answer
1. Uninstall AIX ODM for MPIO following 5 Uninstalling AIX ODM for MPIO
and restart the AIX system.
2. After the AIX system is started, run bootlist -m normal -o hdiskXX to set the
boot list and run shutdown -Fr to restart the AIX system. You can run lslv -m
hd5 to query hdiskXX. For example:
bash-3.00# lslv -m hd5
hd5:N/A
LP PP1 PV1 PP2 PV2 PP3 PV3
0001 0001 hdisk9
bash-3.00# bootlist -m normal -o hdisk9
hdisk9 blv=hd5
bash-3.00#
bash-3.00# shutdown -Fr
SHUTDOWN PROGRAM
Tue Apr 11 11:48:02 CDT 2017
3. After the AIX system is started, run lsdev -Cc disk to check the residual
defined and N/A disks. For example:
bash-3.00# lsdev -Cc disk
lsdev: 0514-521 Cannot find information in the predefined device
configuration database for the customized device hdisk8.
hdisk0 Available Virtual SCSI Disk Drive
hdisk1 Available C4-T1-01 Other FC SCSI Disk Drive
hdisk2 Available C4-T1-01 Other FC SCSI Disk Drive
hdisk3 Available C4-T1-01 Other FC SCSI Disk Drive
hdisk4 Available C4-T1-01 Other FC SCSI Disk Drive
hdisk5 Available C4-T1-01 Other FC SCSI Disk Drive
hdisk6 Available C4-T1-01 Other FC SCSI Disk Drive
hdisk7 Available C4-T1-01 Other FC SCSI Disk Drive
hdisk8 Defined C4-T1-01 N/A
hdisk9 Available C4-T1-01 Other FC SCSI Disk Drive
hdisk8 is the residual disk information.
4. Delete the residual disk information and run the following commands for the
disk:
odmdelete -o CuDv -q name=hdiskX
odmdelete -o CuAt -q name=hdiskX
odmdelete -o CuPath -q name=hdiskX
odmdelete -o CuPathAt -q name=hdiskX
odmdelete -o CuVPD -q name=hdiskX
odmdelete -o CuDvDr -q value3=hdiskX
Run bosboot -a to update the boot image. For example:
bash-3.00# odmdelete -o CuDv -q name=hdisk8
0518-307 odmdelete: 1 objects deleted.
bash-3.00# odmdelete -o CuAt -q name=hdisk8
0518-307 odmdelete: 6 objects deleted.
bash-3.00# odmdelete -o CuPath -q name=hdisk8
0518-307 odmdelete: 2 objects deleted.
bash-3.00# odmdelete -o CuPathAt -q name=hdisk8
0518-307 odmdelete: 4 objects deleted.
bash-3.00# odmdelete -o CuVPD -q name=hdisk8
0518-307 odmdelete: 1 objects deleted.
bash-3.00# odmdelete -o CuDvDr -q value3=hdisk8
0518-307 odmdelete: 1 objects deleted.
bash-3.00# bosboot -a
Answer
1. Run the lslpp -l odmcfg.fcp.MPIO.rte command to check the version of the
installed AIX ODM for MPIO software.
bash-3.00# lslpp -l odmcfg.fcp.MPIO.rte
Fileset Level State Description
----------------------------------------------------------------------------
Path: /usr/lib/objrepos
odmcfg.fcp.MPIO.rte X.X.X.X COMMITTED MPIO Support Disk Arrays
X.X.X.X indicates the software version.
2. In AIX ODM for MPIO, you can use lscfg -vpl Name to query detailed
information about a LUN. The following uses the command to query detailed
information about hdisk1.
Manufacturer................HUAWEI
Machine Type and Model......S5500T
Serial Number...............210235G6KCZ0B8000009
Device Specific.(Z0)........60022A1100073FDD0002A0A800000001
Device Specific.(Z1)........Lun_002
Device Specific.(Z2)........00000001
PLATFORM SPECIFIC
Name: disk
Node: disk
Device Type: block
-bash-3.00#
Table 7-1 describes the command output. Due to restrictions of the operating
system, only single-end information can be displayed for active-active LUNs.
Parameter Description
7.7 How Do I Install AIX ODM for MPIO Using the NIM
RTE Deployment Mode?
Question
How do I install AIX ODM for MPIO using the NIM RTE deployment mode?
Answer
If you need to use the NIM RTE deployment mode to install AIX ODM for MPIO,
use the AIX ODM for MPIO RTE software package, which is dedicated for the NIM
RTE deployment mode. If the NIM RTE deployment mode is used, after the
lpp_source and spot resources are created, add the AIX ODM for MPIO RTE
software package to the lpp_source and spot resources, and then install the AIX
operating system. The procedure is as follows:
1. Add the AIX ODM for MPIO RTE software package to the lpp_source resource.
a. Run the smit nim command to access the management page, and then
select Perform NIM Administration Tasks.
Move cursor to desired item and press Enter.
Manage Networks
Manage Machines
Manage Control Objects
Manage Resources
Manage Groups
Backup/Restore the NIM Database
Configure NIM Environment Options
Rebuild the niminfo File on the Master
Change the Master's Primary Interface
Manage Alternate Master Environment
Unconfigure NIM
[Entry Fields]
Add or Remove Software add
[Entry Fields]
Media, directory or lpp_source to copy images from [/home]
[Entry Fields]
TARGET lpp_source lpp_source_720
SOURCE of Software to Add /home
SOFTWARE Packages to Add [odmcfg 2.1.12.1
I]
-OR-
INSTALLP BUNDLE containing packages to add
[]
gencopy Flags
DIRECTORY for temporary storage during copying [/tmp]
EXTEND filesystems if space needed?
yes
/export/lpp_source/lpp_source/installp/ppc/odmcfg.2.1.12.1.I.1
2. Add the AIX ODM for MPIO RTE software package to the spot resource.
a. Run the nim -o cust -a filesets=odmcfg.fcp.MPIO.rte -a
lpp_source=[LPP_SOURCE_NAME] [SPOT_NAME] command to add the
required AIX ODM for MPIO RTE software package to the created spot
resource.
-bash-3.00# nim -o cust -a filesets=odmcfg.fcp.MPIO.rte -a lpp_source=lpp_source spot
Installation Summary
--------------------
Name Level Part Event Result
-------------------------------------------------------------------------------
odmcfg.fcp.MPIO.rte 2.1.12.1 USR APPLY SUCCESS
3. Run the following commands to check whether the AIX ODM for MPIO RTE
software package is successfully added to the lpp_source and spot resources:
– Check the lpp_source resource and ensure that the odmcfg.fcp.MPIO.rte
resource exists.
-bash-3.00# nim -o showres lpp_source|grep -i "odmcfg.fcp.MPIO.rte"
odmcfg.fcp.MPIO.rte 2.1.12.1 I b usr
4. After the lpp_source and spot resources are added successfully, you can use
the NIM RTE deployment mode to install AIX ODM for MPIO.
a. Run the smit nim command to access the management interface, and
then select Perform NIM Software Installation and Maintenance
Tasks.
Move cursor to desired item and press Enter.
After the ODM is correctly installed on a AIX operating system, the ODM adds and
modifies certain files that ensure its proper running. Do not modify or delete these
files unnecessarily.
/etc/objrepos/SWservAt
/etc/objrepos/CuVPD
/etc/objrepos/CuPathAt.vc
/etc/objrepos/CuPathAt
/etc/objrepos/CuPath.vc
/etc/objrepos/CuPath
/etc/objrepos/CuDvDr
/etc/objrepos/CuDv
/etc/objrepos/CuDep
/etc/objrepos/CuAt.vc
/etc/objrepos/CuAt
/etc/objrepos/lpp.vc
/etc/objrepos/lpp
/usr/lib/objrepos/PDiagRes.vc
/usr/lib/objrepos/PDiagRes
/usr/lib/objrepos/PDiagDev.vc
/usr/lib/objrepos/PDiagDev
/usr/lib/objrepos/PDiagAtt.vc
/usr/lib/objrepos/PDiagAtt
/usr/lib/objrepos/sm_cmd_opt.vc
/usr/lib/objrepos/sm_cmd_opt
/usr/lib/objrepos/sm_cmd_hdr.vc
/usr/lib/objrepos/sm_cmd_hdr
/usr/lib/objrepos/inventory.vc
/usr/lib/objrepos/inventory
/usr/lib/objrepos/PdPathAt.vc
/usr/lib/objrepos/PdPathAt
/usr/lib/objrepos/product.vc
/usr/lib/objrepos/product
/usr/lib/objrepos/lpp.vc
/usr/lib/objrepos/lpp
/usr/lib/objrepos/history.vc
/usr/lib/objrepos/history
/usr/lib/objrepos/PdDv.vc
/usr/lib/objrepos/PdDv
/usr/lib/objrepos/PdAt.vc
/usr/lib/objrepos/PdAt
/var/adm/sw/installp.summary