AIX: 0555 FSCK ERROR

leave a comment Yesterday, after adding some new hard disks to our pSeries p670 machine, when we rebooted our AIX 5.2, we saw the error 0555 FSCK ERROR on LED Panel of machine and also in HMC and then the system stopped! For solving the problem, I searched the error code 0555 in Problem Solving and Troubleshooting in AIX 5L document and found a solution in 3.6 section of this doc. Based on the document I did the following procedure: 1. Turn on the machine in Service Mode Boot from AIX CD-ROM or mksysb backup. 2. Using bootable media at the same version and level as the system, boot the system. 3. Follow the screen prompts to the following menu: Welcome to Base Operating System Installation and Maintenance Choose Start Maintenance Mode for System Recovery(option 3). 4. The next screen has the maintenance menu. Choose Access a Root Volume Group (option 1). The next screen displays a warning that indicates you will not be able to return to the Base OS menu without rebooting. Choose 0 to continue. When rootvg has been found, choose the following option: Access this volume group and start a shell before mounting the file systems 5. Format the default jfslog for the rootvg JFS file systems with the following command:
#/usr/bin/logform /dev/hd8

6. Next, run the following commands to check and repair file systems. The -y option gives the fsck command permission to repair file systems when necessary:
#fsck #fsck #fsck #fsck #fsck -y -y -y -y -y /dev/hd1 /dev/hd2 /dev/hd3 /dev/hd4 /dev/hd9var

Now if you rerun the commands above they will reports that the file systems are clean.

Type exit. The file systems will automatically mount after you type exit. 7. Determine which disk is the boot disk:
#lslv -m hd5

8. If the boot image has problem (How could we check this?), recreate the boot image and alter the boot list by the following commands (hdisk# is the boot disk determined in the previous step):
#bosboot -a -d /dev/hdisk# #bootlist -m normal hdisk#

Note: After recreating the boot image, the root password will be changed! So either you must know the root password of the image on mksysb backup or you must reset the unknown root password after completing this step! 9. run the following command to restart the AIX:
#shutdown -Fr

10. Now the system must be able to boot in normal boot without any problem.