Author – A.Kishore http:/www.appsdba.

info

Build Your Own Oracle RAC 11g Release 2 Cluster on Red Hat 4 and iSCSI
Here is my setup which I have used for Installing Oracle RAC 11gR2

OpenFiler To access linux1 and linux2 2 GB 500 GB HDD Linux1 4 GB 250 GB Oracle Apps R12.1.1 Node 1 Node 2 Linux2 4 GB 250 GB

Author – A.Kishore http:/www.appsdba.info
High Level Steps > Install openfiler on linux1 using VMWARE > Install Grid Infrastructure on linux1 and linux2 > Install Oracle 11gR2 software on linux1 and linux2 Download the software from the below site http://www.oracle.com/technetwork/database/enterprise-edition/downloads/112010linuxsoft-085393.html

Author – A.Kishore http:/www.appsdba.info
1. Install Oracle 11gR2 Grid Infrastructure (Both the nodes should be ready) -- clean the old installation (on both nodes) rm rm rm cd rm rm rm rm -rf /etc/oracle -rf /etc/oraInst.loc -rf /etc/oratab /d01/oracle/app -rf oracle -rf oraInventory -rf /d01/oracle/app/*.* -rf /d01/oracle/app/11.2.0/grid/*.*

-- On one of the node – Using only one diskgroup /etc/init.d/oracleasm deletedisk VOL1 /dev/sdb1 /etc/init.d/oracleasm createdisk VOL1 /dev/sdb1 /etc/init.d/oracleasm listdisks Note – I am using only one diskgroups -- If there are 3 diskgroups then use the below commands /etc/init.d/oracleasm /etc/init.d/oracleasm /etc/init.d/oracleasm /etc/init.d/oracleasm /etc/init.d/oracleasm /etc/init.d/oracleasm /etc/init.d/oracleasm deletedisk deletedisk deletedisk createdisk createdisk createdisk listdisks VOL1 VOL2 VOL3 VOL1 VOL2 VOL3 /dev/sdc1 /dev/sdd1 /dev/sde1 /dev/sdc1 /dev/sdd1 /dev/sde1

Run cluvfy to verify all the prereqs are available su - root cd /tmp rm -rf bootstrap/ su - oracle cd $SOFTWARE_LOCATION/11gR2/grid sh runcluvfy.sh stage -pre crsinst -n linux1,linux2 –verbose See Appendix A for output Only one package has failed and that is fine, red hat comes with older version of glibc, but the cluvfy script is looking for the latest script
Check: Package existence for "glibc-2.3.4-2.41" Node Name Available Required ------------ ------------------------ -----------------------Comment ----------

Author – A.Kishore http:/www.appsdba.info
linux1 glibc-2.3.4-2.39 glibc-2.3.4-2.41 Result: Package existence check failed for "glibc-2.3.4-2.41" failed

cd $SOFTWARE_LOCATION/11gR2/grid ./runInstaller

Author – A.info .appsdba.Kishore http:/www.

appsdba. The SCAN and cluster name must be at least one character long and no more than 15 characters in length. By default. you are prompted to confirm the default Single Client Access Name (SCAN). the name used as the SCAN is also the name of the cluster. which is used to connect to databases within the cluster irrespective of which nodes they are running on. the SCAN is also the name of the cluster.info Check Network Requirements: In this release there are two new network related components – SCAN and GNS. The default value for the SCAN is based on the local node name. If you change the SCAN from the default. In a Typical installation. then the name that you use must be globally unique throughout your enterprise.Author – A. Single Client Access Name (SCAN) for the Cluster: During Typical installation.Kishore http:/www. must be .

Note that SCAN addresses. The SCAN resource and its associated IP address(s) provide a stable name for clients to use for connections. the SCAN is associated with the entire cluster. You will be asked to provide the host name and up to three IP addresses to be used for the SCAN resource during the interview phase of the Oracle grid infrastructure installation. I will configure SCAN to resolve to only one.Kishore http:/www. Clients using SCAN do not need to change their TNS configuration if you add or remove nodes in the cluster. Oracle 11g Release 2 introduced a new feature known as Single Client Access Name or SCAN for short. manually configured static IP address using the DNS method (but not actually defining it in DNS) . At a minimum. unlike a virtual IP. the SCAN must resolve to at least one address. Configure the following addresses: • A public IP address for each node • A virtual IP address for each node • A single client access name (SCAN) configured on the domain name server (DNS) or Grid Naming Service (GNS) for Round Robin resolution to three addresses (recommended) or at least one address (check documentation) Some more information on Single Client Access Name ☺ Single Client Access Name (SCAN) for the Cluster If you have ever been tasked with extending an Oracle RAC cluster by adding a new node (or shrinking a RAC cluster by removing a node). If you require a SCAN that is longer than 15 characters. then select an Advanced installation. such as racnode1-vip. SCAN is a new feature that provides a single host name for clients to access an Oracle Database running in a cluster. independent of the nodes that make up the cluster. not just one address. For high availability and scalability. Oracle recommends that you configure the SCAN name so that it resolves to three IP addresses. or by using Domain Name Service (DNS) resolution.Author – A.appsdba. then you know the pain of going through a list of all clients and updating their SQL*Net or JDBC configuration to reflect the new or deleted node! To address this problem. In this article. and public IP addresses must all be on the same subnet. The SCAN should be configured so that it is resolvable either by using Grid Naming Service (GNS) within the cluster. and may contain hyphens (-). The SCAN virtual IP name is similar to the names used for a node's virtual IP addresses.info alphanumeric. rather than an individual node. virtual IP addresses. and can be associated with multiple IP addresses. However.

168.appsdba.Kishore http:/www.187 racnode-cluster-scan – make the entry in /etc/hosts .Author – A.info 192.1.

Author – A.appsdba.Kishore http:/www.info .

info .Kishore http:/www.appsdba.Author – A.

appsdba.Kishore http:/www.info Enter Oracle password and click Setup .Author – A.

info .Kishore http:/www.appsdba.Author – A.

Author – A.Kishore http:/www.appsdba.info .

Author – A.info .Kishore http:/www.appsdba.

info .Kishore http:/www.Author – A.appsdba.

info .appsdba.Kishore http:/www.Author – A.

appsdba.info .Kishore http:/www.Author – A.

info .Kishore http:/www.appsdba.Author – A.

appsdba.info .Kishore http:/www.Author – A.

appsdba.info The above error can safely be ignored .Author – A.Kishore http:/www.

Kishore http:/www.Author – A.info .appsdba.

Removing read.write permissions for group.execute permissions for world. Removing read.info [root@linux1 ~]# /d01/oracle/app/oraInventory/orainstRoot.write. Changing groupname of /d01/oracle/app/oraInventory to oinstall.Kishore http:/www.sh Changing permissions of /d01/oracle/app/oraInventory. Adding read. The execution of the script is complete.sh Changing permissions of /d01/oracle/app/oraInventory.appsdba. Changing groupname of /d01/oracle/app/oraInventory to oinstall.Author – A.execute permissions for world. . Adding read.write. [root@linux2 ~]# /d01/oracle/app/oraInventory/orainstRoot.write permissions for group. The execution of the script is complete.

sh See Appendix B and C for outputs Click OK .Kishore http:/www.sh on linux1 and linux2 cd /d01/oracle/app/11.2.0/grid/ [root@linux1 grid]# sh root.Author – A.appsdba.info Run root.

Author – A. INFO: ERROR: INFO: PRVF-4657 : Name resolution setup check for "racnode-cluster-scan" (IP address: 216.. INFO: Checking name resolution setup for "racnode-cluster-scan".24. .Kishore http:/www. This is documented in Doc ID: 887471.153) failed INFO: ERROR: INFO: PRVF-4657 : Name resolution setup check for "racnode-cluster-scan" (IP address: 192.info INFO: Checking Single Client Access Name (SCAN)..138..187) failed INFO: ERROR: INFO: PRVF-4664 : Found inconsistent name resolution entries for SCAN name "racnode-cluster-scan" INFO: Verification of SCAN VIP and Listener setup failed Provided this is the only error reported by the CVU. it would be safe to ignore this check and continue by clicking the [Next] button in OUI and move forward with the Oracle grid infrastructure installation..1 on the My Oracle Support web site.appsdba.1.168.

168.154.1.1.34#53" echo "Non-authoritative answer:" echo "Name: racnode-cluster-scan" echo "Address: 192. create a new shell script named /usr/bin/nslookup as shown below while replacing 24.Author – A. simply modify the nslookup utility as root on both Oracle RAC nodes as follows.154. otherwise. SCAN VIP name Node Running? Running? ListenerName Port .original Next. rename the original nslookup binary to nslookup. then echo "Server: 24. The new nslookup shell script simply echo's back your SCAN IP address whenever the CVU calls nslookup with your SCAN host name. The CVU will now pass during the Oracle grid infrastructure installation when it attempts to verify your SCAN: [grid@racnode1 ~]$ cluvfy comp scan -verbose Verifying scan Checking Single Client Access Name (SCAN). First.1.187" else /usr/bin/nslookup..original $HOSTNAME Fi Finally.Kishore http:/www..original on both Oracle RAC nodes: [root@racnode1 ~]# mv /usr/bin/nslookup /usr/bin/nslookup. change the new nslookup shell script to executable: [root@racnode1 ~]# chmod 755 /usr/bin/nslookup Remember to perform these actions on both Oracle RAC nodes. racnode-cluster-scan with your SCAN host name.1.34" echo "Address: 24. it calls the original nslookup binary.187 with your SCAN IP address: #!/bin/bash HOSTNAME=${1} if [[ $HOSTNAME = "racnode-cluster-scan" ]].168.info If on the other hand you want the CVU to complete successfully while still only defining the SCAN in the hosts file.34 with your primary DNS.154.appsdba. and 192.1.

.-----------. SCAN VIP name Node Running? Running? ---------------. Comment ---------- Now retry .appsdba. Comment ---------- =============================================================================== [grid@racnode2 ~]$ cluvfy comp scan -verbose Verifying scan Checking Single Client Access Name (SCAN).-----------------------.Kishore http:/www..-----------------------racnode-cluster-scan 192... SCAN Name IP Address Status -----------..1.------------------racnode-cluster-scan racnode1 true -----------true -----------LISTENER -----------1521 ---- Checking name resolution setup for "racnode-cluster-scan". SCAN Name IP Address Status -----------.-----------------------racnode-cluster-scan 192.187 passed Verification of SCAN VIP and Listener setup passed Verification of scan was successful.168.info ---------------.1.------------------racnode-cluster-scan racnode1 true true ListenerName -----------LISTENER Port -----------1521 ---- Checking name resolution setup for "racnode-cluster-scan".Author – A..168.187 passed Verification of SCAN VIP and Listener setup passed Verification of scan was successful.-----------------------.

appsdba.info .Author – A.Kishore http:/www.

Author – A.info .Kishore http:/www.appsdba.

Kishore http:/www.info cat grid./grid. change directory to the <CRS_HOME> and issue the following commands: srvctl enable nodeapps –g srvctl start nodeapps . To start GSD.2.env export ORACLE_HOME=/d01/oracle/app/11.Author – A.0/grid export PATH=$PATH:$ORACLE_HOME/bin . the Global Services Daemon (GSD) is not started on the cluster.appsdba.env crs_stat –t Post-Install Actions By default. .

Kishore http:/www.info ora.Author – A.appsdba.oc4j is offine. that is fine Successful Oracle Clusterware operation can also be verified using the following command: crsctl check crs olsnodes -n .

info srvctl status asm -a ocrcheck crsctl query css votedisk .Author – A.Kishore http:/www.appsdba.

Kishore http:/www.Author – A./crsctl check cluster -all .info .appsdba.

php?f=1&t=11307&start=0 1. without his help I couldn’t have done this assignment http://www. on Linux this can be done by running the following command(s) as the root user on each node of the cluster: service iptables stop service ip6tables stop To permanently disable the firewall.info References: Thanks to Jeff Hunter.1] Issues and solutions cd /home/oracle/app/11. use: chkconfig iptables off chkconfig ip6tables off 2. http://coskan.Author – A.sh fails to start the clusterware on the second node (Doc ID 981357.rachelp.Kishore http:/www. short-term: disable the firewall on all nodes. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.nl/index_kb.com/forums/viewtopic.1) 1.appsdba. .wordpress.com/2009/12/07/root-sh-failed-after-asm-disk-creation-for11gr2-grid-infrastructure/ http://oracle-base.php?menu=articles&actie=show&id=61 11gR2 Grid: root. long-term: exclude all traffic on the private network from the firewall configuration.2.log [ctssd(27935)]CRS-2409:The clock on host linux2 is not synchronous with the mean cluster time. How to Proceed from Failed 11gR2 Grid Infrastructure (CRS) Installation [ID 942166.com/ http://coskan.0/grid/log/linux2 cat alertlinux2.wordpress.

3.info 2010-07-24 05:26:20.com/2010/03/in-11gr2-grid-rootsh-fails-with-crs.0/grid/log/linux2/ctssd/octssd.2.201/255. Details in /home/oracle/app/11.6 \ gcc-c++-3.97 \ elfutils-libelf-devel-0.3.2 \ compat-libstdc++-33.105 \ .3.oracle.oracle.Author – A.0.html How to Proceed from Failed 11gR2 Grid Infrastructure (CRS) Installation [ID 942166.0/grid/crs/install .168.4 \ libaio-devel-0.sh has failed.4-2.0/grid/crs/install .log. http://www.4./srvctl config vip -n linux2 http://forums. run the below commands to clean up -.pl -verbose -deconfig -force -.3.3.2.255. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.4 \ glibc-headers-2.first node cd /home/oracle/app/11.If root.15.471 [ctssd(27935)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time.com/forums/thread.Kishore http:/www.41 \ glibc-common-2.255.2.6 \ glibc-2.com/technology/pub/articles/hunter-rac11gr2-iscsi.blogspot.0./rootcrs. 2010-07-24 05:26:20.0/eth0 -k 1 [root@linux2 bin]# .pl -verbose -deconfig -force -lastnode To add vip manually [root@linux2 bin]# .4.471 [ctssd(27935)]CRS-2409:The clock on host linux2 is not synchronous with the mean cluster time.92.html http://arjudba./srvctl add vip -n linux2 -A 192.4 \ glibc-devel-2.appsdba.2.3 \ elfutils-libelf-0.second node cd /home/oracle/app/11./rootcrs.jspa?messageID=4039293 rpm -q binutils-2.97 \ gcc-3.1] -.

info libaio-0..11 \ unixODBC-devel-2.6 \ make-3.4.Kishore http:/www..com/forums/thread. Check: Node reachability from node "linux1" Destination Node Reachable? -----------------------------------. Check: User equivalence for user "oracle" Node Name Comment -----------------------------------.-----------------------linux1 yes linux2 yes Result: Node reachability check passed from node "linux1" Checking user equivalence.6 \ libstdc++-devel-3.appsdba.oracle. Checking hosts config file.-----------------------linux2 failed linux1 passed Result: PRVF-4007 : User equivalence check failed for user "oracle" WARNING: User equivalence is not set for nodes: linux2 Verification will proceed with nodes: linux1 Checking node connectivity.3.jspa?messageID=4345930 http://www..Author – A.80 \ pdksh-5..0.2.2.-----------------------Comment ------------------------ .com/page/11gR2+RAC+on+a+Mac+-+Part+6 –nice one Appendix A sh runcluvfy..oracle.6 \ libstdc++-3.105 \ libgcc-3.com/technology/pub/articles/wartak-rac-vm_3.oracle..5 \ unixODBC-2..2.html http://wiki..sh stage -pre crsinst -n linux1.4. Node Name Status -----------.14 \ sysstat-5.11 http://forums.linux2 -verbose Performing pre-checks for cluster services setup Checking node reachability.4.

appsdba.168.0.0.168.1.0.--------------.0.168.-----eth0 192.168.-----------------------linux1 3.168.0" with node(s) linux1 Check: TCP connectivity of subnet "192.0.1.1.1.168.0.3 Interfaces found on subnet "192.168.168.168.3 192.1.0 192.0 00:13:72:22:4C:78 1500 Gateway Def.0.0" Check: Node connectivity of subnet "192.0" Result: Node connectivity passed for subnet "192.--------------.0KB) Comment ---------passed Required -----------------------50MB (51200.0" Result: TCP connectivity check passed for subnet "192.168.0 0.0KB) Result: Available memory check passed Check: Swap space Node Name Available -----------.101 192.168.0.0" Interfaces found on subnet "192.0 00:08:A1:95:2F:61 1500 eth1 192.101 Result: Node connectivity check passed Check: Total memory Node Name Available -----------.0" Result: Node connectivity passed for subnet "192. Gateway HW --------------.1.168.168.0" that are likely candidates for VIP are: linux1 eth0:192.info linux1 passed Verification of the hosts config file successful Interface information for node "linux1" Name IP Address Subnet Address MTU -----.168.168.1 192.0.-----------------------linux1 3.1.-----------------------.1 Check: Node connectivity of subnet "192.0" that are likely candidates for a private interconnect are: linux1 eth1:192.1.168.71GB (3895072.1.0" Result: TCP connectivity check passed for subnet "192.------0.1.0" with node(s) linux1 Check: TCP connectivity of subnet "192.------------------------ Required -----------------------1.0.0.5GB (1572864.168.0KB) Comment ---------passed Required ------------------------ Comment ---------- .0KB) Result: Total memory check passed Check: Available memory Node Name Available -----------.168.Kishore http:/www.32GB (3479748.Author – A.0.

-----------.-----------.---------------linux1 hard 65536 65536 passed Result: Hard limits check passed for "maximum open file descriptors" .-----------.-----------------------linux1 exists passed Result: User existence check passed for "oracle" Check: Group existence for "oinstall" Node Name Status Comment -----------.-----------.-------------------/tmp linux1 / 6.Author – A.-----------.----------linux1 yes yes yes yes passed Result: Membership check for user "oracle" in group "oinstall" [as Primary] passed Check: Membership of user "oracle" in group "dba" Node Name User Exists Group Exists User in Group Comment ---------------.-----------.-----------------------.0KB) Result: Swap space check passed 3.appsdba.-----------.Kishore http:/www.86GB (6144820.-----------------------.-----------.-----------------------linux1 5 Result: Run level check passed Required -----------------------3.5 Comment ---------passed Check: Hard limits for "maximum open file descriptors" Node Name Type Available Required Comment ---------------.-----------.0KB) passed Check: Free disk space for "linux1:/tmp" Path Node Name Mount point Available Comment ---------------.-----------------------.info linux1 5.82GB passed Result: Free disk space check passed for "linux1:/tmp" Required -----------1GB --- Check: User existence for "oracle" Node Name Status Comment -----------.-----------.-----------------------linux1 exists passed Result: Group existence check passed for "dba" Check: Membership of user "oracle" in group "oinstall" [as Primary] Node Name User Exists Group Exists User in Group Primary Comment ---------------.71GB (3895072.-----------.---------------linux1 yes yes yes passed Result: Membership check for user "oracle" in group "dba" passed Check: Run level Node Name run level -----------.-----------------------linux1 exists passed Result: Group existence check passed for "oinstall" Check: Group existence for "dba" Node Name Status Comment -----------.-----------.

Kishore http:/www.info Check: Soft limits for "maximum open file descriptors" Node Name Type Available Required Comment ---------------.6.-----------------------linux1 4294967295 Required -----------------------x86 Comment ---------passed Required -----------------------2.-----------.-----------.-----------.Author – A.-----------.-----------.EL Result: Kernel version check passed Check: Kernel parameter for "semmsl" Node Name Configured -----------.-----------------------linux1 256 Result: Kernel parameter check passed for Check: Kernel parameter for "semmns" Node Name Configured -----------.6.-----------.-----------------------linux1 100 Result: Kernel parameter check passed for Check: Kernel parameter for "semmni" Node Name Configured -----------.-----------.-----------------------linux1 32000 Result: Kernel parameter check passed for Check: Kernel parameter for "semopm" Node Name Configured -----------.-----------.9-67.---------------linux1 soft 65536 1024 passed Result: Soft limits check passed for "maximum open file descriptors" Check: Hard limits for "maximum user processes" Node Name Type Available Required Comment ---------------.9 Comment ---------passed Required -----------------------250 "semmsl" Required -----------------------32000 "semmns" Required -----------------------100 "semopm" Required -----------------------128 "semmni" Required -----------------------536870912 Comment ---------passed Comment ---------passed Comment ---------passed Comment ---------passed Comment ---------passed .---------------linux1 hard 61416 16384 passed Result: Hard limits check passed for "maximum user processes" Check: Soft limits for "maximum user processes" Node Name Type Available Required Comment ---------------.-----------------------linux1 i686 Result: System architecture check passed Check: Kernel version Node Name Available -----------.-----------.-----------------------linux1 2.---------------linux1 soft 61416 2047 passed Result: Soft limits check passed for "maximum user processes" Check: System architecture Node Name Available -----------.-----------------------linux1 142 Result: Kernel parameter check passed for Check: Kernel parameter for "shmmax" Node Name Configured -----------.appsdba.

-----------------------linux1 1048576 Result: Kernel parameter check passed for Check: Kernel parameter for "aio-max-nr" Node Name Configured -----------.-----------------------linux1 6815744 Result: Kernel parameter check passed for Required -----------------------4096 "shmmni" Required -----------------------2097152 "shmall" Required -----------------------6815744 "file-max" Comment ---------passed Comment ---------passed Comment ---------passed Check: Kernel parameter for "ip_local_port_range" Node Name Configured Required -----------.-----------------------linux1 1048576 Result: Kernel parameter check passed for Check: Package existence for "make-3.-----------------------linux1 4096 Result: Kernel parameter check passed for Check: Kernel parameter for "shmall" Node Name Configured -----------.-----------------------.-----------------------linux1 between 9000 & 65500 between 9000 & 65500 Result: Kernel parameter check passed for "ip_local_port_range" Check: Kernel parameter for "rmem_default" Node Name Configured Required -----------.-----------------------.info Result: Kernel parameter check passed for "shmmax" Check: Kernel parameter for "shmmni" Node Name Configured -----------.-----------------------linux1 4194304 Result: Kernel parameter check passed for Required -----------------------4194304 "rmem_max" Comment ---------passed Comment ---------passed Comment ---------passed Check: Kernel parameter for "wmem_default" Node Name Configured Required -----------.Author – A.-----------------------linux1 262144 262144 Result: Kernel parameter check passed for "wmem_default" Check: Kernel parameter for "wmem_max" Node Name Configured -----------.-----------------------linux1 262144 262144 Result: Kernel parameter check passed for "rmem_default" Check: Kernel parameter for "rmem_max" Node Name Configured -----------.-----------------------.-----------------------linux1 2097152 Result: Kernel parameter check passed for Check: Kernel parameter for "file-max" Node Name Configured -----------.appsdba.80" Node Name Available Required -----------------------1048576 "wmem_max" Required -----------------------1048576 "aio-max-nr" Required Comment ---------passed Comment ---------passed Comment ---------passed Comment .Kishore http:/www.

2.92.3.39 glibc-common-2.0.92.3.97 Result: Package existence check passed for "elfutils-libelf-0.97.6 Result: Package existence check passed for "gcc-3.6-9 gcc-3.2.2" Node Name Available Required -----------.3 passed Result: Package existence check passed for "compat-libstdc++-33-3.-----------------------linux1 binutils-2.97" Node Name Available Required Comment -----------.41 Result: Package existence check failed for "glibc-2.-----------------------.---------linux1 compat-libstdc++-33-3.3.EL4 make-3.0.4.3" Node Name Available Required Comment -----------.-----------------------linux1 glibc-common-2.2.4.-----------------------.1-5 elfutils-libelf-0.2 Result: Package existence check passed for "binutils-2.4.3-47.-----------------------.3.4.-----------------------.4-2.97.105" Node Name Available Required -----------.4.15.4-2.-----------------------.3.15.-----------------------linux1 make-3.15.92.39 glibc-2.2" Check: Package existence for "gcc-3.105-2 libaio-0.3" Check: Package existence for "elfutils-libelf-0.-----------------------linux1 glibc-2.0.3.97" Check: Package existence for "glibc-common-2.-----------------------linux1 gcc-c++-3.80 Result: Package existence check passed for "make-3.---------linux1 elfutils-libelf-devel-0.6" Node Name Available Required -----------.6" Node Name Available Required -----------.-----------------------.3.15.105 Result: Package existence check passed for "libaio-0.-----------------------.-----------------------.41" Node Name Available Required -----------.97" Node Name Available Required -----------.-----------------------linux1 libaio-0.-----------------------.3.-----------------------.4" Node Name Available Required -----------.3 compat-libstdc++-33-3.6" Check: Package existence for "gcc-c++-3.-----------------------linux1 gcc-3.2.4.3.-----------------------linux1 elfutils-libelf-0.1-5 elfutils-libelf-devel-0.-----------------------.97 passed Result: Package existence check passed for "elfutils-libelf-devel-0.4-2.4.6" Check: Package existence for "libaio-0.4 Comment ---------passed .4-2.Kishore http:/www.41" ---------passed Comment ---------passed Comment ---------passed Comment ---------passed Comment ---------passed Comment ---------failed Check: Package existence for "compat-libstdc++-33-3.97" Comment ---------passed Check: Package existence for "elfutils-libelf-devel-0.92.3.Author – A.3.80-6.105" Check: Package existence for "glibc-2.80" Check: Package existence for "binutils-2.info -----------.-----------------------.6-9 gcc-c++-3.6 Result: Package existence check passed for "gcc-c++-3.4.2-24 binutils-2.4-2.appsdba.0.

4.6 Result: Package existence check passed for "libstdc++-3.Author – A.3.5-16.6-9 libstdc++-devel-3.-----------------------linux1 sysstat-5.4.-----------------------.6" Node Name Available Required -----------.4.-----------------------.4" Check: Package existence for "glibc-headers-2.4.appsdba.4-2.-----------------------linux1 libstdc++-3.3.6" Node Name Available Required -----------.3.-----------------------linux1 unixODBC-2.---------linux1 unixODBC-devel-2.4.105" Node Name Available Required -----------.4.3.3.-----------------------.3.11-1.5" Check: Package existence for "unixODBC-2.4.0.4.1 unixODBC-devel-2.0.4.5" Node Name Available Required -----------.-----------------------.-----------------------linux1 libstdc++-devel-3.Kishore http:/www.6" Check: Package existence for "libstdc++-devel-3.rhel4 sysstat-5.6" Check: Package existence for "libstdc++-3.3.11" Node Name Available Required Comment -----------.105 Result: Package existence check passed for "libaio-devel-0.1 unixODBC-2.4 Result: Package existence check passed for "glibc-devel-2.39 glibc-headers-2.RHEL4.2.11" Node Name Available Required -----------.105-2 libaio-devel-0.105" Check: Package existence for "libgcc-3.-----------------------.-----------------------.-----------------------.6 Result: Package existence check passed for "libgcc-3.5 Result: Package existence check passed for "sysstat-5.4" Check: Package existence for "glibc-devel-2.2.11" Comment ---------passed Comment ---------passed Comment ---------passed Comment ---------passed Comment ---------passed Comment ---------passed Comment ---------passed Comment ---------passed Check: Package existence for "unixODBC-devel-2.6-9 libgcc-3.-----------------------linux1 libgcc-3.-----------------------linux1 glibc-devel-2.6" Check: Package existence for "sysstat-5.11" Check: Package existence for "pdksh-5.3.-----------------------.3.3.6" Node Name Available Required -----------.4" Check: Package existence for "libaio-devel-0.4.2.39 glibc-devel-2.11-1.RHEL4.4-2.info Result: Package existence check passed for "glibc-common-2.4.4.6 Result: Package existence check passed for "libstdc++-devel-3.3.3.0.11 Result: Package existence check passed for "unixODBC-2.2.4" Node Name Available Required -----------.11 passed Result: Package existence check passed for "unixODBC-devel-2.-----------------------linux1 libaio-devel-0.2.4 Result: Package existence check passed for "glibc-headers-2.6-9 libstdc++-3.4" Node Name Available Required -----------.2.-----------------------.-----------------------linux1 glibc-headers-2.2.0.14" .3.2.-----------------------.2.

Author – A.. NTP Configuration file check started.appsdba.-----------------------linux1 0022 0022 Result: Default user file creation mask check passed Comment ---------passed Starting Clock synchronization checks using Network Time Protocol(NTP). in file "/etc/sysconfig/ntpd"...2. The NTP configuration file "/etc/ntp. for slewing option "-x" Check: NTP daemon's boot time configuration Node Name Slewing Option Set? -----------------------------------. Check passed Check default user file creation mask Node Name Available Required -----------.info Node Name -----------linux1 Result: Package Available Required -----------------------.6 pdksh-5...2.-----------------------linux1 yes Result: NTP daemon slewing option check passed Checking NTP daemon's boot time configuration.-----------------------pdksh-5. .2...-----------------------linux1 yes Result: NTP daemon's boot time configuration check for slewing option passed NTP common Time Server Check started.Kishore http:/www.-----------------------. Core file name pattern consistency check passed.14" Comment ---------passed Checking for multiple users with UID value 0 Result: Check for multiple users with UID value 0 passed Check: Current group ID Result: Current group ID check passed Checking Core file name pattern consistency. Check: Liveness for "ntpd" Node Name Running? -----------------------------------..14 existence check passed for "pdksh-5.. Checking to make sure user "oracle" is not in "root" group Node Name Status Comment -----------.conf" is available on all nodes NTP Configuration file check passed Checking daemon liveness.-----------------------.-----------------------linux1 does not exist passed Result: User "oracle" is not part of "root" group.14-30.-----------------------linux1 yes Result: Liveness check passed for "ntpd" Checking NTP daemon command line for slewing option "-x" Check: NTP daemon command line Node Name Slewing Option Set? -----------------------------------..

-----------------------linux1 0.711 passed Time Server "202. Time Offset Limit: 1000.81... _]0." is common to all nodes on which the NTP daemon is "218.140.-----------------------linux1 23. Clock time offset check passed Result: Clock synchronization check using Network Time Protocol(NTP) passed Pre-check for cluster services setup was unsuccessful on all the nodes.140.21.7" is common to all nodes on which the NTP daemon is ".199" is common to all nodes on which the NTP daemon NTP Time Server passed Clock time offset check from NTP Time Server started.81.. Time Server: 218.45.oracle@linux1:/d01/oracle/RAC/11gR2/grid_[oracle@linux1 grid]$ Script done on Tue 27 Jul 2010 08:02:17 AM IST Appendix B .7 Time Offset Limit: 1000.199" has time offsets that are within permissible limits for nodes "[linux1]".appsdba.21. Time Server: 209.45.9.0 msecs Node Name Time Offset Status -----------.INIT. Checking on nodes "[linux1]".199 Time Offset Limit: 1000. Status -----------------------passed that are within permissible limits Time Server: .45.36 Time Offset Limit: 1000.78 passed Time Server "218.9.Author – A.21.9.81.Kishore http:/www.71.-----------------------linux1 1.7" has time offsets for nodes "[linux1]".71.497 Time Server "209.0 msecs Node Name Time Offset Status -----------.-----------------------linux1 11.0 msecs Node Name Time Offset -----------.-----------------------.info NTP Time Server is running NTP Time Server running NTP Time Server running NTP Time Server is running Check of common "202.INIT.-----------------------.-----------------------.INIT.0 passed Time Server ".0 msecs Node Name Time Offset Status -----------.140..36" has time offsets that are within permissible limits for nodes "[linux1]".71. Check: Clock time offset from NTP Time Server Time Server: 202." has time offsets that are within permissible limits for nodes "[linux1]".36" is common to all nodes on which the NTP daemon "209.

sh Running Oracle 11g root.. 2010-07-27 08:46:51: Parsing the host name 2010-07-27 08:46:51: Checking for super user privileges 2010-07-27 08:46:51: User has super user privileges Using configuration parameter file: /d01/oracle/app/11.sh script..txt [root@linux1 grid]# sh root. Creating /etc/oratab file. Now product-specific root actions will be performed.txt Script started.sh script.Author – A.0/grid/ [root@linux1 grid]# script akr. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.. Operation successful. root wallet root wallet cert root cert export peer wallet profile reader wallet pa wallet peer wallet keys .2.. file is akr. The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /d01/oracle/app/11. The file "coraenv" already exists in /usr/local/bin.. Overwrite it? (y/n) [n]: y Copying coraenv to /usr/local/bin ... Overwrite it? (y/n) [n]: y Copying dbhome to /usr/local/bin .2.0/grid/crs/install/crsc onfig_params Creating trace directory LOCAL ADD MODE Creating OCR keys for user 'root'. privgrp 'root'.0/grid Enter the full pathname of the local bin directory: [/usr/local/bin]: The file "dbhome" already exists in /usr/local/bin... The file "oraenv" already exists in /usr/local/bin.info cd /d01/oracle/app/11..Kishore http:/www..2. Overwrite it? (y/n) [n]: y Copying oraenv to /usr/local/bin .appsdba.

Kishore http:/www.Author – A.gipcd' on 'linux1' CRS-2672: Attempting to start 'ora. ohasd is starting ADVM/ACFS is not supported on Redhat 4 CRS-2672: Attempting to start 'ora..crsd' on 'linux1' . privgrp 'root'.cssd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'linux1' CRS-2676: Start of 'ora.ctssd' on 'linux1' CRS-2676: Start of 'ora. Creating OCR keys for user 'root'. CRS-2672: Attempting to start 'ora.diskmon' on 'linux1' CRS-2676: Start of 'ora. DiskGroup DATA created successfully.appsdba.gipcd' on 'linux1' succeeded CRS-2676: Start of 'ora.cssdmonitor' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.info pa wallet keys peer cert request pa cert request peer cert pa cert peer root cert TP profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP profile reader pa cert TP profile reader peer cert TP peer user cert pa user cert Adding daemon to inittab CRS-4123: Oracle High Availability Services has been started.cssdmonitor' on 'linux1' CRS-2676: Start of 'ora.ctssd' on 'linux1' succeeded ASM created and started successfully.cssd' on 'linux1' CRS-2672: Attempting to start 'ora.diskmon' on 'linux1' succeeded CRS-2676: Start of 'ora. clscfg: -install mode specified Successfully accumulated necessary OCR keys.gpnpd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora. Operation successful.mdnsd' on 'linux1' CRS-2676: Start of 'ora.mdnsd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.

asm' on 'linux1' succeeded CRS-2673: Attempting to stop 'ora.Author – A.cssd' on 'linux1' CRS-2677: Stop of 'ora.cssd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'linux1' CRS-2677: Stop of 'ora.ctssd' on 'linux1' .ctssd' on 'linux1' succeeded CRS-2673: Attempting to stop 'ora.------------------------.crsd' on 'linux1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'linux1' CRS-2677: Stop of 'ora.Kishore http:/www.cssd' on 'linux1' succeeded CRS-2673: Attempting to stop 'ora.diskmon' on 'linux1' CRS-2676: Start of 'ora.gipcd' on 'linux1' succeeded CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'linux1' succeeded CRS-2673: Attempting to stop 'ora. ONLINE 0482638d4e5d4f0fbfd40e025d6ca900 (ORCL:VOL1) [DATA] 2.cssdmonitor' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora. CRS-4256: Updating the profile CRS-4266: Voting file(s) successfully replaced ## STATE File Universal Id File Name Disk group -.gpnpd' on 'linux1' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'linux1' CRS-2677: Stop of 'ora.info CRS-2676: Start of 'ora.crsd' on 'linux1' CRS-2677: Stop of 'ora.gpnpd' on 'linux1' CRS-2676: Start of 'ora.gipcd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora. ONLINE 433cdc1d1b7f4f1fbf7f126bc0452222 (ORCL:VOL3) [DATA] Located 3 voting disk(s).cssdmonitor' on 'linux1' CRS-2677: Stop of 'ora.mdnsd' on 'linux1' CRS-2677: Stop of 'ora.mdnsd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'linux1' CRS-2672: Attempting to start 'ora. Successful addition of voting disk 433cdc1d1b7f4f1fbf7f126bc0452222. CRS-2673: Attempting to stop 'ora. Successfully replaced voting disk group with +DATA.mdnsd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.appsdba.cssdmonitor' on 'linux1' CRS-2676: Start of 'ora.diskmon' on 'linux1' succeeded CRS-2676: Start of 'ora.asm' on 'linux1' CRS-2677: Stop of 'ora. ONLINE 63878fa4923f4f5dbfadf6a8be49a18a (ORCL:VOL2) [DATA] 3.----.mdnsd' on 'linux1' CRS-2676: Start of 'ora.--------1.gipcd' on 'linux1' CRS-2676: Start of 'ora.crsd' on 'linux1' succeeded CRS-4256: Updating the profile Successful addition of voting disk 0482638d4e5d4f0fbfd40e025d6ca900. Successful addition of voting disk 63878fa4923f4f5dbfadf6a8be49a18a.

.. Copying coraenv to /usr/local/bin ...DATA.loc The inventory is located at /d01/oracle/app/oraInventory 'UpdateNodeList' was successful.2.DATA.info CRS-2676: Start of 'ora. Actual 6000 MB The inventory pointer is located at /etc/oraInst... Checking swap space: must be greater than 500 MB. Now product-specific root actions will be performed.sh script.ctssd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'linux1' CRS-2676: Start of 'ora.asm' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.0/grid Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin . succeeded Updating inventory properties for clusterware Starting Oracle Universal Installer. The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /d01/oracle/app/11.asm' on 'linux1' CRS-2676: Start of 'ora.. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root..sh Running Oracle 11g root... Appendix C sh root.asm' on 'linux1' succeeded CRS-2672: Attempting to start 'ora.0/grid/cdata/linux1/back up_20100727_085448.olr Configure Oracle Grid Infrastructure for a Cluster .evmd' on 'linux1' CRS-2676: Start of 'ora.. .dg' on 'linux1' CRS-2676: Start of 'ora.crsd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora...2. Passed Creating /etc/oratab file.appsdba.asm' on 'linux1' CRS-2676: Start of 'ora.Author – A.evmd' on 'linux1' succeeded CRS-2672: Attempting to start 'ora. Copying oraenv to /usr/local/bin .Kishore http:/www.sh script.dg' on 'linux1' succeeded linux1 2010/07/27 08:54:48 /d01/oracle/app/11..

0/grid/crs/install/crsc onfig_params Creating trace directory LOCAL ADD MODE Creating OCR keys for user 'root'.cssd' on 'linux2' CRS-2672: Attempting to start 'ora.gpnpd' on 'linux2' CRS-2676: Start of 'ora..diskmon' on 'linux2' succeeded CRS-2676: Start of 'ora.info 2010-07-27 08:57:25: Parsing the host name 2010-07-27 08:57:25: Checking for super user privileges 2010-07-27 08:57:25: User has super user privileges Using configuration parameter file: /d01/oracle/app/11.0/grid/cdata/linux2/back up_20100727_090136.gipcd' on 'linux2' CRS-2676: Start of 'ora.crsd' on 'linux2' CRS-2676: Start of 'ora.Kishore http:/www..gipcd' on 'linux2' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'linux2' succeeded CRS-2672: Attempting to start 'ora. ohasd is starting ADVM/ACFS is not supported on Redhat 4 CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS d aemon on node linux1.2.diskmon' on 'linux2' CRS-2676: Start of 'ora.ctssd' on 'linux2' CRS-2676: Start of 'ora.7-1 . Operation successful.appsdba. privgrp 'root'.mdnsd' on 'linux2' succeeded CRS-2672: Attempting to start 'ora.2.mdnsd' on 'linux2' CRS-2676: Start of 'ora.crsd' on 'linux2' succeeded CRS-2672: Attempting to start 'ora. Adding daemon to inittab CRS-4123: Oracle High Availability Services has been started.asm' on 'linux2' CRS-2676: Start of 'ora.evmd' on 'linux2' succeeded linux2 2010/07/27 09:01:36 /d01/oracle/app/11. number 1.0. cvuqdisk-1. restarting to join the clu ster CRS-2672: Attempting to start 'ora.Author – A.cssd' on 'linux2' succeeded CRS-2672: Attempting to start 'ora.evmd' on 'linux2' CRS-2676: Start of 'ora.cssdmonitor' on 'linux2' CRS-2676: Start of 'ora.cssdmonitor' on 'linux2' succeeded CRS-2672: Attempting to start 'ora..olr Preparing packages for installation. and is terminating An active cluster was found during exclusive startup.ctssd' on 'linux2' succeeded CRS-2672: Attempting to start 'ora.asm' on 'linux2' succeeded CRS-2672: Attempting to start 'ora.

Checking swap space: must be greater than 500 MB.Author – A..Kishore http:/www.. Passed .loc The inventory is located at /d01/oracle/app/oraInventory 'UpdateNodeList' was successful. succeeded Updating inventory properties for clusterware Starting Oracle Universal Installer.appsdba.info Configure Oracle Grid Infrastructure for a Cluster . Actual 7994 MB The inventory pointer is located at /etc/oraInst...

Sign up to vote on this title
UsefulNot useful