You are on page 1of 53

Quick Installation Guide Oracle9i RAC on IBM eServer pSeries with AIX 4.3.

3

Version 1.1 February 2002

Authors : Fabienne Lepetit - Oracle France Michel Passet - EMEA Oracle/IBM JSC

Many thanks to : John McHugh - Oracle Corporate François Pons - Oracle EMEA PTS EMEA Oracle/IBM JSC team

Installing Oracle9i RAC on IBM

pSeries with AIX 4.3.3

page 1/ 53

Installing Oracle 9.0.1 RAC on AIX 4.3.3
A. THE AIM OF THIS DOCUMENT ....................................................................................................... 3 B. PREPARING THE SYSTEM.............................................................................................................. 4 B. PREPARING THE SYSTEM.............................................................................................................. 5 Hardware requirements...................................................................................................................... 5 Software requirements ....................................................................................................................... 5 AIX patches requirements .................................................................................................................. 5 SSA external disks microcode............................................................................................................ 5 SSA adapters microcode.................................................................................................................... 6 C. NETWORK CONFIGURATION ........................................................................................................ 7 D. CREATING THE RAW DEVICES ..................................................................................................... 9 E. CONFIGURING THE VSD SYSTEM ON SP NODES, USING PSSP 3.2....................................... 10 F. CONFIGURING HACMP/ES ON A CLUSTER OF PSERIES HOSTS........................................... 12 G. INSTALLING ORACLE ................................................................................................................... 18 Set up the Oracle environment......................................................................................................... 18 Cluster Manager Software................................................................................................................ 19 Unzip the distribution or mount the CDROM .................................................................................... 19 H. INSTALL THE ORACLE SOFTWARE ............................................................................................ 20 I. CREATING THE DATABASE ........................................................................................................... 29 Manually ........................................................................................................................................... 29 With the database configuration assistant (DBCA) .......................................................................... 30 J. POST INSTALLATION..................................................................................................................... 31 Startup/shutdown services ............................................................................................................... 31 Configure listener.ora / sqlnet.ora / tnsnames.ora ........................................................................... 31 Configure Oracle Enterprise Manager.............................................................................................. 31 Troubleshooting................................................................................................................................ 32 Appendix A : SSA external disks and adapters microcode management............................................ 33 Appendix B : Logical volumes creation ................................................................................................ 34 Appendix C : VSD management on SP nodes, using PSSP 3.2 ........................................................ 35 Appendix D : Cluster topology & network verification output. .............................................................. 37 Appendix E : Installation Directories. ................................................................................................... 40 Appendix F : RAC Database creation script & init.ora. ........................................................................ 41 Appendix G : Some configuration files… (examples) .......................................................................... 47 Appendix H : Oracle technical notes .................................................................................................... 50

Installing Oracle9i RAC on IBM

pSeries with AIX 4.3.3

page 2/ 53

A. THE AIM OF THIS DOCUMENT
The aim of this document is to provide help to install Oracle9i Real Application Clusters on IBM eServer pSeries with AIX 4.3.3 through a description of the different steps necessary to run Oracle9i RAC. It is based on our 9i RAC installation experience on AIX and is ever evolving.

There are two ways to setup a RAC environment depending on the type of hardware that is used and the software that is installed. Your configuration will therefore direct you towards one or the other of the following two methods : - Virtual Shared Disks (VSD) when available - High Availability Cluster Management Program (HACMP) always possible In this document, both methods are explained. The information contained in this paper resulted from : - Oracle and IBM documentations - Installation runs of Oracle9i RAC - Workshop experiences done in the Oracle/IBM Join Solutions Center - Contributions from Oracle and IBM specialists. Please also refer to Oracle documentation for more information. (http://docs.us.oracle.com). Oracle9i Quick Installation Procedure Release 9.0.1 for AIX-Based Systems Oracle9i Installation Guide Release 9.0.1 for UNIX Systems Oracle9i Administrator's Reference 9.0.1 for UNIX Systems Oracle9i Release Notes Release 9.0.1 for AIX-Based Systems Oracle9i Online Generic Documentation CD-ROM Installation and Usage Notes Oracle9i Real Application Clusters Installation and Configuration Oracle9i Installation Checklist for AIX-Based Systems Oracle Enterprise Manager Configuration Guide

Your comments are important for us. We want our technical papers to be as helpful as possible. Please send us your comments about this document to the EMEA Oracle/IBM Joint Solutions Center.

Use our email address :

oraclibm@fr.ibm.com
or our phone number :

+33 (0)4 67 34 67 49

Installing Oracle9i RAC on IBM

pSeries with AIX 4.3.3

page 3/ 53

How to install 9i RAC on AIX using this document?

Prepare the system. Chapter B.

Configure the network. Chapter C.

Create the raw devices. Chapter D.

SP nodes : configure the VSDs. Chapter E.

pSeries cluster : configure HACMP/ES. Chapter F.

Prepare the installation of Oracle. Chapter G.

Install the Oracle sftware. Chapter H.

Create the database. Chapter I.

Post-install tasks. Chapter J.

Installing Oracle9i RAC on IBM

pSeries with AIX 4.3.3

page 4/ 53

B. PREPARING THE SYSTEM
HARDWARE REQUIREMENTS • • • • RAM >= 512 MB Command to check the physical memory : lsattr –El sys0 –a realmem Internal disk >= 4 GB for the oracle code Paging space = 2 x RAM, with a minimum of 400 MB Nota : for big servers with more than 8 GB of memory, the paging space could be less than 2 x RAM. To check the paging space configured : lsps –a Temporary Disk Space: The Oracle Universal Installer requires up to 800 MB of free space in the /tmp directory. To check the free temporary space available : df –k /tmp You can use an other filesystem instead of /tmp. Set the TEMP environment variable (used by Oracle) and the TMPDIR environment variable to the new location. For example : export TEMP=/new_tmp export TMPDIR=/new_tmp Change the permissions of /new_temp chown oracle:dba /new_temp CD-ROM drive. If the server does not have a CD-ROM unit (like a SP node for example), it is still possible to mount via NFS the drive from an other machine on the network.

SOFTWARE REQUIREMENTS • • • • AIX 4.3.3 Maintenance level 9 To determine the current operating system version : oslevel To check the maintenance level applied : instfix -i | grep ML PSSP 3.2 ptfset 12 SP machine only VSD (Virtual Shared Disks) SP machine only HACMP/ES 4.4 Clusters of pSeries servers only

AIX PATCHES REQUIREMENTS IY01050 IY03478 IY04109 IY04149 IY04767 IY07276 IY06749 IY15138 IY20220 IY22458 (AIXV43 ONLY) SUPPORT FOR NON-ROOT ACCESS TO KERNEL PERF STA PTCs rejected because instance number wraps PROBLEM WITH HA_GS_INIT() FOR 64-BIT CLIENTS PTCs rejected because instance number wraps css0 IP driver shouldn't return ENETDOWN during (AIXV43 only) AIO_SUSPEND RETURNS WITHOUT I/O COMPLETION HAES/ORACLE: add event management variables for (AIXV43 only) LIO_LISTIO RETURNS 0 INSTEAD OF -1 FOR EAGAIN E RSCT 1.2.1 Maintainence Level PTF. Mandatory to link Oracle binaries (AIXV43 only) GETPWUID IN 64BIT APPLICATION FAILS WHILE USI instfix –ik IY15138

To check if a specific patch is applied :

You can download new AIX maintenance levels and specified patches on http://techsupport.services.ibm.com/server/nav?fetch=ffa4e

SSA EXTERNAL DISKS MICROCODE It is particulary important for HACMP that all the SSA disks connected to the cluster are all at the same level of microcode.

Installing Oracle9i RAC on IBM

pSeries with AIX 4.3.3

page 5/ 53

–1 in the file /etc/security/limits) To turn some user limitation to unlimited. use smit users Installing Oracle9i RAC on IBM pSeries with AIX 4. The default limits should be set to unlimited. 2001) are : 9911. 0012 and 0070 (depending on the model of the disk). SSA ADAPTERS MICROCODE The latest level of microde is B300 (12/2001) • Check if there is some AIX default limitations (especially on the file size) File size limitation: ulimit –f All limitations : ulimit –a See also the file /etc/security/limits which shows the limits for each user. To list the SSA disks of the cluster : lscfg | grep pdisk To check the microcode level : lscfg –vl pdisknn (ROS level and ID line) For more information on the procedure of download and installation of new microcode. 0023.Last microcode levels (november 1st.3 page 6/ 53 . except for core (e. The default stanza applies to all new user to be created.3. This file can be modified by root with vi.g. see appendix A.

.9.194.128.194.C. In the root’s home directory. fixed IP address.rhosts file. /etc/hosts file.2 rac2_boot rac2_service rac2_stdby rac1_fixed rac2_fixed # HACMP managed addresses # HACMP managed addresses # External.2 int-rac2 192. out of HACMP management /etc/hosts.1 192.rhosts # for VSD configuration : rac1 rac2 int-rac1 int-rac2 Installing Oracle9i RAC on IBM pSeries with AIX 4.9.ibm. fixed IP address External. to enable rsh.mop.equiv # for VSD configuration : rac1 rac2 int-rac1 int-rac2 # for HACMP configuration : rac1_boot rac1_service rac1_stdby rac2_boot rac2_service rac2_stdby rac1_fixed rac2_fixed .10.194..1 int-rac1 10.1 rac1_stdby 9.2 192.com # # # # Internal private net.128.22 10.10.9.9. fast interconnect Internal private net.9. out of HACMP management # External.128. ! When VSD are used : /etc/hosts for VSD (on both nodes) 10.equiv file.10.10. Put the list of machines or nodes into hosts.10.9.194.2 9.10. rcp.2 rac2 rac2. fixed IP address (This file should contain private network addresses which would use the private link (interconnect) between the two nodes.9.10.) ! When HACMP is used : /etc/hosts for HACMP (on both nodes) 9. $HOME/.ibm. rlogin commands.mop. fixed IP address.1 rac1 rac1.com 192.10.3 page 7/ 53 . NETWORK CONFIGURATION Set up user equivalence for the oracle account. /etc/hosts. put the list of machines.1 rac1_boot 9.9.11 rac1_service 10.equiv. fast interconnect External.3.128.

equiv and . but not advised because of security reasons.3 page 8/ 53 .# for HACMP configuration : rac1_boot rac1_service rac1_stdby rac2_boot rac2_service rac2_stdby rac1_fixed rac2_fixed Note : It is possible.3. Test if the user equivalence is correctly set up (rac2 is the secondary server name) You are logged on rac1 as oracle.rhosts files. to put a “+” in hosts. $ rlogin rac2 (-> no pwd) $ rcp /tmp/toto rac2:/tmp/toto $ rsh rac2 pwd Installing Oracle9i RAC on IBM pSeries with AIX 4.

The data. Group #1 Redo Log Thread #2. its own raw devices. In a normal operation. control files and so on are stored on external SSA disks. The size of the logical volume is expressed in number of PP. duplicated on the two machines of the cluster. This is the device name to use with VSD. Because theses SSA loops are connected on the two machines. the others datafiles. in order to have roughly the same volume. There are shared.3 page 9/ 53 . Technical file: one raw device to store server configuration information (list of nodes. in case of a failure of one node.D. CREATING THE RAW DEVICES The Oracle code is located on an internal SCSI disk.conf in OPS) Database files: Size 5M 12M 80M 90M 100M 100M 10M 10M 120M 120M 120M 120M 120M 160M 512M 512M 400M 160M Logical Volume name Spfile_lv Tools_lv Index_lv Drsys_lv Temp_lv cmwlite_lv ctrl1_lv ctrl2_lv Users_lv redolog1_1_lv redolog1_2_lv redolog2_1_lv redolog2_1_lv example_lv Undo1_lv Undo2_lv System_lv oemrepo_lv Raw device name /dev/rvsd_spfile /dev/rvsd_tools /dev/rvsd_index /dev/rvsd_drsys /dev/rvsd_temp /dev/rvsd_cmwlite /dev/rvsd_ctrl1 /dev/rvsd_ctrl2 /dev/rvsd_users /dev/rvsd_redolog1_1 /dev/rvsd_ redolog1_2 /dev/rvsd_ redolog2_1 /dev/rvsd_ redolog2_1 /dev/rvsd_example /dev/rvsd_undo1 /dev/rvsd_undo2 /dev/rvsd_system /dev/rvsd_oemrepo Purpose Server Parameter File (replacing init. A script is provided in appendix to create the volumes groups and the logical volume as specified above. each node has its own disks. and ora2vg of the secondary are build with a physical partition size of 16MB. that have to be duplicated on each instance. oemrepo. Group #2 EXAMPLE Tablespace UNDO Tablespace (instance #1) UNDO Tablespace (instance #2) SYSTEM Tablespace OEM repository All these raw devices can be created for our database. Except for the 2 redo logs and undo files. for VSD configuration. cmwlite…) are not mandatory. Once a logical volume new_lv is created on a node. are splited on the two volumes groups.ora) TOOLS Tablespace INDX Tablespace DRSYS (intermedia & Ultrasearch) Tablespace TEMP Tablespace CMWLITE (OLAP) Tablespace Control File # 1 Control File # 2 USERS Tablespace Redo Log Thread #1. Group #2 Redo Log Thread #2. Installing Oracle9i RAC on IBM pSeries with AIX 4. But some of them (for exemple drsys. A typical installation requires the following raw devices. all the disks can be accessed by both of the nodes. its own volume group. The two volumes groups. Group #1 Redo Log Thread #1.3. index. when the two nodes are up and running. ora1vg for the primary node. All the SSA disks are physically linked to the two nodes (open loops). not in Kbytes. /dev/rnew_lv where the “r” stands for raw device. two new entries appears in the /dev directory : /dev/new_lv which is normally used by LVM for file systems. etc…) Size 100M Logical Volume name srvconfig_lv Device name /dev/ rvsd_srvconfig Purpose Server configuration file (replacing db_name. but not concurrent.

HACMP/ES is used for clusters of pSeries machines with AIX 4.3 page 10/ 53 . and access both of the volumes groups.2.0 vsd.0. To read/write a raw device. A patch will be installed only if the base fileset it fixes is found on the system.cws11 hagsglsm.vsdd 3. Oracle knows only the VSD name of a raw device. • VSD filesets to be installed on CWS and all nodes : vsd.E. the VSD configuration files are updated. CONFIGURING THE VSD SYSTEM ON SP NODES. The volumes groups are NOT opened in concurrent mode.3. When Oracle wants to access a file.0.sysctl 3. no matter if this file have to be accessed via one node. and all the I/O previously processed by the broken machine are rerouted to the remaining node.0 vsd.cws11 hags.0.3.rvsd. It is not a concurrent disk access. In case of a hardware problem of a node.hc To list the status of a service : To start a service : To stop a service : lssrc –g <group of services> startsrc –g <group of service> stopsrc –g <group of service> For example : lssrc –a | grep –i ha hats.scripts 3. start all the HA services and processes stop the HA syspar_ctrl –A syspar_ctrl –D Check if the High Availability is up and running on the nodes : It is composed of the following services (or sub-systems): hags (HA Group Services) hagsglsm hats (HA Topology Services) rvsd hc. There are shared between all the nodes. When we talk about file.3 At the LVM layer.3 and PSSP 3. The VSD layer then send the I/O request to the machine that can physically access the disk. and varyoff (but defined) on the other node. not with file systems.2.0. • Start the High Availability (HA) using a script. we have two volumes groups for a cluster of two nodes. or datafile. It does start/stop all the processes in the right order. you have to install first the base software before the patches. or the other.cws11 hats hags hags 30846 25572 15052 active active active Installing Oracle9i RAC on IBM pSeries with AIX 4.2.0 vsd.0 Note : Generally speaking. The VSD are to be used with a SP machine running AIX 4. we have to understand raw device (a logical volume). VSD reside only with raw devices.rvsd. There are no locks to manage.2.2 The VSD (Virtual Shared Disk) layer is over the AIX Logical Volume Manager layer.cmi 3.2.0 vsd. but a shared one. In case of problem on a machine.rvsdd 3. the other node of the cluster can varyon the volume group of the broken machine.2. it uses the VSD name of the file. USING PSSP 3.3. All the I/O requests to a disk are transmitted to the node who owns the disk. but there are varyon on a single node. Each volume group is varyon and used on one node. and send back the data to the requester node.0. Only one node have the access to a particular disk. This node handles the physical read/write.

all the following commands have to be run on the Control WorkStation (CWS) of the SP. Step 3 : define the logical volumes (raw devices) that can be used by VSD.For example : lssrc –a | grep –i vsd rvsd.cws11 rvsd 40482 active The hags daemon creates a socket (size 0) the first time it starts : /var/ha/soc/hagsdsocket.3 page 11/ 53 . and the link between them Step 2 : define the VSD volumes groups. indicate the node which normally access the volume group. • To enable the VSD of a SP. The user and the group must both have read and write permissions on this socket. For each volume group.3.<CWS_name> should belong to the user root and the group hagsuser. to do the 4 steps for all the raw devices involved in the database. Step 1 : define the nodes of a cluster. and the backup node. the secondary node. Installing Oracle9i RAC on IBM pSeries with AIX 4. Step 4 : start the VSD A script is provided in Appendix. which reference the volume group and the logical volume. A new VSD name is set. The primary node.

man. at the CLVM layer (including memory cache).0.0 cluster.4.0 cluster. It is a real concurrent access.demos cluster. which is enough to install and run 9i RAC.5 cluster.3 page 12/ 53 .rte 4.U.include cluster.client.server.es.adt.server.4. Filesets to be installed on the two machines of the cluster : cluster. are managed by HACMP.client.0.en_US.en_US.client. which enable the concurrent logical volume manager.demos cluster. After all the filesets have been installed: .0 cluster.0.en_US.es.adt.0 cluster.0.es.4. These locks.4.clstat cluster.5 cluster.rte 4.es.clvm.es.en_US.4.es.es.4. locks have to be managed.es.doc.rte 4. English HACMP CSPOC Messages .4. Else.2 cluster.server.images cluster.msg.4.en_US.U.es.es.pdf 4. and not a shared one like in the VSD environment.es.cspoc.es.0.0.es.0.4.server.0.3.F.client.adt.cspoc.html 4. Because several instances access at the same time the same files and data.client.S.0.0.es.server.U.es.en_US.msg.0 cluster.4.cmds 4.add in the PATH environment variable the following directories # /usr/es/sbin/cluster # /usr/es/sbin/cluster/utilities # /usr/es/sbin/cluster/sbin # /usr/es/sbin/cluster/diag .0 cluster.es.4.2.es.es 4.es.4.hc.4.3.ps 4. ES VSM Configuration Utility The two instances of the same parallel database have a concurrent access on the same external disks.es.utils 4.4.2 C C C C C C C C C C C C C C C C C C C C C HAES Web-based HTML HAES PDF Documentation .dsh 4.demo.es. Installing Oracle9i RAC on IBM pSeries with AIX 4.0.0.samples.4.java.5 cluster.samples.U.4.adt.4 cluster.html 4.es.haview. In this 9i RAC installation guide.man.3 cluster.0 cluster.client.es.en_US.en_US.3.utils 4.4.server.samples. the purpose is not to set up all the parameter stuff of HACMP. HACMP/ES is used for clusters of pSeries machines with AIX 4.samples. HACMP layer includes the CLVM.0.2 cluster.es.0.data 4.samples.adt.client. We will focus on the concurrent volumes groups.0.0. HAES Postscript Documentation HACMP Web-based HTML HACMP PDF Documentation .check the existence of symbolic links from files contained in /usr/sbin/cluster to /usr/es/sbin/cluster.3 and PSSP 3.4 cluster.doc.msg.data cluster.demos cluster.4.4.events 4.adt.0 cluster.samples.monitor cluster. HACMP Postscript Documentation ES Client Libraries ES Client Runtime ES Client Utilities ES for AIX Concurrent Access ES CSPOC Commands ES CSPOC dsh ES CSPOC Runtime Commands ES HC Daemon ES Server Diags ES Server Events ES Base Server Runtime ES Server Utilities ES Man Pages .es.en_US.en_US. CONFIGURING HACMP/ES ON A CLUSTER OF PSERIES HOSTS HACMP/ES is a product which provide a high availability on a cluster of two machines.client cluster.4.5 cluster.S.demos cluster.adt.S.doc.5 cluster.0.doc.3 The VSD are to be used with a SP machine running AIX 4.en_US.server.rte 4. create then with ln –s.server cluster.rte 4.0.es.pdf 4.es.0.client.ps 4.4.cspoc.0 cluster.doc.adt.0.adt.0 cluster.vsm.doc.libcl cluster.adt.lib 4.client.0.clinfo cluster.diag 4.es.es.S.cspoc 4.

In RAC environments.3 page 13/ 53 . Use the second field of the output (PVid) of lspv to be sure you are dealing with the same physical disk from two hosts. only a private network is needed.3. Installing Oracle9i RAC on IBM pSeries with AIX 4. 5 – Synchronize the cluster topology. “Add a network” in section “Configure IP-based networks” in smitty. Note : the hdisk number can be different. Run lspv command on both machines. 3 – Configure the network. it will be necessary to enter its name in the attributes of your resource group (line “Volume groups” in the “Change/Show Resources/Attributes for a Resource Group” panel of smitty). 7 – Synchronize the cluster resources. Then. There must be one adapter by machine. Consult the HACMP documentation. Important note: your cluster must be synchronized after each new modification. you will need a high performance private network between the machines participating to the RAC cluster. available on http://xxx. It’s not necessary to define boot. When you will have created a concurrent volume group (see next paragraph). 1 – Configure the cluster : “Add a cluster definition” in smitty . The network type of this interconnect can be HPS (High Performance Switch) or ethernet (use a gigabit ethernet. 2 – Configure nodes of the cluster: “Add cluster nodes” in smitty. In the case of the implementation of a concurrent volume group.Main steps for implementing an HACMP configuration. “Add a resource group” in section “Cluster resources” in smitty. 6 – Define a resource group.xxx 4 – Configure the adapters. you enter the name of the nodes participating to the cluster. depending on the others disks connected on each machine.xxx. for example). Note : It is advised to have also a non-IP network (like RS/232 or Target mode SSA). “Synchronize Cluster Topology” in smitty. and seen by both. “Add an adapter” in section “Adapters on IP-based network” in smitty. In this step you give an identifier and a name to your cluster. All participating nodes must be entered. service and standby addresses like in cascading or rotating HACMP configurations. The node relationship must be “concurrent”. Here. How to create and setup a concurrent volume group 1 – Check if the target disks are physically linked to the two machines of the cluster. “Synchronize Cluster Resources” in smitty. check the attributes of the resource group in “ Change/Show Resources/Attributes for a Resource Group”.

The volume group just has to be created with concurrent capability. neither auto-varyon. import the definition of the volume group : Import a Volume Group Type or select values in entry fields. before choosing this number. You must choose the major number to be sure the volume groups have the same major number in all the nodes (attention.2 – Create at the AIX level on the first machine a concurrent volume group. The new volume group is now defined on the all the machines of the cluster. with the concurrent capable feature set on. 0 Aug 02 13:39 /dev/myvg The major number for myvg volume group is 57. Press Enter AFTER making all desired changes. create all the logical volumes and file systems you need for your database. type varyoffvg myvg On the second machine. VOLUME GROUP name * PHYSICAL VOLUME name Volume Group MAJOR NUMBER Make this VG Concurrent Capable? Make default varyon of VG Concurrent? [Entry Fields] [myvg] [] [64] no no + +# + + The physical volume name (hdisk) could not have the same number on both sides. you must be sure it’s free on all the nodes). Check the PVID of the disk. Installing Oracle9i RAC on IBM pSeries with AIX 4.3 page 14/ 53 . This number has to be undefined on all the nodes. myvg smit vg Add a Volume Group Type or select values in entry fields. Be sure to have the same major number. type crw-rw---1 root system ls –al /dev/* 57. 3 – Import myvg volume group on the second machine On the first machine. because it’s the only information reliable and common thru the cluster. On this volume group. Press Enter AFTER making all desired changes. To check all defined major number. These tasks have to be managed by HACMP.3. VOLUME GROUP name Physical partition SIZE in megabytes * PHYSICAL VOLUME names Activate volume group AUTOMATICALLY at system restart? Volume Group MAJOR NUMBER Create VG Concurrent Capable? Auto-varyon in Concurrent Mode? [Entry Fields] [myvg] 32 [] no [64] yes no + + + +# + + Never choose YES to activate at system restart.

perform the following tasks : - check hagsuser group exists.4 – Define myvg volume group in an HACMP resource smit hacmp Change/show ressources/attributes for ressource group Service IP label None Concurrent VG myvg Fsck sequential Synchronize the topology and the ressources 5 – Start HACMP smit hacmp services start Is HACMP correctly configured? Checklist. see the note # 2064876. HACMP interconnect network adapter configuration can be checked with : /usr/sbin/cluster/utilities/cllsif Installing Oracle9i RAC on IBM pSeries with AIX 4. The HAGS socket needs to be writable by "oracle" and the "cldomain" executable needs to be executable by "oracle".3.`/usr/sbin/cluster/utilities/ cldomain` For more information. 1 – HAGS socket. else create it place "oracle" into the "hagsuser" group change the permissions on the "cldomain" executable : # chmod a+x /usr/sbin/cluster/utilities/cldomain change the group to "hagsuser" for the "svcsdsocket. By configuring the group and permissions for the "grpsvcsdsocket.<domain>" file the instance will be able to communicate with HAGS and the Oracle instance will mount. On all the nodes of the cluster.<domain>" socket: # chgrp hagsuser /var/ha/soc/grpsvcsdsocket.102 in Metalink (also presented in appendix H : Oracle Technical notes).3 page 15/ 53 . 2 – Interconnect.

3 – Concurrent Volume group Check the concurrent volume group is active on all the nodes of the cluster. Oracle with HACMP in concurrent mode can be implemented in SP environments. […] When HACMP and PSSP are installed on the same machine.2. Hereunder.cllsif on a working configuration should look like this: Adapter pfpdb3 pfpdb4 Type service service Network pfpdb pfpdb Net Type ether ether Attribute private private Node pfpdb3 pfpdb4 IP Address 11. So.24 11.3 page 16/ 53 . Oracle assumes that customers want to use PSSP functionality.3 For more information. see the note # 115792.3. PSSP and HACMP will coexist on the same machine.18.2. Installing Oracle9i RAC on IBM pSeries with AIX 4. customers using OPS [or RAC] must place all database files on Virtual Shared Disks (VSDs).1 in Metalink (also presented in appendix H : Oracle Technical notes).18. In the default configuration. lsvg myvg VOLUME GROUP: VG STATE: VG PERMISSION: MAX LVs: LVs: OPEN LVs: TOTAL PVs: STALE PVs: ACTIVE PVs: Concurrent: VG Mode: Node ID: MAX PPs per PV: myvg active read/write 256 37 30 1 0 1 Capable Concurrent 2 1016 VG IDENTIFIER: 000915700ab7290d PP SIZE: 32 megabyte(s) TOTAL PPs: 543 (17376 megabytes) FREE PPs: 40 (1280 megabytes) USED PPs: 503 (16096 megabytes) QUORUM: 1 VG DESCRIPTORS: 2 STALE PPs: 0 AUTO ON: no Auto-Concurrent: Disabled Active Nodes: MAX PVs: 1 32 4 – Daemons etc… Execute the following command : lssrc -a | egrep 'svcs|ES' It should give the following output : topsvcs grpsvcs grpglsm emsvcs emaixos clstrmgrES cllockdES clsmuxpdES clinfoES topsvcs grpsvcs grpsvcs emsvcs emsvcs cluster lock cluster cluster 45454 59670 39028 59508 45896 47700 52542 37470 56110 active active active active active active active active active HACMP and PSSP on the same machine. an excerpt taken from a note about the installation of Oracle on AIX-Based Systems".

3 page 17/ 53 .3. including the listener. they must enable HACMP functionality by setting the environment variable PGSD_SUBSYS to grpsvcs.. The PGSD_SUBSYS environment variable should be set in all the environments where Oracle is used. Oracle will not allow VSDs and Concurrent Logical Volumes (CLVs) to be used on the same database. Oracle will report an error if the customer attempts to use CLVs.ora file… […] Installing Oracle9i RAC on IBM pSeries with AIX 4. If PSSP services are being used. If HACMP services are used (i.e.If customers wish to use the Concurrent Logical Volume Manager (CLVM) instead of VSDs. PGSD_SUBSYS is set to grpsvcs). Oracle will report an error if the customer attempts to use VSDs.

This group is a secondary group for oracle user. After installation.sh) will contain information that briefly describes the Oracle software installations and databases on the server. This group is not mandatory. hagsuser For high availability (if not already created). The external SSA disks will store the datafiles. These commands verify that the oracle account has the appropriate permissions : touch /etc/oraInst. it will be the group owner of the oracle code files.3. oinstall The ora inventory group.loc chmod 644 /etc/oraInst. with a single line : srvconfig_loc=/dev/rvsd_srvconfig In Sqlplus. execute the following command : touch /etc/passwd • Installing Oracle9i RAC on IBM pSeries with AIX 4.loc chown oracle:dba /etc/oraInst. The oracle user must have dba as primary group.loc /etc/oratab /etc/srvConfig.3 page 18/ 53 .loc /etc/oratab /etc/srvConfig.loc file on each node. INSTALLING ORACLE SET UP THE ORACLE ENVIRONMENT • Use smit group or smitty group to create the groups dba Primary group for the oracle user. Use smit user to create the users oracle Owner of the database. Also add the secondary group hagsuser to the root account. is generally located on an internal SCSI disk. as root. and internal SCSI free disk of 18. To list the internal disks : lscfg | grep -i scsi | grep hdisk Suppose we have hdisk1. If it exists. oinstall and hagsuser as secondary groups. This file system of 4 GB. these two files (created by root. when you “connect / as sysdba” if you get “insufficient privileges” (even if you are the user “oracle” with group “dba”).loc and /etc/oratab files are writable by the oracle account.loc /etc/oratab /etc/srvConfig.G. Verification : check if the file /etc/group contains lines such as : (the numbers could be different) hagsuser:!:203:oracle. root dba:!:204:oracle oinstall:!:205:oracle • Create the file system for Oracle code.loc • Edit the /etc/srvConfig.2 GB Create a volume group called oraclevg : mkvg -f -y'oraclevg' -s'16' hdisk1 Create a 4GB file system /oracle in the previous volume group (large file enabled): crfs -v jfs -a bf=true -g'oraclevg' -a size='8388608' -m'/oracle' A'yes' -p'rw' -t'no' -a nbpi='8192' -a ag='64' mount /oracle chown oracle:dba /oracle • • Verify that the /etc/oraInst.

loc # If tmp has been re-directed (for example in /new_temp) add the 2 following lines: export TEMP=/new_temp export TEMPDIR=/new_temp # if you want to use CLVM of HACMP instead of VSD in a SP environment export PGSD_SUBSYS=grpsvcs # set DISPLAY according to the machine to where you want to send the display.1 export ORA_NLS33=$ORACLE_HOME/ocommon/nls/admin/data export NLS_LANG=american_america.3.loc # These variables are not used and incorrectly referred to in some docs. and execute xhost + as root export DISPLAY=<machine_name>:0 export ENV=$HOME/. the Oracle RAC option should be automatically preselected in Oracle Universal Installer.0.1.• Oracle environment In the .kshrc export PS1='{'"$(hostname -s)"'} $PWD> ' set -o vi CLUSTER MANAGER SOFTWARE If the cluster manager software is correctly set up. export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib:usr/local/lib export LIBPATH=$ORACLE_HOME/lib:$LIBPATH export CLASSPATH=$ORACLE_HOME/jre:$ORACLE_HOME/jre/1. UNZIP THE DISTRIBUTION OR MOUNT THE CDROM If you have downloaded the distribution.profile in Oracle’s $HOME : # Oracle specific environment umask 022 export ORACLE_BASE=/oracle export ORACLE_HOME=$ORACLE_BASE/product/9.loc #SRVM_RAW_CONFIG=/etc/srvConfig. Note: If you copy the five CDs to the hard disk. Installing Oracle9i RAC on IBM pSeries with AIX 4.WE8ISO8859P1 export ORACLE_SID=INSTANCE_NAME export PATH=/usr/bin:/etc:/usr/sbin:/usr/ucb:/usr/local/bin:$ORACLE_HOME/bin:/usr/bin/X11: /sbin:. you should have 5 CDs.3 page 19/ 53 . use cp –a to maintain directories and links.8/lib:/usr/jdk_base: /usr/jdk_base/lib:$ORACLE_HOME/rdbms/jlib:$ORACLE_HOME/jlib:$ORACLE_HOME/network/jlib # used by database configuration assistant to map datafiles to raw devices export DBCA_RAW_CONFIG=$HOME/dbca_raw_config # This file contains the raw device for 9i/RAC config export SRVM_SHARED_CONFIG=/etc/srvConfig. # Use SRVM_SHARED_CONFIG instead #OPSM_SHARED_CONFIG=/etc/srvConfig.

This script creates the file /etc/oraInst.H.sh in a separate window. Installing Oracle9i RAC on IBM pSeries with AIX 4.sh as root in another window. The installer will ask the user to run /tmp/orainstRoot.3. which is used by OUI for the list of installed products. click Next. OUI asks you to run rootpre.loc.3 page 20/ 53 . Remember that the hagsuser should be secondary group for the user oracle. INSTALL THE ORACLE SOFTWARE Login as oracle and follow the procedure hereunder… $ /<cdrom_mount_point>/runInstaller At the OUI Welcome screen.

sh. Verify the UNIX group name of the user which controls the installation of the Oracle9i software. Click OK.loc. If the pre-installation steps have not been completed successfully. Oracle user should have write permissions on this directory. This is the base directory into which OUI will install files. Installing Oracle9i RAC on IBM pSeries with AIX 4.3 page 21/ 53 .A prompt will appear for the Inventory Location (if this is the first time that OUI has been run on this system). to be written to the ORACLE_HOME directory.3. forcing Oracle Inventory files. The Oracle Inventory definition can be found in the file /etc/oraInst. and others. you are asked to run /tmp/orainstRoot. Click Next. This screen only appears the first time Oracle9i products are installed on the system.

Select the Products to install. Click Next. The Destination field defaults to the ORACLE_HOME environment variable. In this example.3.The File Location window will appear. Do not change the Source field. select the Oracle9i Server then click Next.3 page 22/ 53 . Installing Oracle9i RAC on IBM pSeries with AIX 4.

3.3 page 23/ 53 . The next screen allows for a customized database configuration to be chosen. Choose the Enterprise Edition option. Installing Oracle9i RAC on IBM pSeries with AIX 4. The selection on this screen refers to the installation operation.Select the installation type. Click Next. not the database configuration.

Click Next. In this example. “Customized” configuration is selected. It is not necessary to select the node on which the OUI is currently running. Click Next. Select the other nodes on to which the Oracle RDBMS software will be installed.Select the configuration type.3. Installing Oracle9i RAC on IBM pSeries with AIX 4. a customizable database will be created. so.3 page 24/ 53 .

in our case.Identify the raw partition in to which the Oracle9i Real Application Clusters (RAC) configuration information will be written. Enter the name of the raw device previously created. Installing Oracle9i RAC on IBM pSeries with AIX 4.3 page 25/ 53 .3. It is recommended that this raw partition has a minimum size of 100MB. “/dev/rvsd_svrconfig”.

Installing Oracle9i RAC on IBM pSeries with AIX 4.3. The OUI will install the Oracle9i software on to the local node. and will error if selected to do so. Confirm that the RAC database software will be installed and then click Install.An option to Upgrade or Migrate an existing database is presented.3 page 26/ 53 . and then copy this information to the other nodes selected. Do NOT select the radio button. The Summary screen will be presented. The Oracle Migration utility is not able to upgrade a RAC database.

The user won’t be informed of this copy.1/root.3.3 page 27/ 53 . This script must be executed on both nodes.0.sh. And so on until the disk #5. From the root command prompt.During the installation. The results of this are shown below : Installing Oracle9i RAC on IBM pSeries with AIX 4. execute /oracle/product/9. the installer will continue to work because it will copy the files on the other node. you will be prompted to give the location of the second disk. When the installation progress bar will reach 100%.

Installing Oracle9i RAC on IBM pSeries with AIX 4.3.3 page 28/ 53 .

sh gsd is used by OEM and global tools such as srvctl to execute commands on all the nodes at the same time. 10) as sysdba. there are some errors in this file… 9) you can create a password file.loc for example).I.ora file for each node. For example. 8) create the database creation script. And be careful. Do not choose to create the database by copying one of the preconfigured database.3. cdump and bdump directories. CREATING THE DATABASE The database and the two instances can be created by the Oracle Database Assistant. as the DDL statement used to create the TEMP tablespace does not work against a raw device. start gsd by executing gsd. create (or update) oratab file (in /etc directory) with the following line : <db_name>:<$ORACLE_HOME>:N 5) create the udump. rollback_segments… It is possible to create a spfile with “create spfile=’/dev/rawspfile’ from pfile=/…/init. execute the script. Installing Oracle9i RAC on IBM pSeries with AIX 4.sql script as sample. You can use $ORACLE_HOME/srvm/clustdb. Under $ORACLE_HOME execute orapwd file=orapw password=###. 6) set the SID in .profile of oracle user 7) create the init. It is possible to prefix parameter which are local to the instance with the instance name. The configuration device should be pointed to by SRVM_SHARED_CONFIG (containing /var/opt/oracle/srvConfig. This script is also presented in appendix F. instance_name. On one node.3 page 29/ 53 . check the configuration : srvctl config –p <db_name> 4) on each node. thread.ora”. MANUALLY 1) on one node : srvctl add db -p <db_name> -o <oracle_home> 2) for each instance of the database : srvctl add instance –p <db_name> -i <SID> -n <node_name> (it is advised to set the SID to db_name plus instance_number) 3) on each node. The script must be adapted to your environment. initialize the configuration raw device by running srvconfig -init Start the Global services Daemon (as oracle) on each node (runs as OPSDaemon) $ gsd.sh & $ ps -efl | grep –i 'ops' gsd (Oracle Global Services Daemon) needs to be running on each node under oracle privileges.

3 page 30/ 53 .ora' from spfile='/dev/rvsd_3' Installing Oracle9i RAC on IBM pSeries with AIX 4. This parameter file needs to be pointed to by the environment variable DBCA_RAW_CONFIG and makes easier to create the database (see example in Appendix). instead have DBCA create a customized database (create database). First use NETCA to create listeners configuration on each node. DBCA can also be used to cleanly remove instances or add new instance to an existing multi-instance database Optionally back up the spfile SQL> create pfile='?/dbs/initXXX.WITH THE DATABASE CONFIGURATION ASSISTANT (DBCA) Create a parameter file $HOME/dbca_raw_config which will be used by DBCA to map the typical tablespaces to raw devices.3. Start DBCA Do not use a pre-configured database (as the DDL statement used to create the TEMP tablespace does not work against a raw device).

it is necessary to start the Intelligent Agent on each node and to “discover” the nodes. The first administrator for the domain will be sysman/oem_temp.3 page 31/ 53 .oracle srvctl start|stop|status -p <db_name> srvctl start|stop|status -p <db_name> -i <instance_name> srvctl start|stop –p <db_name> –s lsnr srvctl start|stop –p <db_name> –s inst srvctl config –p <db_name> srvctl get env -p <db_name> srvctl set env -p <db_name> LANG=en To start/stop a given instance and listener: To start/stop the listeners only: To start/stop the instances only: To list the instances: To get environment information : To set an env. POST INSTALLATION STARTUP/SHUTDOWN SERVICES GSD must be running for srvctl to be able to run each command on all the nodes. then start it : oemctl start oms Enter a username/password with DBA privileges to connect to the instance where the repository is to be set up.J.3. $ srvctl command -h -> help To start/stop/check all instances and listeners: su . CONFIGURE ORACLE ENTERPRISE MANAGER Use the Java assistant emca to configure the Oracle Management Server.ORA Use netca and/or netmgr to check the configuration of the listener and configure Oracle Net services (by default the Net service may be equal to the global database name (see instance parameter service_names ). Installing Oracle9i RAC on IBM pSeries with AIX 4.ORA / TNSNAMES.ORA / SQLNET. variable globally : To start/stop the Oracle Intelligent Agent: To start/stop the Oracle Management Server: agentctl start oemctl start oms oemctl status oms oemctl stop oms oemapp console oemapp dbastudio OH/Apache/Apache/bin/apachectl start To start an OEM Console : To start Oracle http server (Apache): CONFIGURE LISTENER. For the console to be able to give a single system image of the cluster database.

3.106 # OEM agent (IP address of current node) The SNMP master agent needs to be restarted: #stopsrc –s snmpd #startsrc –s snmpd Then start the OEM agent: $agentctl start - Check /etc/oratab The file should contain a reference to the database name.conf (this is specific to AIX). - Register the database with srvctl (this should not be necessary if the database was created by DBCA) srvctl add db –p <db_name> –o <ORACLE_HOME path> srvctl add instance –p <db_name> –i <SID1> –n <node1> srvctl add instance –p <db_name> –i <SID2> –n <node1> TROUBLESHOOTING Useful SQL: SQL> SELECT * FROM V$ACTIVE_INSTANCES Installing Oracle9i RAC on IBM pSeries with AIX 4.1.3 page 32/ 53 . smux 0.- Start the Oracle Intelligent Agent on each node Add the following line for Oracle Intelligent Agent to /etc/snmpd. The last field should always be “N” on a RAC environment to avoid 2 instances of the same name to be started. not to the instance name.0 “” 129.11.

Advanced Diagnostics.storage.1. This will upgrade the microcode on all the disks with a lower level of microcode than the one installed in /etc/microcode during the phase A.cd to your temporary directory 3. Service Aids. download the file ssacode433..tar 4.6).Select install & update software 6.Type tar -xvf ssacode433. download the file devices.com/hardsoft/products/ssa To list all the SSA disks of the cluster : To check the microcode level : To determine the disk model : lscfg | grep pdisk lscfg –vl pdisknn (ROS Level and ID) lscfg –vl pdisknn (Machine Type and Model) Depending on the disk model.Login as Root 2. Task Selection(Diagnostics.3 (november 1st. etc.Use the directory that you saved and unpacked the ssacode433.Select all filesets in this directory for install 9.tar onto your system in your temporary directory How to apply a new disk drive microcode A.Select install & update from ALL available software 7.) 3. execute the command diag 2.Continue with the microcode installation 7. SSA Service Aids 4.pci.3.storage. 1..3.Display/Download Disk Drive Microcode 5.APPENDIX A : SSA EXTERNAL DISKS AND ADAPTERS MICROCODE MANAGEMENT • SSA Disks The IBM SSA Customer support page resides on http://www. 2001): DCHC(CUSM)->9911.tar file into as the install device 8. DFHC(CUSJ)->9911 DGHC(CUSJ)->9911.Run smit install 5. 1.Execute the command B.ibm. At the prompt. and install it as decribed above.Download Microcode to all SSA Physical Disk Drives 6.ibm.3 page 33/ 53 . the latest level of microcode to download and install on all the SSA disks of the cluster is : Release of new disk drive microcode for AIX 4.ucode (4. DGHC(CUSM)->9911 DRVC(CUSH)->0023 DRHC(CUSS)->0012 DMVC(CUSN)->0070 From the site http://www.No (because software is in /etc/microcode ) 8.14109100.. Installing Oracle9i RAC on IBM pSeries with AIX 4.com/hardsoft/products/ssa.2.Do you want to continue? Yes. • SSA adapter : Advanced SerialRAID Adapter 6225/6230 To install the new adapter microcode.

with two disks mkvg -f -y $secondary_oravg -s'16' ssa_disk_21 ssa_disk_22 # Creation of the logical volumes (raw devices) # The number is the size of the LV (number of 16MB physical mklv -y'ctrl2lv' $secondary_oravg 1 ssa_disk_21 mklv -y'undo2lv' $secondary_oravg 32 ssa_disk_21 mklv -y'redolog2_1lv' $secondary_oravg 8 ssa_disk_21 mklv -y'redolog2_2lv' $secondary_oravg 8 ssa_disk_21 mklv -y'oemrepolv' $secondary_oravg 10 ssa_disk_21 mklv -y'indexlv' $secondary_oravg 5 ssa_disk_21 mklv -y'examplelv' $secondary_oravg 10 ssa_disk_21 mklv -y'spfilelv' $secondary_oravg 1 ssa_disk_21 mklv -y'srvconfiglv' $secondary_oravg 7 ssa_disk_21 mklv -y'cmwlitelv' $secondary_oravg 7 ssa_disk_21 partitions) # 16 MB # 512 MB # 128 MB # 128 MB # 160 MB # 80 MB # 160 MB # 16 MB # 112 MB # 112 MB # To be exectued on the primary node. which owns ssa_disk_21.APPENDIX B : LOGICAL VOLUMES CREATION #!/bin/ksh export primary_oravg=ora1vg export secondary_oravg=ora2vg # To be exectued on the primary node.dba /dev/*vsd* chmod go+rw /dev/*vsd* Installing Oracle9i RAC on IBM pSeries with AIX 4.3 page 34/ 53 .dba /dev/*vsd* chmod go+rw /dev/*vsd* # To be exectued on the secondary node. to recognize ora1vg on the secondary node varyoffvg $secondary_oravg redefinevg -d ssa_disk_11$primary_oravg varyonvg $secondary_oravg chown oracle. ssa_disk_12 and ora1vg # Creation of the volume group.3. to recognize ora2vg on the primary node varyoffvg $primary_oravg redefinevg -d ssa_disk_21 $secondary_oravg varyonvg $primary_oravg chown oracle. ssa_disk_22 and ora2vg # Creation of the volume group. which owns ssa_disk_11. with two disks mkvg -f -y $primary_oravg -s'16' ssa_disk_11 ssa_disk_12 # Creation of the logical volumes (raw devices) # The number is the size of the LV (number of 16MB physical mklv -y'systemlv' $primary_oravg 25 ssa_disk_11 mklv -y'undo1lv' $primary_oravg 32 ssa_disk_11 mklv -y'templv' $primary_oravg 7 ssa_disk_11 mklv -y'ctrl1lv' $primary_oravg 1 ssa_disk_11 mklv -y'redolog1_1lv' $primary_oravg 8 ssa_disk_11 mklv -y'redolog1_2lv' $primary_oravg 8 ssa_disk_11 mklv -y'userslv' $primary_oravg 8 ssa_disk_11 mklv -y'toolslv' $primary_oravg 1 ssa_disk_11 mklv -y'drsyslv' $primary_oravg 6 ssa_disk_11 partitions) # 400 MB # 512 MB # 112 MB # 16 MB # 128 MB # 128 MB # 128 MB # 16 MB # 96 MB # To be exectued on the secondary node.

APPENDIX C : VSD MANAGEMENT ON SP NODES.2 #!/bin/ksh #____________________________________________________________________ # Procedures #____________________________________________________________________ vsdnode_proc () { /usr/lpp/csd/bin/vsdnode $* } vsdvg_proc () { /usr/lpp/csd/bin/vsdvg $* } defvsd_proc () { /usr/lpp/csd/bin/defvsd $* } vsdconfig_proc () { /usr/lpp/csd/bin/allvsdl $* -c /usr/lpp/csd/bin/cfgvsd } vsdstart_proc () { args=$1 shift while [ $# -gt 1 ] do args="$args $1" shift done if [ "$1" = "Primary" ] then ServerFlag="-p" elif [ "$1" = "Backup" ] then ServerFlag="-b" else args="$args $1" ServerFlag="-p" fi /usr/lpp/csd/bin/allvsdl $args -c /usr/lpp/csd/bin/startvsd $ServerFlag } #____________________________________________________________________ # Main #____________________________________________________________________ export primary_node_name=node1 export secondary_node_name=node2 export primary_node_num=1 export secondary_node_num=2 export primary_oravg=ora1vg export secondary_oravg=ora2vg # VSD node database information vsdnode_proc "$primary_node_num $secondary_node_num" 'en0' '64' '256' '256' '48' '4096' '131072' '4' '61440' "RAC_${primary_node_num}_${secondary_node_num}" Installing Oracle9i RAC on IBM pSeries with AIX 4. USING PSSP 3.3.3 page 35/ 53 .

# VSD global Volume Group information vsdvg_proc -g vsd_$primary_oravg $primary_oravg $primary_node_name $secondary_node_name vsdvg_proc -g vsd_$secondary_oravg $secondary_oravg $secondary_node_name $primary_node_name # Define a virtual shared disk (logical volume) defvsd_proc systemlv vsd_$primary_oravg vsd_system defvsd_proc templv vsd_$primary_oravg vsd_temp defvsd_proc undolv vsd_$primary_oravg vsd_undo defvsd_proc log1lv vsd_$primary_oravg vsd_log1 defvsd_proc ctrl1lv vsd_$primary_oravg vsd_ctrl1 defvsd_proc userslv vsd_$primary_oravg vsd_users defvsd_proc toolslv vsd_$primary_oravg vsd_tools defvsd_proc defvsd_proc defvsd_proc defvsd_proc defvsd_proc defvsd_proc defvsd_proc log2lv vsd_$secondary_oravg vsd_log2 ctrl2lv vsd_$secondary_oravg vsd_ctrl2 oemrepolv vsd_$secondary_oravg vsd_oemrepo indexlv vsd_$secondary_oravg vsd_index examplelv vsd_$secondary_oravg vsd_example spfilelv vsd_$secondary_oravg vsd_spfile srvmconfiglv vsd_$secondary_oravg vsd_srvmconfig # Configure a VSD vsdconfig_proc -v vsdconfig_proc -v vsdconfig_proc -v vsdconfig_proc -v vsdconfig_proc -v vsdconfig_proc -v vsdconfig_proc -v vsdconfig_proc vsdconfig_proc vsdconfig_proc vsdconfig_proc vsdconfig_proc vsdconfig_proc vsdconfig_proc -v -v -v -v -v -v -v on 2 nodes 'vsd_system' 'vsd_temp' 'vsd_undo' 'vsd_log1' 'vsd_ctrl1' 'vsd_users' 'vsd_tools' -n -n -n -n -n -n -n $primary_node_num $primary_node_num $primary_node_num $primary_node_num $primary_node_num $primary_node_num $primary_node_num -n -n -n -n -n -n -n $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num $secondary_node_num 'vsd_log2' 'vsd_ctrl2' 'vsd_oemrepo' 'vsd_index' 'vsd_example' 'vsd_spfile' 'vsd_srvmconfig' $primary_node_num $primary_node_num $primary_node_num $primary_node_num $primary_node_num $primary_node_num $primary_node_num # Start a single VSD on the cluster #vsdstart_proc -v '<vsd_name>' -n $primary_node_num $secondary_node_num # Start all VSD on all nodes vsdstart_proc -v 'All_VSDs' -n $primary_node_num $secondary_node_num Installing Oracle9i RAC on IBM pSeries with AIX 4.3.3 page 36/ 53 .

Installing Oracle9i RAC on IBM pSeries with AIX 4. All the following outputs come from an HACMP configuration which was including a parallel instance database (HACMP concurrent mode) and a single instance database (HACMP rotating mode). NODE palavas: This node has 3 service interface(s): Service Interface palavas: IP address: 130. (Information about the concurrent mode configuration is in bold. inter_net. Service Interface gard_stby: IP address: 130.3 page 37/ 53 . Service Interface tty_gard: IP address: /dev/tty2 Hardware Address: Network: rs232_net Attribute: serial Aliased Address?: False Service Interface tty_gard has no boot interfaces.1.APPENDIX D : CLUSTER TOPOLOGY & NETWORK VERIFICATION OUTPUT. Service Interface palavas_stby has no standby interfaces.101 Hardware Address: Network: giga_net Attribute: public Aliased Address?: False Service Interface palavas has no boot interfaces.102 Hardware Address: Network: inter_net Attribute: private Aliased Address?: False Service Interface gard_stby has no boot interfaces.1. Service Interface palavas_stby: IP address: 130.1. Service Interface gard_stby has no standby interfaces. rs232_net There are 2 nodes in this cluster. Cluster Description of Cluster opscluster Cluster ID: 68 There were 3 networks defined : giga_net. Service Interface palavas has no standby interfaces.101 Hardware Address: Network: inter_net Attribute: private Aliased Address?: False Service Interface palavas_stby has no boot interfaces. Service Interface tty_gard has no standby interfaces.) Cluster description : output from a ‘cllscf’ command. Service Interface gard has no standby interfaces.1.1.1.102 Hardware Address: Network: giga_net Attribute: public Aliased Address?: False Service Interface gard has no boot interfaces. NODE gard: This node has 3 service interface(s): Service Interface gard: IP address: 130.2.3.2.

102 130.1.1. Service Interface tty_palavas has no standby interfaces.3 page 38/ 53 .2.1.1.Service Interface tty_palavas: IP address: /dev/tty3 Hardware Address: Network: rs232_net Attribute: serial Aliased Address?: False Service Interface tty_palavas has no boot interfaces. {palavas:root}/ ->cllsif Adapter Type Network Net Type Attribute Node IP Address Hardware Address Interface Name Global Name Netmask gard gard_stby tty_gard palavas palavas_stby tty_palavas service service service service service service giga_net inter_net rs232_net giga_net inter_net rs232_net ether ether rs232 ether ether rs232 public private serial public private serial gard gard gard palavas palavas palavas 130. Breakdown of network connections: Connections to network giga_net Node gard is connected to network giga_net by these interfaces: gard Node palavas is connected to network giga_net by these interfaces: palavas Connections to network inter_net Node gard is connected to network inter_net by these interfaces: gard_stby Node palavas is connected to network inter_net by these interfaces: palavas_stby Connections to network rs232_net Node gard is connected to network rs232_net by these interfaces: tty_gard Node palavas is connected to network rs232_net by these interfaces: tty_palavas Cluster network interfaces : output from a ‘cllsif’ command.2.3.1.101 130. Resource Group Name Node Relationship Participating Node Name(s) Dynamic Node Priority Service IP Label Filesystems Filesystems Consistency Check Filesystems Recovery Method Filesystems/Directories to be exported Filesystems to be NFS mounted Network For NFS Mount Volume Groups Concurrent Volume Groups Disks Connections Services ops_res concurrent palavas gard fsck sequential opsvg Installing Oracle9i RAC on IBM pSeries with AIX 4.101 /dev/tty3 Cluster resource group : output from a ‘clshowres’ command.102 /dev/tty2 130.1.

Fast Connect Services Shared Tape Resources Application Servers Highly Available Communication Links Miscellaneous Data Automatically Import Volume Groups Inactive Takeover Cascading Without Fallback 9333 Disk Fencing SSA Disk Fencing Filesystems mounted before IP configured Run Time Parameters: Node Name Debug Level Host uses NIS or Name Server Format for hacmp.3 page 39/ 53 .3.out false false false false false false palavas high false Standard gard high false Standard Installing Oracle9i RAC on IBM pSeries with AIX 4.out Node Name Debug Level Host uses NIS or Name Server Format for hacmp.

loc --... dbhome srvConfig./etc --.1./mnt /oracle --ex: /u ($ORACLE_BASE) /admin /<SID> / bdump cdump create pfile udump … /product /9. --.APPENDIX E : INSTALLATION DIRECTORIES.0./usr /local/bin oratab oraenv./etc --.3 page 40/ 53 ./ bin dbs rdbms sqlplus . /oraInventory /jre/1. coraenv.loc oraInst.1.3.8 /oui Installing Oracle9i RAC on IBM pSeries with AIX 4.

ORA.3 page 41/ 53 . All Rights Reserved. ** 6) The character and national character sets for the databse.10:10:37 rajayar Exp $ clustdb.Example database creation script DESCRIPTION Creates a RAC database on Unix NOTES ****************************************************************** ** UNIX clustdb.log set echo on connect / as sysdba startup nomount pfile="%ORACLE_BASE%/admin/clustdb/pfile/init.ora" CREATE DATABASE clustdb CONTROLFILE REUSE MAXLOGMEMBERS 5 MAXLOGHISTORY 100 MAXDATAFILES 254 MAXINSTANCES 32 MAXLOGFILES 64 DATAFILE '/dev/vx/rdsk/oracle_dg/clustdb_raw_system_400m' SIZE 325M REUSE AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED UNDO TABLESPACE "UNDOTBS1" DATAFILE '/dev/vx/rdsk/oracle_dg/clustdb_raw_undotbs1_290m' SIZE 200M REUSE AUTOEXTEND ON NEXT 5120K MAXSIZE UNLIMITED LOGFILE GROUP 1 ('/dev/vx/rdsk/oracle_dg/clustdb_raw_log11_120m') REUSE. Rem Rem Rem Rem Rem Rem Rem Rem Rem Rem Rem Rem Rem Rem Rem REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM $Header: clustdb.APPENDIX F : RAC DATABASE CREATION SCRIPT & INIT. ** 5) The name of the database in the "CREATE DATABASE " statement. see ** "CREATE DATABASE " statement. NAME clustdb.3. We have shortened this script in order to provide you only main excerpts. ** 4) The raw partition names(Symbolic link name) for log and data files ** Note: This script will add two additional log files for the second ** node. clustdb. to reflect your ORACLE_HOME. 2000.sql Copyright (c) Oracle Corporation 1999.ora file in startup nomount pfile= ** 2) The sysdba account and password if not using connect / as sysdba ** (Note: The connect / as sysdba statement occurs multiple ** times in the sql script below) ** 3) The location of the sql scripts.sql 08-may-2001. If your cluster will contain more nodes(instances) you ** must create and enable the additional logfiles for those node. ** 6) The size of tablespaces. ** ****************************************************************** spool createdb. if you would like to increase or ** decrease the default size.sql .SQL Version ** ** Please update this file to reflect the correct values for ** 1) The init. You can find the whole script in your $ORACLE_HOME/svrm/admin directory.sql This database creation script is provided with the Oracle 9i software. GROUP 2 ('/dev/vx/rdsk/oracle_dg/clustdb_raw_log12_120m') REUSE Installing Oracle9i RAC on IBM pSeries with AIX 4.

create rollback segment rbs2_2 storage(initial 200K next 200K) tablespace RBS. REM ********** UNDO TABLESPACE FOR SECOND INSTANCE ********** CREATE TABLESPACE UNDOTBS2 DATAFILE '/dev/vx/rdsk/oracle_dg/clustdb_raw_undotbs2_290m' SIZE 200M REUSE AUTOEXTEND ON NEXT 5120K MAXSIZE UNLIMITED EXTENT MANAGEMENT LOCAL. REM ********** TABLESPACE FOR TEMPORARY ********** CREATE TABLESPACE TEMP DATAFILE '/dev/vx/rdsk/oracle_dg/clustdb_raw_temp_100m' SIZE 40M REUSE AUTOEXTEND ON NEXT 640K MAXSIZE UNLIMITED TEMPORARY MANAGEMENT LOCAL..log set echo on REM *** WHEN USING UNDO_MANAGEMENT=MANUAL.sql Installing Oracle9i RAC on IBM pSeries with AIX 4. REM ********** TABLESPACE FOR Tools ********** CREATE TABLESPACE TOOLS DATAFILE '/dev/vx/rdsk/oracle_dg/clustdb_raw_temp_12m' SIZE 10M REUSE AUTOEXTEND ON NEXT 320K MAXSIZE UNLIMITED MANAGEMENT LOCAL.. alter rollback segment rbs2_2 online. connect / as sysdba create rollback segment rbs1_1 storage(initial 200K next 200K) tablespace RBS. spool off **** End Rollback segments for our 2 nodes *************** alter user sys temporary tablespace TEMP. @%ORACLE_HOME%/rdbms/admin/catexp7. REM ********** TABLESPACE FOR USER ********** CREATE TABLESPACE USERS DATAFILE '/dev/vx/rdsk/oracle_dg/clustdb_raw_users_120m' SIZE 25M REUSE AUTOEXTEND ON NEXT 1280K MAXSIZE UNLIMITED MANAGEMENT LOCAL. alter rollback segment rbs2_1 online. create rollback segment rbs1_2 storage(initial 200K next 200K) tablespace RBS.3. spool off spool createdb1. REM ********** TABLESPACE FOR INDEX ********** CREATE TABLESPACE INDX DATAFILE '/dev/vx/rdsk/oracle_dg/clustdb_raw_indx_70m' SIZE 25M REUSE AUTOEXTEND ON NEXT 1280K MAXSIZE UNLIMITED MANAGEMENT LOCAL.sql. alter rollback segment rbs1_2 online. REM **** Various SQL packages *************** @%ORACLE_HOME%/rdbms/admin/catalog.3 page 42/ 53 .CHARACTER SET US7ASCII NATIONAL CHARACTER SET AL16UTF16.log. create rollback segment rbs2_1 storage(initial 200K next 200K) tablespace RBS. REM CREATE TABLESPACE RBS DATAFILE '/dev/vx/rdsk/oracle_dg/clustdb_rbs1' REM SIZE 520M REUSE MINIMUM EXTENT 512K. DELETE THE UNDO TABLESPACE . REM LINE FROM THE CREATE DATABASE COMMAND AND UNCOMMENT THE FOLLOWING REM SQL STATEMENT FOR RBS TABLESPACE. alter rollback segment rbs1_1 online. REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM REM **** comment out rollback_segments for automatic undo management **** Rollback segments for our 2 nodes *************** spool psrbs.

sql REM **** End various SQL packages *************** REM ***** Scott's tables *************** connect / as sysdba @%ORACLE_HOME%/rdbms/admin/scott.sql @%ORACLE_HOME%/rdbms/admin/caths. alter database datafile '/dev/vx/rdsk/oracle_dg/clustdb_raw_undotbs1_290m' autoextend OFF. REM **** Enable the new logfile for thread 2 alter database enable public thread 2.log. REM alter database datafile '/dev/vx/rdsk/oracle_dg/clustdb_raw_rbs_580m' autoextend OFF.log. alter database datafile '/dev/vx/rdsk/oracle_dg/clustdb_raw_system_400m' autoextend OFF.sql REM ***** End Scott table *************** REM **** Demo support *************** connect / as sysdba @%ORACLE_HOME%/rdbms/admin/demo. connect / as sysdba @%ORACLE_HOME%/rdbms/admin/catclust.@%ORACLE_HOME%/rdbms/admin/catproc. Installing Oracle9i RAC on IBM pSeries with AIX 4. alter database datafile '/dev/vx/rdsk/oracle_dg/clustdb_raw_undotbs2_290m' autoextend OFF. alter database datafile '/dev/vx/rdsk/oracle_dg/clustdb_raw_temp_20m' autoextend OFF.sql spool off REM **** End Cluster Database SQL support *************** connect / as sysdba alter user system default tablespace TOOLS. spool off REM **** End Logfiles for the second instance *************** REM **** Cluster Database SQL support *************** spool catclust.3. connect / as sysdba alter database add logfile thread 2 group 3 '/dev/vx/rdsk/oracle_dg/clustdb_raw_log21_120m' reuse. uncomment next line and comment the 2 lines REM after that. group 4 '/dev/vx/rdsk/oracle_dg/clustdb_raw_log22_120m' reuse. alter user system temporary tablespace TEMP.sql connect / as sysdba spool off REM **** End Demo *************** REM **** Redo logfiles for the second instance *************** spool clustlog.sql connect system/manager @%ORACLE_HOME%/dbs/pupbld. REM **** Auto extend is turned off ******* REM For undo_management=MANUAL.3 page 43/ 53 .

# For parameters that require different values in different size # installations. # these must be specified differently for each instance. # # Some parameter settings are generic to any size installation. # # Use the following table to approximate the SGA size needed for the # three scenarious provided in this file: # # -------Installation/Database Size-----# SMALL MEDIUM LARGE # Block 2K 4500K 6800K 17000K # Size 4K 5500K 8800K 21000K # # To set up a database that multiple instances will be using. # # $Header: init. ############################################################################### # replace "clustdb" with your database name db_name = clustdb compatible=9.0 db_files = 1024 # INITIAL control_files = ("/dev/vx/rdsk/oracle_dg/clustdb_raw_1_controlfile_110m". init. 2001. Any parameter that needs to be tuned according to # installation size will have three settings.ora This init. alter database datafile '/dev/vx/rdsk/oracle_dg/clustdb_raw_indx_70m' autoextend OFF.3 page 44/ 53 . */ # ############################################################################## # Example INIT.17:38:43 rajayar Exp $ # # Copyright (c) 1991. if you choose to use private rollback segments.alter database datafile '/dev/vx/rdsk/oracle_dg/clustdb_raw_users_120m' autoextend OFF. but since all gc_* # parameters must be the same on all instances. Place all instance-specific parameters # at the end of the file using the <sid>. three scenarios have been provided: SMALL. exit.ora file is provided with the Oracle 9i software (in the same directory as clustdb. either by using the values provided here or by providing # your own. # This way. and example settings given. This is # necessary. # # INSTRUCTIONS: Edit this file and the other INIT files it calls for # your site.sql). Oracle Corporation.ORA file # # This file is provided by Oracle Corporation to help you customize # your RDBMS installation for your site.ora 04-may-2001. All rights reserved. each one commented # according to installation size. they should be in one file. use the # same file for all instance.<parameter_name> = <value> syntax. when you change a public # parameter. MEDIUM # and LARGE. it will automatically change on all instances.3. "/dev/vx/rdsk/oracle_dg/clustdb_raw_16_controlfile2_110m") db_file_multiblock_read_count = 8 # INITIAL Installing Oracle9i RAC on IBM pSeries with AIX 4. since all instances must run with the same value for many # parameters. Important system parameters # are discussed. For example.0.

log_archive_start = true log_archive_dest = %ORACLE_HOME%/admin/clustdb/arch log_archive_format = "%%ORACLE_SID%%T%TS%S.3 page 45/ 53 . If your site uses Internet Domain names for e-mail. Transaction processing # INITIAL # INITIAL # datewarehouse.rollback_segments = (name1. Datawarehouse #Datawarehouse. # global database name is db_name. # oracle_trace_enable = TRUE # define directories to store trace and alert files background_dump_dest=%ORACLE_HOME%/admin/clustdb/bdump user_dump_dest=%ORACLE_HOME%/admin/clustdb/udump Installing Oracle9i RAC on IBM pSeries with AIX 4. using the formula # of rollback segments = transactions / transactions_per_rollback_segment In this example each instance will grab 40/10 = 4: transactions = 40 transactions_per_rollback_segment = 10 # Global Naming -. every session will write to the named collection. This enables scheduling of server collections from the Oracle Enterprise Manager Console.enforce that a dblink has same name as the db it connects to global_names = TRUE # # # # # Edit and uncomment the following line to provide the suffix that will be appended to the db_name parameter (separated with a dot) and stored as the global database name when a database is created.acme. Also. then the part of your e-mail address after the '@' is a good candidate for this parameter value. place lines of the following # form at the end of this file: # <sid>. if the oracle_trace_collection_name parameter is non-null. define how many rollback segments each instance will pick up. Transaction processing #Datawarehouse. name2) # # # # # # If using public rollback segments.db_block_size=8192 # db_block_size=4096 open_cursors=300 #sort_area_size=524288 sort_area_size=1048576 large_pool_size=1048576 db_cache_size=50331648 java_pool_size=67108864 # db_block_buffers = 200 # Datawarehouse # Transaction processing #Transaction processing #Datawarehouse #Transaction processing.3.db_domain # db_domain = us.com # # # # # # Uncomment the following line if you wish to enable the Oracle Trace product to trace server activity.ARC" # If using private rollback segments. as well as enabling you to schedule future collections from the console. transaction processing #shared_pool_size = 52428800 shared_pool_size = 67108864 log_checkpoint_interval = 10000 processes = 150 # INITIAL parallel_max_servers = 5 log_buffer = 8192 # INITIAL # if you want auditing # if you want timed statistics # limit trace file size to 10 K each # audit_trail = true # timed_statistics = true max_dump_file_size = 10240 # # # # # Uncommenting the line below will cause automatic archiving if archiving has been enabled using ALTER DATABASE ARCHIVELOG.

rbs2_2) #datawarehouse Installing Oracle9i RAC on IBM pSeries with AIX 4.rollback_segments = (rbs2_1.instance_name=clustdb1 clustdb1.rollback_segments # when undo_management=MANUAL clustdb1.undo_tablespace and uncomment clustdb1.undo_tablespace = UNDOTBS2 # clustdb2.undo_tablespace = UNDOTBS1 # clustdb1.instance_number = 2 clustdb2.undo_tablespace and uncomment clustdb2.3.db_block_size = 4096 remote_login_passwordfile = exclusive # text_enable = TRUE # The following parameters are needed for the Advanced Replication Option job_queue_processes = 2 # job_queue_processes = 4 # job_queue_interval = 10 # job_queue_keep_connections = false distributed_transactions = 5 open_links = 4 # The following parameters are instance-specific parameters that are # specified for two instances named clustdb1 and clustdb2 user_dump_dest=%ORACLE_HOME%/admin/clustdb/udump undo_management=AUTO # For automatic undo management # = MANUAL For manual/RBS undo management cluster_database= true cluster_database_instances=2 remote_listener=LISTENERS_CLUSTDB # First instance specific parameters clustdb1.rollback_segments = (rbs1_1.thread=2 clustdb2.rollback_segments # when undo_management=MANUAL clustdb2.local_listener=listener_clustdb1 # Comment out clustdb1.thread=1 clustdb1.instance_name = clustdb2 clustdb2.3 page 46/ 53 .rbs1_2) # Second instance specific parameters clustdb2.local_listener = listener_clustdb2 # Comment out clustdb2.instance_number=1 clustdb1.

2 172.com rac2.1 10.equiv is not sufficient for root) /etc/hosts.10.ibm.10.3 page 47/ 53 .194.3.APPENDIX G : SOME CONFIGURATION FILES… (EXAMPLES) This appendix provides examples of the configuration files that are mentioned in the document. Hosts file /etc/hosts 10.10.1 172.10.loc srvconfig_loc=/dev/rvsd_srvconfig Raw devices parameter file for the Database Configuration Assistant $HOME/dbca_raw_config system=/dev/rvsd_system temp=/dev/rvsd_temp undo1=/dev/rvsd_undo1 redo1_1=/dev/rvsd_redolog1_1 redo1_2=/dev/rvsd_redolog1_2 control1=/dev/rvsd_ctrl1 users=/dev/rvsd_users tools=/dev/rvsd_tools drsys=/dev/rvsd_drsys undo2=/dev/rvsd_undo2 redo2_1=/dev/rvsd_redolog2_1 redo2_2=/dev/rvsd_redolog2_2 control2=/dev/rvsd_ctrl2 oemrepo=/dev/rvsd_oemrepo index=/dev/rvsd_index example=/dev/rvsd_example spfile=/dev/rvsd_spfile srvconfig=/dev/rvsd_srvconfig cmwlite=/dev/rvsd_cmwlite Installing Oracle9i RAC on IBM pSeries with AIX 4.com rac1 rac2 User equivalence (both files are identical.2 int-rac1 int-rac2 rac1.194.128. hosts.mop.128.ibm.equiv rac1 rac2 int-rac1 int-rac2 Path to the server configuration raw device /etc/srvConfig.mop.

1/network/admin/tnsnames.1/network/admin/listener.0.3.ora # Generated by Oracle configuration tools. LISTENER = (DESCRIPTION_LIST = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = RAC1)(PORT = 1521)) ) ) ) SID_LIST_LISTENER = (SID_LIST = (SID_DESC = (SID_NAME = PLSExtProc) (ORACLE_HOME = /oracle/prod/9.1) (PROGRAM = extproc) ) (SID_DESC = (ORACLE_HOME = /oracle/product/9.ORA Network Configuration File: /oracle/product/9.1) (SID_NAME = RAC1) ) ) Example tnsnames.ora implementing TAF tnsnames.0.ora # TNSNAMES.0.Example listener.ora # LISTENER.0.ORA Network Configuration File: /oracle/product/9. LISTENERS_TEST = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = RAC1)(PORT = 1521)) (ADDRESS = (PROTOCOL = TCP)(HOST = RAC2)(PORT = 1521)) ) ) RAC2 = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = rac2)(PORT = 1521)) ) (CONNECT_DATA = (SERVICE_NAME = RAC) (INSTANCE_NAME = RAC2) ) ) RAC1 = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = RAC1)(PORT = 1521)) ) (CONNECT_DATA = (SERVICE_NAME = RAC) (INSTANCE_NAME = RAC1) ) ) RAC = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = rac1)(PORT = 1521)) (ADDRESS = (PROTOCOL = TCP)(HOST = rac2)(PORT = 1521)) ) (CONNECT_DATA = Installing Oracle9i RAC on IBM pSeries with AIX 4.ora # Generated by Oracle configuration tools.ora listener.3 page 48/ 53 .

(SERVICE_NAME = RAC) (FAILOVER_MODE = (TYPE = SELECT) (METHOD = PRECONNECT) (RETRIES = 20) (DELAY = 60) ) ) ) INST1_HTTP = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = RAC1)(PORT = 1521)) ) (CONNECT_DATA = (SERVER = SHARED) (SERVICE_NAME = MODOSE) (PRESENTATION = http://HRService) ) ) Example listener.ora implementing TAF sqlnet.3 page 49/ 53 .int-rac2" RAC.txt RAC:/oracle/product/9.inst_oracle_sid = (RAC1.DIRECTORY_PATH= (TNSNAMES) Server configuration file exported by srvconfig srvconfig.1:N RAC.0.RAC2) Installing Oracle9i RAC on IBM pSeries with AIX 4.3.ora NAMES.spfile = /dev/rvsd_3 RAC.node_list = "int-rac1.

Note #2064876.102 : How to setup High Availability Group Services (HAGS) on IBM AIX/RS6000. Article-ID: Circulation: Folder: Topic: Title: Document-Type: Impact: Skill-Level: Server-Version: Updated-Date: References: Shared-Refs: Authors: Attachments: Content-Type: Keywords: Products: Platforms: Purpose ======= This article gives quick reference instructions on how to configure High Availability Group Services (HAGS) on IBM AIX RS6000 for Oracle 8. These notes can be found in Metalink. Installing Oracle9i RAC on IBM pSeries with AIX 4..Parallelserver . Do the following on all nodes that form the cluster: 1.3).XX 04-FEB-2002 08:21:25 BLEVE.OPS. 319 (4.XX).APPENDIX H : ORACLE TECHNICAL NOTES This appendix provides some useful notes coming from Oracle support..01. SERVER.US NONE TEXT/PLAIN LMON.XX. How to Configure High Availability Group Services (HAGS) ======================================================== In order to configure High Availability Group Services (HAGS).XX.XX.01. OPS. SUBCOMP-OPS.X. Scope and Application ===================== These instructions are helpful to any customer using Oracle on IBM AIX/RS6000 on which HACMP is installed.102> PUBLISHED (EXTERNAL) server.3.IBM RS6000 and SP How to setup High Availability Group Services (HAGS) on IBM AIX/RS6000 BULLETIN LOW CASUAL 08.1. PARALLEL. 236/RDBMS (08.XX. you need to be connected as root. Create the "hagsuser" group and place "oracle" into the "hagsuser" group: Verify the group does not exists: # grep hagsuser /etc/group If this returns nothing do the following: # smitty groups Select "Add a Group" and fill in the following: <Note:2064876.3 page 50/ 53 .

Search Words ============ OPS HAGS RS6000 Installing Oracle9i RAC on IBM pSeries with AIX 4. Also note that after the group is created you will have to log out and log back in as "oracle" to be sure "oracle" is part of the "hagsuser" group.1. References ========== Oracle Installation Guide for AIX RS6000.`/usr/sbin/cluster/utilities/ cldomain` 4.<domain>" socket: # chmod g+w /var/ha/soc/grpsvcsdsocket. release 8.5.<domain>" file the instance will be able to communicate with HAGS and the instance will mount. By configuring the group and permissions for the "grpsvcsdsocket. Change the permissions on the "cldomain" executable: # chmod a+x /usr/sbin/cluster/utilities/cldomain 3. Change the group permissions for the "grpsvcsdsocket.Group Name USER list ----> hagsuser ----> oracle You can take the defaults for the other settings.<domain>" socket: # chgrp hagsuser /var/ha/soc/grpsvcsdsocket.3.3 page 51/ 53 .`/usr/sbin/cluster/utilities/ cldomain` The HAGS socket needs to be writeable by "oracle" and the "cldomain" executable needs to be executable by "oracle". 2. Change the group to "hagsuser" for the "svcsdsocket.

[KCCSBCK_FIRST]. It has to be identical for both adapters.18. OPS. Check HACMP interconnect network adapter configuration with /usr/sbin/cluster/utilities/cllsif Adapter Address pfpdb3 11. Trying to start a second OPS instance on another cluster node fails with ORA-600 [KCCSBCK_FIRST].3.1> PENDING_DELETE (EXTERNAL) server.Parallelserver . ************************************************************* PURPOSE ------This article helps to resolve problems with Oracle Parallel Server startup related to HACMP configuration SCOPE & APPLICATION ------------------How to setup HACMP cluster interconnect adapter ----------------------------Oracle Parallel Server software is successfully installed. 319.. 5/RDBMS. ************************************************************* This article is being delivered in Draft form and may contain errors. /usr/sbin/cluster/diag/clverify doesn't show any errors.0X to 08. $ORACLE_HOME/bin/lsnodes will list all cluster nodes.IBM RS6000 and SP AIX: ORA-600 [KCCSBCK_FIRST] starting up second OPS Instance BULLETIN LOW NOVICE 08. cllsif on a working configuration should look like this: Installing Oracle9i RAC on IBM pSeries with AIX 4.DE NONE TEXT/PLAIN HACMP. The first OPS instance starts without errors. Article-ID: Circulation: Folder: Topic: Title: Document-Type: Impact: Skill-Level: Server-Version: Updated-Date: References: Shared-Refs: Authors: Attachments: Content-Type: Keywords: Errors: Products: Platforms: <Note:115792.Note # 115792.0X 05-FEB-2002 13:10:49 RKIRCHHE.18. ORA-600.1 .24 pfpdb4 11.06.01.2. Please use the MetaLink "Feedback" button to advise Oracle of any issues related to this article.2.01.. explaining how to setup HACMP cluster interconnect adapter.3 Type service service Network pfpdb3 pfpdb4 Net Type ether ether Attribute private private Node pfpdb3 pfpdb4 IP The network parameter doesn't match.3 page 52/ 53 .OPS.06.

3.> Installing Oracle9i RAC on IBM pSeries with AIX 4.2.Adapter Address pfpdb3 11. articles and other documents.24 pfpdb4 11.18.3 page 53/ 53 .18.3 RELATED DOCUMENTS ----------------- Type service service Network pfpdb pfpdb Net Type ether ether Attribute private private Node pfpdb3 pfpdb4 IP <List related manuals.2.