Professional Documents
Culture Documents
RACGuides Rac10gR2OnWindows
RACGuides Rac10gR2OnWindows
Rac10gR2OnWindows ........................................................................................................................................1 1. *Introduction.......................................................................................................................................1 1.0.1. Software required for install............................................................................................1 1.0.2. Processor Model.................................................................................................1 1.1. *Installation steps ..........................................................................................................................................2 1.2. *Schematic....................................................................................................................................................2 1.2.1. Hardware/software configuration BEFORE Oracle software install............................................2 1.2.2. Hardware/software configuration AFTER Oracle software install..............................................3 1.3. *Installation Method.....................................................................................................................................3 2. Prepare the cluster nodes for Oracle RAC.......................................................................................................4 2.1. User Accounts..................................................................................................................................4 2.2. Installing Using Windows Remote Desktop Client.........................................................................6 2.3. Environment Variables....................................................................................................................6 2.4. Networking......................................................................................................................................7 2.4.1. Network Ping Tests ..........................................................................................................8 2.4.2. Network Adapter configuration.......................................................................................8 2.4.3. Network Adapter naming and binding order...................................................................8 2.4.4. Net Use Test ...................................................................................................................11 2.4.5. Disable DHCP Media Sense..........................................................................................11 2.5. Remote Registry Connect...........................................................................................................................13 2.6. Stopping Services ........................................................................................................................................17 2.7. Time Sync...................................................................................................................................................18 2.8. Stage the Oracle Software...........................................................................................................................18 2.9. CVU stage check .........................................................................................................................................19 3. Prepare the shared storage for Oracle RAC...................................................................................................20 3.1. Shared Disk Layout ........................................................................................................................20 3.2. Enable Automount.........................................................................................................................21 3.3. Clean the Shared Disks - Optional Step .........................................................................................22 3.4. Create Logical partitions inside Extended partitions.....................................................................23 3.4.1. View Created partitions.................................................................................................25 3.5. List Drive Letters........................................................................................................................................25 3.5.1. Remove Drive Letters.................................................................................................................26 3.5.2. List volumes on Second node.....................................................................................................27 3.6. View Disks using diskmgmt.msc ................................................................................................................28 4. Oracle Clusterware Installation and Configuration.......................................................................................28 4.1. CVU Pre Oracle Clusterware install check ....................................................................................29 4.2. Oracle Clusterware Install ..............................................................................................................30 4.2.1. Run the VIP Configuration Assistant manually to configure the VIPs.........................57 4.2.2. Oracle Clusterware has been installed and configured correctly ...................................64 5. Oracle Clusterware patching..........................................................................................................................64 5.1. Apply the latest major patchset......................................................................................................65 5.1.1. Install the patch software...............................................................................................65 5.1.2. Stop the Clusterware software on the first node............................................................71 5.1.3. Stop any other Clusterware processes...........................................................................72 5.1.4. run the patch102.bat file................................................................................................74 5.1.5. repeat on the other nodes in the cluster ..........................................................................75 5.1.6. Application of the Oracle Clusterware major patchset is complete ...............................75 5.2. Mini Patch...................................................................................................................................................75 6. Oracle ASM Home Software Install..............................................................................................................75 6.1. CVU check.....................................................................................................................................76 6.2. Oracle ASM Home Software Install..............................................................................................76 6.2.1. Oracle ASM software home has been installed.............................................................85 7. Oracle ASM Software Home Patching..........................................................................................................85 7.1. Apply the latest Major patchset.....................................................................................................86 7.2. Apply the latest Mini patch............................................................................................................94 i
Table of Contents
Rac10gR2OnWindows 7.3. The ASM home is patched successfully........................................................................................94 8. Oracle RAC Database Listener Creation.......................................................................................................94 8.1. Create Node specific network listeners ..........................................................................................94 8.2. Completed Node specific network listeners creation ...................................................................104 9. Oracle ASM Instance and diskgroup Creation............................................................................................104 9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups........................................104 9.2. Completed creation of ASM Instance and add of the +DATA and +FLASH diskgroups..........129 10. Oracle RAC Database Home Software Install...........................................................................................129 10.1. CVU check.................................................................................................................................129 10.2. Oracle RAC Database Home Software Install...........................................................................129 10.2.1. Oracle RAC Database software home has been installed..........................................140 11. Oracle RAC Software Home Patching......................................................................................................140 11.1. Apply the latest Major patchset.................................................................................................141 11.2. Apply the latest Mini patch........................................................................................................149 11.3. The RAC Database home is patched successfully.....................................................................149 12. Oracle RAC Database Creation.................................................................................................................149 12.1. use DBCA to create the RAC database ......................................................................................149 12.2. RAC database creation is complete...........................................................................................170
ii
Rac10gR2OnWindows
1. *Introduction
1.0.1. Software required for install
Microsoft Windows 2003 For Microsoft Windows 2003 Service Pack 2 is strongly recommended, do not run with SP1 Base Oracle 10gR2 DVD The latest patchset (currently 10.2.0.4 available as patch 6810189 for x64) The latest mini patch (currently PATCH 34 available as patch 9393550 for x64) - These patches are cumulative - The latest mini patch will have all previous mini patch components with it. Use My Oracle Support ExtNote:373040.1 : 'How To Identify and Locate the Latest Windows MiniPatch For Your Patchset Version'. The latest Oracle Cluster verify Utility (CVU) from here : http://www.oracle.com/technology/products/database/clustering/cvu/cvu_download_homepage.html Microsoft Windows 2008 For Microsoft Windows 2008 Service Pack 2 is strongly recommended, do not run with SP1 Oracle Database 10g Release 2 (10.2.0.4.0) Enterprise/Standard Edition for Microsoft Windows Vista x64 and Microsoft Windows Server 2008 x64 The latest mini patch (currently PATCH 34 available as patch 9393550 for x64) - These patches are cumulative - The latest mini patch will have all previous mini patch components with it. Use My Oracle Support ExtNote:373040.1 : 'How To Identify and Locate the Latest Windows MiniPatch For Your Patchset Version'. The latest Oracle Cluster verify Utility (CVU) from here : http://www.oracle.com/technology/products/database/clustering/cvu/cvu_download_homepage.html Do not mix Microsoft Operating Systems between nodes in a cluster. e.g Windows 2003 X64 on one node and Windows 2003 64bit Itanium IA64 on another
Windows 2008 64bit X64 - you must install the 64bit X64 versions of the Oracle software.
1.2. *Schematic
The following is a schematic of the software & hardware layout of a 2-node RAC cluster. As explained in this document the actual number of LUNs required will vary depending on your mirroring requirements.
Notice that there are a number of LUNs presented to both machines from the shared storage. 5 of 270MB LUNs 2 are used for the OCR devices 3 are used for the vote devices 9 of 1GB LUNs 6 are used for the +DATA ASM diskgroup 3 are used for the +FLASH ASM diskgroup Also notice there is a dedicated switch on the cluster interconnect.
This installation routine presumes that you have a 2-node Windows cluster. There are a number of items that require checking before the install commences. Getting this bit right will enhance your install experience. 1. User Accounts 2. Installing using Remote desktop client 3. Environment Variables 4. Networking 5. Remote Registry Connect 6. Stopping Services that might impact the installation process 7. Time sync 8. Stage the Oracle Software 9. Run CVU It is essential that these items are checked and are configured correctly before the install commences.
For Microsoft Windows 2008, you will need to change the elevation prompt behavior for administrators to "Elevate without prompting" to allow for user equivalence to function properly: 1. Open a command prompt and type secpol.msc to launch the Security Policy Console management utility. 2. From the Local Security Settings console tree, click Local Policies, and then Security Options 3. Scroll down to and double-click User Account Control: Behavior of the elevation prompt for administrators. 4. From the drop-down menu, select: Elevate without prompting (tasks requesting elevation will automatically run as elevated without prompting the administrator) 5. Click OK to confirm the changes. 6. Repeat steps 1-5 on ALL cluster nodes. You also must ensure that the Administrators group is listed under Manage auditing and security log: 1. Open a command prompt and type secpol.msc to launch the Security Policy Console management utility. 2. Click on Local Policies 3. Click on User Rights Assignment 4. Locate and double click the Manage auditing and security log in the listing of User Rights Assignments. 5. If the Administrators group is NOT listed in the Local Security Settings tab, add the group now. 6. Click OK to save the changes (if changes were made). 7. Repeat steps 1-6 on ALL cluster nodes.
2.4. Networking
You will need a minimum of 2 network adapters per machine, 1 adapter is the public interface. The other adapter, the private interface, is used for Oracle RAC node membership and inter-instance traffic. The private interface adapters should be connected to each other via a network switch which is used exclusively for the interconnect traffic. In 2 node environments do not be tempted to use a 'Crossover Cable' as these are not supported. Recommended best practice is to use more than 2 adapters. This is known as network teaming and is configured before installation of the Oracle software. In basic outline, you take 2 of the adapters on the private interface and team them together to create what looks like a single, highly available adapter for the interconnect traffic. You can then take the remaining 3rd adapter and use it for the public interface. You can also team the public adapters as well. In that case you would need to start with 4 adapters, 2 public & 2 private. Ensure you team the adapters before starting installation. Please be aware that even with a 2-node cluster you must use a dedicated network switch on the interconnect. You will need a total of 3 IP addresses per node: The public IP address, which should be recorded in hosts file on each node and, if available, DNS. This IP Address should be bound to the public adapter before starting the install. It should be a static, not DHCP, address The private IP address, which should be from a different subnet than the public IP address. This address does not require registering in DNS but you should place an entry in the hosts file on each node. This IP Address should be bound to the private adapter before starting the install. It should be a static, not DHCP, address A VIP address, which should be from the same subnet as the public IP address and should be recorded in DNS and the hosts file on each node. This IP Address should NOT be bound to the public adapter before starting the install. Oracle Clusterware is responsible for binding this address. It should be a static, not DHCP, address If you do not have a DNS server then make sure both the public and the VIP addresses are entered into all the relevant hosts files that are normally found in the %SystemRoot%\system32\drivers\etc\hosts file. Show Networking setup information Hide Networking setup information You should use ipconfig on each node to confirm the correct IP addresses are bound to the correct adapters C:\Documents and Settings\Administrator>ipconfig Windows IP Configuration Ethernet adapter PublicLAN: Connection-specific DNS Suffix IP Address. . . . . . . . . . . Subnet Mask . . . . . . . . . . Default Gateway . . . . . . . . Ethernet adapter PrivateLAN: Connection-specific DNS Suffix IP Address. . . . . . . . . . . Subnet Mask . . . . . . . . . . Default Gateway . . . . . . . . A sample hosts file
127.0.0.1 10.10.10.11 10.10.10.21 10.10.10.51 localhost winnode1 winnode2 winnode1-vip
. . . .
: : 10.10.10.11 : 255.255.255.0 :
. . . .
: : 192.168.10.11 : 255.255.255.0 :
2.4. Networking
As an example, rename the public adapter to PublicLAN and the private adapter to PrivateLAN. It is important that you use the same names on all nodes. If there are other adapters take the opportunity to rename them as well taking care to avoid overly long adapter names and use of any special characters (spaces, periods, dashes etc) in the adapter names.
You must confirm the network adapter binding order on all the nodes in the cluster. Select the menu item 'Advanced->Advanced settings...'
10
On the Adapters and Bindings TAB you must ensure that the public adapter is listed first and the private adapter is listed second. If they are not in this order: select the public adapter and use the up arrow button to the right of the Connections list box to move the public adapter to the top of the list. It is very important to confirm this on all nodes in the cluster
11
Navigate to the Key HKLM\SYSTEM\CurrentControlSet\Services\Tcpip\Parameters and right click to create a new key of type DWORD.
12
make sure that the Key is called DisableDHCPMediaSense, is of type DWORD and has a value of 1.
13
In the 'Enter the object name...' edit box enter the name of the other node in the cluster (e.g. winnode2) and click OK
14
Wait for the node to appear in the registry tree. If this works then remote registry connect is working and you can continue.
15
If this fails then you probably have a policy set to disallow this. You need to change this policy. When done you can right click on the node in the regedit tree and select disconnect.
16
17
Stop the service and set the Startup type to Manual, repeat on all nodes in the cluster. If, after completing the install, the MS DTC service is required it can be restarted and set to auto start.
Connected? ---------------yes
Result: Node connectivity check passed for subnet "10.10.10.0" with node(s) winnode2,winnode1. Check: Node connectivity of subnet "192.168.10.0" Source Destination ------------------------------ -----------------------------winnode2:PrivateLAN winnode1:PrivateLAN
Connected? ---------------yes
Result: Node connectivity check passed for subnet "192.168.10.0" with node(s) winnode2,winnode1. WARNING: Could not find a suitable set of interfaces for VIPs. WARNING: Could not find a suitable set of interfaces for the private interconnect. Result: Node connectivity check passed.
19
Checking shared storage accessibility... Shared storage check failed on nodes "winnode2,winnode1". Post-check for hardware and operating system setup was unsuccessful on all the nodes.
Notice the Shared Storage check failed: This is because this test cluster is using iSCSI and CVU cannot check the shared-ness of iSCSI disks. Also it could not automatically determine the distinct public and private network adapters. Show all Hide all
20
The first disk (Disk 0) is the local C: drive used for the software install. The Storage Administrator has provisioned 14 LUNs from the shared disk array (Disk1 Disk14) Disk1 Disk5 are used for Oracle Clusterware Disk6 Disk11 are used by ASM for the +DATA diskgroup Disk12 Disk14 are used by ASM for the +FLASH diskgroup In this document we will use the diskpart command line tool to manage these LUNs. You must create logical drives inside of extended partitions for the disks to be used by Oracle Clusterware and Oracle ASM. There must be no drive letters assigned to any of the Disks1 Disk14 on any node. For MIcrosoft Windows 2003 it is possible to use diskmgmt.msc instead of diskpart (as used in the following sections) to create these partitions. For Microsoft Windows 2008, diskmgmt.msc cannot be used instead of diskpart to create these partitions.
21
DISKPART> clean all DISKPART> select disk 8 Disk 8 is now the selected disk. DISKPART> clean all DISKPART> select disk 9 Disk 9 is now the selected disk. DISKPART> clean all DISKPART> select disk 10 Disk 10 is now the selected disk. DISKPART> clean all DISKPART> select disk 11 Disk 11 is now the selected disk. DISKPART> clean all DISKPART> select disk 12 Disk 12 is now the selected disk. DISKPART> clean all DISKPART> select disk 13 Disk 13 is now the selected disk. DISKPART> clean all DISKPART> select disk 14 Disk 14 is now the selected disk. DISKPART> clean all
DISKPART> create part DiskPart succeeded in DISKPART> create part DiskPart succeeded in
ext creating the specified partition. log creating the specified partition..
DISKPART> select disk 4 Disk 4 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 5 Disk 5 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 6 Disk 6 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 7 Disk 7 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 8 Disk 8 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 9 Disk 9 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 10 Disk 10 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 11 3.4. Create Logical partitions inside Extended partitions 24
Disk 11 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 12 Disk 12 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 13 Disk 13 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition. DISKPART> select disk 14 Disk 14 is now the selected disk. DISKPART> create part ext DiskPart succeeded in creating the specified partition. DISKPART> create part log DiskPart succeeded in creating the specified partition.
25
list volume
Ltr --H J O M D L K C E N G F I P Q R Label ----------Fs ----RAW RAW RAW RAW RAW RAW NTFS RAW RAW RAW RAW RAW RAW RAW RAW Type ---------Partition Partition Partition Partition DVD-ROM Partition Partition Partition Partition Partition Partition Partition Partition Partition Partition Partition Size ------290 MB 1271 MB 1271 MB 1271 MB 0 B 1271 MB 1271 MB 8182 MB 290 MB 1271 MB 290 MB 290 MB 290 MB 1271 MB 1271 MB 1271 MB Status --------Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Info --------
Volume ### ---------Volume 0 Volume 1 Volume 2 Volume 3 Volume 4 Volume 5 Volume 6 Volume 7 Volume 8 Volume 9 Volume 10 Volume 11 Volume 12 Volume 13 Volume 14 Volume 15
System
Notice that the volumes are listed in a completely different order compared to the disk list.
DISKPART> select volume 8 Volume 8 is the selected volume. DISKPART> remov DiskPart successfully removed the drive letter or mount point. DISKPART> select volume 9 Volume 9 is the selected volume. DISKPART> remov DiskPart successfully removed the drive letter or mount point. DISKPART> select volume 10 Volume 10 is the selected volume. DISKPART> remov DiskPart successfully removed the drive letter or mount point. DISKPART> select volume 11 Volume 11 is the selected volume. DISKPART> remov DiskPart successfully removed the drive letter or mount point. DISKPART> select volume 12 Volume 12 is the selected volume. DISKPART> remov DiskPart successfully removed the drive letter or mount point. DISKPART> select volume 13 Volume 13 is the selected volume. DISKPART> remov DiskPart successfully removed the drive letter or mount point. DISKPART> select volume 14 Volume 14 is the selected volume. DISKPART> remov DiskPart successfully removed the drive letter or mount point. DISKPART> select volume 15 Volume 15 is the selected volume. DISKPART> remov DiskPart successfully removed the drive letter or mount point.
list vol
Ltr --Label ----------Fs ----RAW RAW RAW RAW RAW RAW NTFS RAW RAW RAW Type ---------Partition Partition Partition Partition DVD-ROM Partition Partition Partition Partition Partition Partition Size ------290 MB 1271 MB 1271 MB 1271 MB 0 B 1271 MB 1271 MB 8182 MB 290 MB 1271 MB 290 MB Status --------Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Healthy Info --------
Volume ### ---------Volume 0 Volume 1 Volume 2 Volume 3 Volume 4 Volume 5 Volume 6 Volume 7 Volume 8 Volume 9 Volume 10
System
27
11 12 13 14 15
MB MB MB MB MB
The disks should look like the above on all nodes in the cluster.
Next we will install the Oracle Clusterware layer. Oracle Clusterware is an essential component of the Oracle RAC database infrastructure. Oracle Clusterware does not require any other clustering software. There is no need to install Microsoft Cluster Services (MSCS) software. To install you will need the following information: The local drive that will host the Oracle Clusterware software The shared devices that will be used by Oracle Clusterware The public node names and IP addresses for the nodes to be used by the cluster The private node names and IP addresses for the nodes to be used by the cluster 3.5.2. List volumes on Second node 28
The Virtual Public IP names and IP addresses for the nodes to be used by the cluster
1 file(s) copied. C:\WINDOWS\temp\cvtmphome\oui\lib\win32\msvcp71.dll C:\WINDOWS\temp\cvtmphome\oui\lib\win32\msvcr71.dll 2 file(s) copied. Performing pre-checks for cluster services setup Checking node reachability... Check: Node reachability from node "winnode1" Destination Node Reachable? ------------------------------------ -----------------------winnode1 yes winnode2 yes Result: Node reachability check passed from node "winnode1".
Checking user equivalence... Check: User equivalence for user "Administrator" Node Name Comment ------------------------------------ -----------------------winnode2 passed winnode1 passed Result: User equivalence check passed for user "Administrator". Checking administrative privileges... Administrative privileges check passed. Checking node connectivity...
Interface information for node "winnode2" Interface Name IP Address Subnet ---------------- ------------ -----------PublicLAN 10.10.10.21 10.10.10.0 PrivateLAN 192.168.10.21 192.168.10.0 Interface information for node "winnode1" Interface Name IP Address Subnet ---------------- ------------ -----------PublicLAN 10.10.10.11 10.10.10.0 PrivateLAN 192.168.10.11 192.168.10.0
Subnet Gateway Default Gateway Hardware Address ------------ ------------ -----------10.10.10.21 192.168.1.254 00:0C:29:E3:82:6C 192.168.10.21 192.168.1.254 00:0C:29:E3:82:76
Subnet Gateway Default Gateway Hardware Address ------------ ------------ -----------10.10.10.11 192.168.1.254 00:0C:29:E3:81:6C 192.168.10.11 192.168.1.254 00:0C:29:E3:81:76
Check: Node connectivity of subnet "10.10.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------winnode2:PublicLAN winnode2:PublicLAN yes winnode2:PublicLAN winnode1:PublicLAN yes winnode2:PublicLAN winnode1:PublicLAN yes winnode2:PublicLAN winnode1:PublicLAN yes winnode2:PublicLAN winnode1:PublicLAN yes winnode1:PublicLAN winnode1:PublicLAN yes Result: Node connectivity check passed for subnet "10.10.10.0" with node(s) winnode2,winnode1. Check: Node connectivity of subnet "192.168.10.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------winnode2:PrivateLAN winnode1:PrivateLAN yes Result: Node connectivity check passed for subnet "192.168.10.0" with node(s) winnode2,winnode1.
29
WARNING: Could not find a suitable set of interfaces for VIPs. WARNING: Could not find a suitable set of interfaces for the private interconnect. Result: Node connectivity check passed.
Checking system requirements for 'crs'... Check: Operating system version Node Name Available Required ------------ ------------------------ -----------------------winnode2 Windows Server 2003 Windows Server 2003 winnode1 Windows Server 2003 Windows Server 2003 Result: Operating system version check passed. Check: Total memory Node Name Available ------------ -----------------------winnode2 1.63GB (1707464KB) winnode1 1.63GB (1707464KB) Result: Total memory check passed. Check: Swap space Node Name Available ------------ -----------------------winnode2 2.99GB (3131544KB) winnode1 2.99GB (3131544KB) Result: Swap space check passed. Check: System architecture Node Name Available ------------ -----------------------winnode2 32-bit winnode1 32-bit Result: System architecture check passed.
Check: Free disk space in "C:\WINDOWS\TEMP" dir Node Name Available Required ------------ ------------------------ -----------------------winnode2 4.91GB (5150352KB) 400MB (409600KB) winnode1 4.7GB (4924284KB) 400MB (409600KB) Result: Free disk space check passed. System requirement passed for 'crs' Pre-check for cluster services setup was successful.
30
31
Notes The OUI will name the Oracle Clusterware Home 'OraCr10g_home'. If you change this you should make sure that the name you use is unique By default the Oracle installer will select the local drive with the most free space and will use the path :\oracle\product\10.2.0\crs. If you change the drive you should make sure that there is enough free space on the selected drive on all the nodes for the home (which is currently some 600MB). As clusterware runs it will also create various log files inside the Clusterware Home. Actions If the defaults are not acceptable modify them Click Next
32
Notes The installer will validate the state of the cluster before continuing. If there are issues you should rectify them before continuing. Actions Click Next
33
Notes Each Cluster requires a name, this should be unique within your organization, The default is 'crs' you should change this to be unique within your organization This is where you specify details of all the nodes in the cluster. The installer will default names for the node it is running on. You must add other nodes manually. Oracle defaults the names to 'nodename', 'nodename-priv', 'nodename-vip' be sure to modify these names if needed using the 'Edit...' button Actions Enter a unique cluster name Confirm the Details for the current node are OK. The defaults are: Public Node Name : must resolve via hosts and or DNS to the public IP address and must be live Private Node Name : must resolve via hosts to the interconnect IP address and must be live Virtual Host Name : must resolve via hosts and or DNS to a new IP address and must not be live If these are not correct select the node entry and click Edit... to modify OR Click Add... to add more nodes to the cluster
34
Notes Here you specify the details of the node you wish to add to the cluster nodes list Actions Enter the new node details Public Node Name : must resolve via hosts and or DNS to the public IP address and must be live Private Node Name : must resolve via hosts to the interconnect IP address and must be live Virtual Host Name : must resolve via hosts and or DNS to a new IP address and must not be live Click OK to return to the node list for the cluster
35
Notes If you have more nodes repeat the Add... cycle Actions Click Next
36
Notes The installer lists all the Network adapters. You should have one Adapter correctly identified as type 'Public' and at least one adapter correctly identified as type 'Private'. The installer will try and guess the use of an adapter based on the IP address bound. If it guesses incorrectly you must change the usage. Here it has guessed that all adapters are Private, which is incorrect. Actions Select the Adapter PublicLAN Click Edit...
37
Notes Here you specify the Interface type Oracle will use this specific network for Actions Select the Interface Type : Public radio button Click OK
38
Notes Here we specify the shared storage devices that will be used by Oracle Clusterware. Ideally you will have 2 devices for the OCR, Oracle will mirror to these devices to protect you from a single OCR device failure. Also you will have a total of 3 vote devices to protect your cluster from the failure of a single vote device. If you do not see partitions listed here that you expect to see - It may be because you had a previous failed install and have not cleaned up correctly - see My Oracle Support Note:341214.1 : How To clean up after a Failed (or successful) Oracle Clusterware Installation on Windows for how to clean up a failed install. Actions Select the device to be used for the First OCR Click Edit...
39
Notes Here we specify the usage for the selected device Actions Select the Place OCR (Primary) on this partition checkbox Click OK
40
Notes Here you can see the usage for the first OCR device has been set Now we will set the usage for the second OCR device Actions Select the device to be used for the Mirror OCR Click Edit...
41
Notes Here we specify the usage for the selected device Actions Select the Place OCR (Mirror) on this partition checkbox Click OK
42
Notes Next we specify the devices to be used for the Oracle Clusterware vote disks Actions Select the device to be used for the First vote device Click Edit...
43
Notes Here we specify the usage for the selected device Actions Select the Place Voting Disk on this Partition checkbox Click OK
44
Notes Continue with the second vote device Actions Select the device to be used for the Second vote device Click Edit...
45
Notes Here we specify the usage for the selected device Actions Select the Place Voting Disk on this Partition checkbox Click OK
46
Notes Continue with the third vote device Actions Select the device to be used for the third vote device Click Edit...
47
Notes Here we specify the usage for the selected device Actions Select the Place Voting Disk on this Partition checkbox Click OK
48
Notes Now you can see that we have 2 OCR devices and 3 vote devices Actions Click Next
49
Notes the installer lists a summary of the planned actions Actions Click Install
50
Notes the installer installs the software onto the local node Actions none required
51
Notes a series of configuration assistants are run at the end of the install Actions none required
52
Notes the VIP Configuration assistant will fail if the public IP address is not from within a routable range - we can fix this later. Actions Click OK
53
Notes here you can see that the installer shows the status canceled for the VIP Configuration Assistant Actions Click Cancel
54
Notes The OUI detects that not all the assistants completed successfully Actions Click OK
55
Notes The installer has completed installation and configuration of Oracle Clusterware Actions Click Exit
56
4.2.1. Run the VIP Configuration Assistant manually to configure the VIPs
4.2.1. Run the VIP Configuration Assistant manually to configure the VIPs
57
Notes here we need to run the vip configuration assistant manually Actions Select the Start->Run button Enter the full path to the vipca.bat file Click OK
4.2.1. Run the VIP Configuration Assistant manually to configure the VIPs
58
4.2.1. Run the VIP Configuration Assistant manually to configure the VIPs
59
Notes Here we identify which adapter will host the Virtual IP Actions Select the PublicLAN? Adapter Click Next
4.2.1. Run the VIP Configuration Assistant manually to configure the VIPs
60
Notes here we enter the IP Alias names for the virtual IP Addresses * Take care here to manually enter both the IP Alias names Actions Enter the Alias name for the first node in the cluster Enter the Alias name for the second node in the cluster - repeat for all nodes in the cluster if you have more than 2 Click Next
4.2.1. Run the VIP Configuration Assistant manually to configure the VIPs
61
Notes here you can see a summary of the VIP Configuration Actions Click Finish
4.2.1. Run the VIP Configuration Assistant manually to configure the VIPs
62
Notes The VIP, GSD, and ONS resources get configured inside Oracle Clusterware Actions none required
4.2.1. Run the VIP Configuration Assistant manually to configure the VIPs
63
64
First you can query the software and active versions of Oracle Clusterware D:\oracle\product\10.2.0\crs\BIN>crsctl query crs softwareversion CRS software version on node [winnode1] is [10.2.0.1.0] D:\oracle\product\10.2.0\crs\BIN>crsctl query crs activeversion CRS active version on the cluster is [10.2.0.1.0] here you can see that the software version = active version = 10.2.0.1
65
Notes You should ensure that the Clusterware home is selected in the first drop down list box The installer should default the directory to the correct location Actions Ensure the correct home is selected Click Next
66
Notes the installer detects that this is a clustered home and automatically selects all the nodes in the cluster Actions Click Next
67
Notes Some parameters are validated by the installer Actions Click Next
68
Notes This is a summary of the actions the installer will complete Actions Click Install
69
Notes the installer stages the patch on all the nodes in the cluster Actions No action required
70
Notes At the end of the install the installer lists the mandatory steps that must be completed to apply this patch Actions Click exit
71
Notes You must stop all of the Oracle Clusterware Services using the services.msc applet Actions Stop the following services OracleObjectService OracleClusterVolumeService OracleCRService OracleCSService OracleEVMService
72
Notes Using Windows task Manager - you should locate the ons.exe processes Actions No Action Required
73
Notes You should kill both the ons processes Actions Right Click on each process and select End Process
74
D:\oracle\product\10.2.0\crs\inventory\Templates\install\patch102\cv\remenv\exectask.bat -> D:\oracle\product\10.2.0\crs\inventory\Templates\cv\remenv\exectask.bat D:\oracle\product\10.2.0\crs\inventory\Templates\install\patch102\evm\admin\conf\evm.auth -> D:\oracle\product\10.2.0\crs\inventory\Templates\evm\admin\conf\evm.auth D:\oracle\product\10.2.0\crs\inventory\Templates\install\patch102\evm\admin\conf\evmdaemon.conf -> D:\oracle\product\10.2.0\crs\inventory\Templates\evm\admin\conf\evmdaemon.conf D:\oracle\product\10.2.0\crs\inventory\Templates\install\patch102\evm\admin\conf\evmlogger.conf -> D:\oracle\product\10.2.0\crs\inventory\Templates\evm\admin\conf\evmlogger.conf D:\oracle\product\10.2.0\crs\inventory\Templates\install\patch102\install\preupdate.bat -> D:\oracle\product\10.2.0\crs\inventory\Templates\install\preupdate.bat 15 File(s) copied Successful startup of OracleCSService Successful startup of OracleEvmService Successful startup of OracleCRService Setting up OPMD process OpmdInstall: OPM service successfully installed OpmdFixupService: Oracle Object Service set to manual startup and added to list OpmdFixupService: OracleCSService set to manual startup and added to list OpmdFixupService: OracleEVMService set to manual startup and added to list OpmdFixupService: OracleCRService set to manual startup and added to list clscfg: EXISTING configuration version 3 detected. clscfg: version 3 is 10G Release 2. Successfully accumulated necessary OCR keys. Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897. node <nodenumber>: <nodename> <private interconnect name> <hostname> node 1: winnode1 winnode1-priv winnode1 Creating OCR keys for user 'administrator', privgrp ''.. Operation successful. clscfg -upgrade completed successfully Successful upgrade of this node to Oracle Cluster Ready Services 10204
Once again you can check the Oracle Clusterware software levels D:\oracle\product\10.2.0\crs\BIN>crsctl query crs softwareversion CRS software version on node [winnode1] is [10.2.0.4.0] D:\oracle\product\10.2.0\crs\BIN>crsctl query crs activeversion CRS active version on the cluster is [10.2.0.1.0] As you can see the software version is now 10.2.0.4 however the active version is still 10.2.0.1. This means that the new software is in place on this node but is not yet active. It becomes active when the patch102.bat file completes on the last node in the cluster
75
Notes Here we will create an ASM Software home on all the nodes in the cluster Actions Click Next
76
Notes Here we can choose the type of database software to be installed Actions Select the Enterprise Edition radio button Click Next
77
Notes This is where you specify the location of the ASM software home. Modify the Home name and Home Path to include the word ASM. This makes it easier to identify later on. If you change the path you should ensure that you do not use the exact same path as the Oracle Clusterware home. Actions Confirm entries are OK Click Next
78
Notes The installer has detected the presence of Oracle Clusterware and uses this to populate this dialog box. To build a cluster which includes all nodes you must ensure that there are check-boxes next to the node names. Actions Click Select All Click Next
79
Notes The installer will then complete some Product-Specific Prerequisite checks. These should all pass OK as you have already run the CVU check. Actions Click Next
80
Notes We are going to install a Software only home and then subsequently configure the software Actions Select the Install Software Only radio button Click Next
81
Notes Here we can see a summary of the install. Actions Click Install
82
Notes Here the installer copies the software to all nodes in the cluster Actions none required
83
Notes After the software install completes you will see this 'End of Installation' dialog Actions Click Exit
84
85
86
Notes You are patching the ASM home. you need to make sure this is selected in the drop down list box Actions Select the ASM home in the drop down list box Click Next
87
Notes the installer detects that this is a clustered home and automatically selects all the nodes in the cluster Actions Click Next
88
Notes Some parameters are validated by the installer Actions Click Next
89
Notes Here you can setup the Oracle Configuration Manager Actions Click Next
90
Notes This is a summary of the actions the installer will complete Actions Click Install
91
Notes The installer copies the patch to all the nodes in the cluster Actions No action required
92
93
94
Notes You must use the NETCA from the ASM home to create the listeners Actions From the start menu select Oracle - OraDb10g_home1->Configuration and Migration Tools -> Net Configuration Assistant
95
Notes Netca detects that the Oracle Clusterware layer is running and offers Cluster or Single Node configuration Actions Select the Cluster configuration radio button Click Next
96
Notes Netca uses Oracle Clusterware to determine all the nodes in the cluster Actions Click Select all nodes Click Next
97
Notes You get various options we need to configure listeners Actions Select the Listener configuration radio button Click Next
98
Notes We need to add a listener Actions Select the Add radio button Click Next
99
Notes Here you get the opportunity to name the listener Do not change this. The listeners will automatically be called LISTENER_nodename1 & LISTENER_nodename2. This is important for RAC. Actions Click Next
100
Notes Oracle Net supports various network protocols, although TCP is the most common. Actions Ensure the Selected Protocols list includes TCP Click Next
101
Notes It is possible to choose a non-default Port this is not recommended Actions Ensure the Use the 'Standard port number of 1521' radio button is set Click Next
102
Notes After configuring the node listeners you get the opportunity to configure additional listeners Actions Select the 'No' radio button Click Next
103
Notes The Listeners are configured on all nodes Actions Click Finish
104
Notes We use the DBCA from the ASM install to create the ASM instances Actions From the start menu select Oracle - OraASM10g_home1->Configuration and Migration Tools -> Database Configuration Assistant
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
105
Notes DBCA detects the Oracle Clusterware layer is running and offers to create either cluster or single instance database Actions Select the 'Oracle Real Application Clusters database' radio button Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
106
Notes We use DBCA to create RAC databases and ASM instances Actions Select the 'Configure Automatic Storage Management' radio button Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
107
Notes You need to make sure you create ASM instances on all the cluster nodes Actions Click Select All Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
108
Notes Here we specify the password for the ASM Oracle SYS user Actions Enter the SYS password Enter the same password for the Confirm SYS password Select 'Create initialization parameter file (IFILE)' Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
109
Notes dbca will create and start ASM instances Actions Click OK
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
110
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
111
Notes ASM requires disks to be grouped together into diskgroups. This section will be used to create 2 disk groups +DATA and +FLASH Actions Click Create New
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
112
Notes At the moment no disks are visible They must be stamped before they appear in the Member disk list. Actions Click 'Stamp Disks'
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
113
Notes DBCA will use asmtool to stamp the disks Actions Select the 'Add or change label' radio button Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
114
Notes Here you can see a list of the devices visible to asmtool. The first 2 are the OS C: and D: drives. The next 5 are the devices used by Oracle Clusterware. The next 9 disks are Candidate devices for ASM usage. We are going to use the first 6 disks for the +DATA diskgroup Actions Select the first 6 disks Check the 'generate stamps with this prefix' checkbox Enter a prefix of DATA Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
115
Notes This is a summary of the actions asmtool will carry out for the DATA disks Actions Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
116
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
117
Notes The stamped disks are now visible. We need to stamp the remaining disks for the +FLASH diskgroup Actions Click 'Stamp Disks'
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
118
Notes Here we go through basically the same steps once more Actions Select the Add or change label radio button Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
119
Notes You can see the same list as before. Notice the DATA diskgroup disk labels are visible. Actions Select the final 3 candidate devices Check the 'generate stamps with this prefix' checkbox Enter a prefix of FLASH Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
120
Notes This is a summary of the actions asmtool will carry out for the FLASH disks Actions Click Next
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
121
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
122
Notes Now we will assign disks to specific diskgroups and create the DATA diskgroup Actions For the Disk Group Name enter DATA Select the 'External Redundancy' radio button Select the 'Show Candidates' radio button Select the first 6 disks, the ones that were stamped \\.\ORCLDISKDATAn Click OK
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
123
Notes A progress message this should not take very long Actions none
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
124
Notes Here we can see the DATA diskgroup has been created and is mounted on 2/2 instances. We now need to create the FLASH diskgroup. Actions Click Create New
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
125
Notes Now we will assign disks to specific diskgroups and create the FLASH diskgroup For a change we will create this diskgroup with Normal redundancy Actions For the Disk Group Name enter FLASH Select the 'Normal' radio button Select the 'Show Candidates' radio button Select the remaining 3 disks, the ones that were stamped \\.\ORCLDISKFLASHn Click OK
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
126
Notes A progress message this should not take very long Actions none
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
127
Notes Here we can see the DATA and FLASH diskgroups have been created and are mounted on 2/2 instances. This completed the ASM configuration. Actions Click Finish
9.1. Create ASM Instance and add the +DATA and +FLASH diskgroups
128
9.2. Completed creation of ASM Instance and add of the +DATA and +FLASH diskgroups
Congratulations you have installed ASM, Network listeners and created 2 ASM diskgroups.
9.2. Completed creation of ASM Instance and add of the +DATA and +FLASH diskgroups
129
Notes Here we will create a RAC Database Software home on all the nodes in the cluster Actions Click Next
130
Notes Here we can choose the type of database software to be installed Actions Select the 'Enterprise Edition' radio button Click Next
131
Notes This is where you specify the location of the RAC Database software home. If you change the path you should ensure that you do not use the exact same path as the Oracle Clusterware home or the ASM Home. Actions Confirm entries are OK Click Next
132
Notes The installer has detected the presence of Oracle Clusterware and uses this to populate this dialog box. To build a cluster which includes all nodes you must ensure that that you check the checkboxes next to the node names. Actions Click Select All Click Next
133
Notes The installer will then complete some Product-Specific Prerequisite checks. These should all pass OK as you have already run the CVU check. Actions Click Next
134
Notes The installer detects you already have a Database home installed Actions ensure the 'No' radio button is selected Click Next
135
Notes We are going to install a software only home and then subsequently configure the software Actions Select the Install Software Only radio button Click Next
136
Notes Here we can see a summary of the install. Actions Click 'Install'
137
Notes Here the installer copies the software to all nodes in the cluster Actions none required
138
Notes After the software install completes you will see this 'End of Installation' dialog Actions Click Exit
139
140
141
Notes You are patching the RAC Database home. Make sure this is selected in the drop down list box. Actions Select the RAC Database home in the drop down list box Click Next
142
Notes the installer detects that this is a clustered home and automatically selects all the nodes in the cluster Actions Click Next
143
Notes Some parameters are validated by the installer Actions Click Next
144
Notes Here you can setup the Oracle Configuration Manager Actions Click Next
145
Notes This is a summary of the actions the installer will complete Actions Click Install
146
Notes The installer copies the patch to all the nodes in the cluster Actions No action required
147
148
149
Notes You must use the DBCA from the RAC database home not the ASM home
150
Notes DBCA detects the Oracle Clusterware layer is running and offers to create either cluster or single instance database Actions Select the Oracle Real Application Clusters database radio button Click Next
151
Notes We use DBCA to create RAC databases Actions Select the 'Create a Database' radio button Click Next
152
Notes You need to make sure you create RAC database instances on all the cluster nodes Actions Click Select All Click Next
153
Notes Here you get to select the type of database Actions Select the 'General Purpose' radio button Click Next
154
Notes Now you specify the preface for the SIDs for the RAC database instances recommendation is to keep it simple Actions Enter ERI in the Global Database name, The SID should autofill Click Next
155
Notes Here you get to configure Oracle Enterprise Manager. If you have no Grid Control server then the best method is to use dbcontrol as detailed here. Actions Check the Configure Enterprise manager checkbox Select the Configure Database Control for local management radio button Click Next
156
Notes Here we specify the password for the Oracle Database users. In this example we are setting the same password for all users. You should set a password scheme that meets your requirements. Actions Select the 'Use the Same Administrative Password' radio button Enter the password Enter the same password for the Confirm password Click Next
157
Notes Here you specify where you would like your database datafiles stored. We are going to use the ASM diskgroups we created earlier. Actions Select the 'Automatic Storage Management (ASM)' radio button Click Next
158
Notes DBCA displays the diskgroups we previously created. We are going to use the DATA diskgroup Actions Check the box on the DATA diskgroup line Click Next
159
Notes Here we can adjust where various files are placed Actions Select the 'Use Oracle-managed Files' radio button Ensure +DATA is in the Database Area field Click Next
160
Notes Here we specify recovery configuration information. We are going to use a flash recovery area. Actions Check the 'Specify Flash Recovery Area' checkbox In the Flash recovery area enter +FLASH Set the flash recovery size remember the size of the +FLASH diskgroup Check the 'Enable Archiving' checkbox Click Next
161
Notes Here you can choose to add the Oracle Sample schemas Actions Check the 'Sample schemas' checkbox Click Next
162
Notes Here you can choose to create additional database Services Actions Click Next
163
Notes Here you can modify the default initialisation parameters. Actions Click Next
164
Notes Here you can review the placement of various database files Actions Click Next
165
Notes You can decide to generate database creation scripts Actions Check the Create Database checkbox Click Next
166
167
168
Notes After the database is created the summary screen is displayed note the URL provided for Database Control Actions Click Exit
169
Notes The Database instances will be started on all nodes Actions none
170