Professional Documents
Culture Documents
Installation
Installation steps for Oracle RAC on Windows 2003 Enterprise x64 Edition.
Clusterware
Oracle Clusterware Installation
Note, the names of the network interfaces must be exactly the same on each node in the cluster
and have the same case.
For the private interfaces we will use the subnet 10.1.1.0, using 10.1.1.180 for rac1 and
10.1.1.182 for rac2.
For the public interfaces we will use the subnet 192.168.1.0 using 192.168.1.180 for rac1 and
192.168.1.182 for rac2.
In addition, Clusterware will assign a "virtual" IP address to each node in the cluster. These IP
addresses must not be defined in the Windows Network Settings. Clusterware takes case of the
VIP assignment.
For the virtual ips we will use 192.168.1.181 for rac1 and 192.168.1.183 for rac2.
To configure the public interface. right click on the interface and select Properties.
.
Select "Internet Protocol (TCP/IP)" and click the Properties button.
Note, change the default gateway and DNS server to appropriate values for your network.
Repeat this process to configure the private interface.
The public interface must also be listed first in the network binding order. This can be done by
clicking Advanced Settings from the Advanced menu of the Network Connections window.
If the public interface is not listed first, use the "up arrow" button to move it to the top of the
connection list.
Finally, Media Sensing needs to be disabled for networking on the nodes. Media Sensing is a
feature used to detect if network interfaces are in a link state. When a link goes down, Windows
will unbind protocols from the interface, this can cause problems with Clusterware and must be
disable.
Using the Disk Management interface in Windows, right click on the 10GB disk and select New
Partition.
Click Next.
Select Extended partition and click Next.
Use the entire disk for the partition and click Next.
Click Finish to create the partition.
Now, we need to create a new logical disk. Right click on the newly created partition and select
New Logical Disk. Click Next.
Select Logical drive and click Next.
Use the entire disk for the partition and click Next.
Select "Do not assign a drive letter or drive path" and click Next.
Each node may need to be restarted before they can see the partitions on the shared disks. After a
restart, Windows may assign a drive letter to the partitions. These drive letters should be
removed through the Disk Management interface before proceeding.
Right click on the volume and select "Change Driver Letter and Paths...".
Clusterware Install
Download Oracle Clusterware Release 2 (10.2.0.1.0) from
http://download.oracle.com/otn/nt/oracle10g/10201/102010_win64_x64_clust...
Unzip the software to a temporary staging area that will be called $STAGING_DIR from this
point onwards.
Included as part of the installation software is the Cluster Verification Utility (CVU). This utility
can be used to verify the cluster before and after installation. Before the cluster software has
been installed, this utility is available in the
$STAGING_DIR\10210_win64_x64_clusterware\clusterware\cluvfy directory.
Execute the following from a command prompt:
> runcluvfy.bat stage -pre crsinst -n rac1,rac2 -verbose
ERROR:
Could not find a suitable set of interfaces for VIPs.
Pre-check for cluster services setup was unsuccessful on all the nodes.
Note, the tool will fail with the error "Could not find a suitable set of interfaces for VIPs.". This
is normal as we have used a private subnet (10.1.1.0) for the VIP interfaces.
Enter a name for the cluster. We also need to add our second node. Click Add and enter in the
information for rac2.
Click Next.
The interface type needs to be changed to "Public" for our public interface. Click Edit.
Click Next when done.
Now we need to select partitions that will be used as the Oracle Cluster Registry (OCR) and the
Voting disk. Highlight the partition to be used for the OCR disk, click Edit and mark it.
Now, highlight the second partition and mark it as the Voting disk.
Click Next when done.
A warning dialog will pop up recommending that an OCR mirror disk be created for redundancy.
Click OK.
A warning dialog will pop up recommending that an Voting mirror disk be created for
redundancy. Click OK.
For the purposes of this example, we do not need any redundancy as the install is in a virtual
machine. Click Next to continue.
The Virtual Private IP Configuration Assistant will fail for the same reason that the CVU utility
failed due to the private subnet being used. Click OK to continue
Another warning dialog will pop up. Click OK to close it.
Clusterware should now be installed and running on both nodes. To verify the installation, run
the CVU utility from $CLUSTER_HOME\bin
Node Name
------------------------------------
rac1
rac2
Unzip the patch to a temporary directory on any of the two nodes and run setup.exe and click
Next.
Select the Clusterware home and click Next.
Cluster installation should already be selected at this point. Click Next to continue.
The summary screen should be displayed at this point. Click Next to continue.
At this point the patch software will be deployed to all the nodes in the cluster.
The patch software should be now be deployed to each node. Click Exit to close the installer.
At this point, the patch has not been installed. It has only be staged to each node in the cluster.
We now need to apply the patch on a rolling basis to each node. NOTE: the following steps need
to be repeated for each node in the cluster.
The first thing we need to do is to stop all the Oracle services. From a command prompt, execute
the following commands:
To verify that all Oracle services have stopped, there should be no output from the following
command:
It is also a good idea to stop the Microsoft Distributed Transaction Coordinator, as it may have
loaded some Oracle libraries that need to be patched.
> net stop MSDTC
> patch102.bat
If the MSDTC has already been stopped, this is most likely due to two ons.exe processes that
are still running. Using the Windows Task Manager to kill these two processes.
Now execute the command again and if successful it should display the following message:
Run the cluster verification cluvfy to verify the cluster is ready for a database installation by
executing the following command:
ERROR:
Could not find a suitable set of interfaces for VIPs.
Once again the tool will report a failure due to private subnet being using for the virtual IPs. If
this is the only error, we can proceed with the installation.
Click Next.
Unzip the patch to a temporary directory on any of the two nodes and run setup.exe and click
Next.
Select the ASM home and click Next.
Cluster installation should already be selected. Click Next to continue.
The installation summary should now be displayed. Click Install to continue.
The patch will now be staged to each node in the cluster.
Configuration assistants will be run to apply the patch to each node.
The patch should now be installed. Click Exit to close the installer.
c:\oracle\product\10.2.0\asm_1\bin> netca.bat
c:\oracle\product\10.2.0\asm_1\bin> asmtoolg.exe
Select the 35GB partition and enter "DATA" as the prefix to stamp this partition with. Click
Next.
Click Next.
Click Finish to close the tool.
We now need to repeat the above steps to specify our partition to be used for flash recovery.
From the $ASM_HOME\bin directory, run the asmtool utility:
c:\oracle\product\10.2.0\asm_1\bin> asmtoolg.exe
Click Next.
Click Finish to close the tool.
Now from the $ASM_HOME\bin directory, start the Database Configuration Assistant:
c:\oracle\product\10.2.0\asm_1\bin\dbca.bat
Database Installation
Guide to installing and patching an Oracle database in a Clusterware environment.
Unzip the patch to a temporary directory on any of the two nodes and run setup.exe and click
Next.
Select the RAC home from our previous install and click Next.
Cluster installation mode should already be selected. Click Next to continue.
Review the summary before installing. Click Install to continue.
The patch will now be staged to each node in the cluster.
The patch will now be applied to each node.
Click Exit to close the installer.
c:\oracle\product\10.2.0\db_1\bin> dbca.bat
Select Oracle Real Application Clusters database and click Next.
The two nodes in my cluster were fresh installs of Win2003 R2 Enterprise x64 Edition. In this
case I needed to reuse the shared disk between the two nodes.
Running the cluster verification utility (runcluvfy.bat), my two machines passed cluster pre-
install check:
The problem happened during the actual install itself during Storage Configuration stage. The
two partitions that I had previously selected as my OCR and Voting disks were not listed.
Checking the installer logs (these are normally found in C:\Program Files\Oracle\Inventory\logs
and will be called installActionsYYYY-MM-DD_hh-mm-ssAMPM.log), I found the following:
nodeList = rac1,rac2
INFO: Query Returned:
B:,E:,F:,G:,H:,I:,J:,K:,L:,M:,N:,O:,P:,Q:,R:,S:,T:,U:,V:,W:,X:,Y:,Z:
INFO: Setting variable 'sl_Drives' to
'B:,E:,F:,G:,H:,I:,J:,K:,L:,M:,N:,O:,P:,Q:,R:,S:,T:,U:,V:,W:,X:,Y:,Z:'.
Received the value from a code block.
INFO: Calling Query ClusterPreinstQueries1.2.1 getPartitionInfo
INFO: Query Returned: ocrcfg,1,1,10229,votedsk1,2,1,10229,,3,1,35001,,3,2,5946
INFO: Setting variable 'sl_OHPartitionsAndSpace' to 'NO_VAL,3'. Received the
value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to 'NO_VAL,3,1'. Received the
value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to 'NO_VAL,3,1,35001'.
Received the value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to 'NO_VAL,3,1,35001,'.
Received the value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to 'NO_VAL,3,1,35001,,'.
Received the value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to 'NO_VAL,3,1,35001,,,'.
Received the value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to 'NO_VAL,3,1,35001,,,,3'.
Received the value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to 'NO_VAL,3,1,35001,,,,3,2'.
Received the value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to
'NO_VAL,3,1,35001,,,,3,2,5946'. Received the value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to
'NO_VAL,3,1,35001,,,,3,2,5946,'. Received the value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to
'NO_VAL,3,1,35001,,,,3,2,5946,,'. Received the value from a code block.
INFO: Setting variable 'sl_OHPartitionsAndSpace' to
'NO_VAL,3,1,35001,,,,3,2,5946,,,'. Received the value from a code block.
INFO: Calling Query NtServicesQueries10.2.0.2.0 ntGetAllOracleServices
INFO: Query Returned: OracleRemExecService,OracleClusterPreinstService
INFO: Calling Query ClusterPreinstQueries1.2.1 RemoveClusterPreinstService
Apparently, the Oracle Installer is smart enough to recognize that 2 of my 4 partitions have
labels "ocrcfg" and "votedsk1" and is not listing them because as far as it knows, theses
partitions are in use by another cluster.
I tried deleting my partitions, re-sizing them, re-formatting with full NTFS and then restarting
the Oracle Installer. Once again, the same problem occurred, the disks still had these labels.
It turns out Oracle includes two utilities that are part of the Clusterware install for removal of
disk labels and low-level formatting of partitions
guioracleobjmanager.exe
logpartformat.exe
The catch here is that you need to retrieve the files from CLUSTER_HOME\bin directory. If you
do not have Clusterware installed on another machine, you will not be able to get access to these
files and may need to call Oracle support to get copies of them.
In my case, I was able to copy these executables and the appropriate DLLs to my install
machines.
As we can see above, this utility lists any labels that Oracle has applied to the shared storage. We
can see the same names we saw in the install log: ocrcfg and votedsk1.
From a command prompt, we now need to format this partitions using the logpartformat.exe
utility:
Check the checkbox on each line with the disk labels that we just formatted and select the
Commit menu item from the Options menu.
The partitions should now appear in Oracle Universal Installer during the Clusterware
installation.