You are on page 1of 25

An Oracle White Paper May 2010

Oracle E-Business Suite 11i Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

Introduction ......................................................................................... 1! Value Proposition ............................................................................ 1! Setup Details....................................................................................... 3! Configuring the Unified Storage System and Oracle Database Server ................................................................................................. 4! Configuring the Unified Storage System ......................................... 4! Installing Oracle Benchmark Database............................................... 7! Configuring the Database System to Use the NFS File System ..... 7! Installing Oracle Application Server 11i ............................................ 15! References........................................................................................ 22!

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

Introduction
This document describes the steps needed to configure and install Oracle E-Business Suite 11i in Oracles Sun Storage 7000 Unified Storage Systems, as well as the value proposition offered by the solution, including easy setup and management. It covers the following topics. Preparing an unified storage system for Oracle database storage Preparing an Oracle Solaris server to use NFS file systems Installing Oracle E-Business Suite on the Oracle Solaris server and creating a database on the storage system Separating database transaction log files from data files and storing on the storage system Taking a snapshot of an online Oracle database and recovery from the snapshot

Value Proposition
Running an Oracle database with data and transaction log files stored on an unified storage system NAS storage system has several advantages. Data protection features. Unified storage system has data protection features including snapshots, rollback, cloning and remote replication. Fast snapshots and quick recovery. The snapshot feature is almost instantaneous. Also, during rollback, since there is no data copying involved, an incredible amount of time is saved as the file system is put back to the original state it was at the time the snapshot was taken.

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

Availability and reliability. The unified storage system snapshot can create a database backup in a matter of seconds without bringing a database down along with various RAID configurations.

In addition, unified storage system leverage the following key features. Oracle Solaris. Key features for NAS include the high-performance Fire Engine networking stack for IPv4 and IPv6. Analytics. A graphical user interface based on Oracle Solaris Dynamice Tracing (DTrace) enables real-time performance analysis and debugging. Oracle Solaris ZFS. The world's first 128-bit file system, with key features such as checksum, copy on write, cloning, snapshot and iSCSI support. Fault Management Architecture (FMA). The FMA provides unique self-healing diagnosis for common hardware problems.

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

Setup Details
Table 1 summarizes the hardware and software configuration used.
TABLE 1. HARDWARE AND SOFTARE SPECIFICATIONS

HARDWARE CONFIGURATION

S.NO

APPLICATION COMPONENT

SOFTWARE VERSION

SYSTEM MODEL

PROCESSOR

MEMORY (GB)

NETWORK

STORAGE

Oracle Database Server (x64)

Oracle Solaris 10 5/08 Oracle Solaris 10 5/08

Sun Fire X4150 Server Sun Fire T2000 Server

2 x 2660 Intel Xeon/8000 MB 1 x 1400 UltraSPARC T1/64000MB 2 x 73 GB

1 GB

1 x 73 GB

Oracle Application Server (SPARC)

64

1 GB

2 x 73 GB Internal Disks

Unified Storage System

Sun Storage 7000 Version 2008.10

Sun Storage 7210 Array

2 x Quad Core AMD Opteron

64

1 GB

48 x 500 GB SATA HDD

Load Runner

V20Z-WIN

2 x 2400 AMD Opteron

1 x 73 GB

Note 1: x64 platforms was tested to prove that the instructions listed in this documents are applicable Note 2: On the unified storage system, a single volume of 48 disks was created

Figure 1 shows the deployment topology.

Sun Fire T2000 Server (Oracle E-Business Suite Application Tier)

Sun Fire X4150 Server (Database Tier)

2 x 3.2 GHz Quad-Core Intel Xeon Processors 8 GB Memory 4 x 136 GB

Sun Storage 7210 System (NAS Appliance)

2 x 2.6 GHz Dual-Core AMD Opteron Processors 16 GB Memory 48 x 500 GB


Figure 1. Deployment topology

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

Configuring the Unified Storage System and Oracle Database Server


Before creating a database on the unified storage system, a series of steps must be performed on the database server and the storage system.

Configuring the Unified Storage System


1. 2. 3. Login to the unified storage system using a Web browser: https://<host-name>:215. Create a new project. Click on Shares -> Projects. In the Projects menu click on Add. Type a name for the project and click Apply. Change the project properties for the NFS protocol to make NFS file systems accessible for the database servers.

Click on Protocols. Under NFS section, click on the EXCEPTION section. Select DNS Domain. Add sfbay.Sun.COM. Select Read/Write Access. Check root access. Select Host x4150-241-01.sfbay.sun.com. Select Read/Write Access. Check root access.

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

4.

Change the project properties, such as database record size and volume block size. Go to the Shares view. Click on General. Set the property values for Database record size in the Inheritable Properties section and Volume block size in the LUN creation defaults section. In this experiment, we choose 64K for both the database record size and volume block size. You can also change the export directory. The default is /export.

5.

Create the file systems. Go to the Shares. Click Shares. Click FILESYSTEMS. Click Add New... to create a new file system share. For example, the following creates a file system named OracleEBS.

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

Four files systems are created: oradata (for control files, etc.), oradat_4 (for redo log files), admin (for udump, bdump etc.), and mydatafile (for the entire bench mark db).

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

Installing Oracle Benchmark Database


The following sections describe the installation of the Oracle benchmark database.

Configuring the Database System to Use the NFS File System


All the steps documented below as run as the root user unless otherwise stated.

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

1.

Create mount points.


/opt/oracle/oradata /opt/oracle/oradata_4 (RedoLogFiles) /opt/oracle/admin

2.

Add NFS file systems mount entries to /etc/vfstab. The unified storage system host name is x4500240-02.sfbay in this example.
x4500-240-02.sfbay:/export/OracleEBS/oradata - /opt/oracle/oradata nfs no rw,bg,hard,nointr,rsize=32768,wsize=32768,proto=tcp,vers=3,noac,forcedirectio x4500-240-02.sfbay:/export/OracleEBS/oradata4 - /opt/oracle/oradata4 nfs no rw,bg,hard,nointr,rsize=32768,wsize=32768,proto=tcp,vers=3,noac,forcedirectio x4500-240-02.sfbay:/export/OracleEBS/admin - /opt/oracle/admin nfs no rw,bg,hard,nointr,rsize=32768,wsize=32768,proto=tcp,vers=3,noac,forcedirectio

3.

Mount the NFS file systems and verify the read/write access.
mount -F nfs -o hard,rw,noac,rsize=32768,wsize=32768,suid,proto=tcp,vers=3 x4500-240-02.sfbay:/export/OracleEBS/oradata /opt/oracle/oradata mount -F nfs -o hard,rw,noac,rsize=32768,wsize=32768,suid,proto=tcp,vers=3 x4500-240-02.sfbay:/export/OracleEBS/oradata4 /opt/oracle/oradata_4 mount -F nfs -o hard,rw,noac,rsize=32768,wsize=32768,suid,proto=tcp,vers=3 x4500-240-02.sfbay:/export/OracleEBS/admin /opt/oracle/admin

4.

Verify that the mount points are listed in the output. Also verify the read/write access on the file systems using the touch(1M) command. You should be able to create and delete files on the NFS file systems. Create the oracle user.
# mkdir -p /export/home/oracle # useradd -d /export/home/oracle -s /bin/ksh oracle # passwd oracle (password: or04ebs)

5.

6.

Obtain the benchmark database files for Oracle 10g R1 database server from Oracle. Untar the database server files in the home directory of the oracle user.
# cd /export/home/oracle # tar xf oracle10.1.0.tar # mkdir -p /opt/oracle/oradata/VIS (for all *.dbf files except redo log files) # mkdir -p /opt/oracle/oradata_4/RedoLogFiles (for redo log files) # mkdir -p /opt/oracle/admin/VIS

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

7.

Create udump, bdump, and cdump directories under the admin/VIS directory.
# cd /opt/oracle/admin/VIS # mkdir udump bdump cdump # chown oracle:dba

8.

Make sure the domainname command returns the proper domain name.
% domainname mpklab.sfbay.sun.com

9.

Edit the /etc/inet/hosts file. Make sure you use the private network IP addresses for the database server, application server, and Load Runner driver PC. It typically looks like the following.
10.6.241.234 x4150-241-01.sfbay.sun.com x4150-241-01 loghost 10.6.240.162 t2000-240-10.sfbay.sun.com t2000-240-10 129.146.44.113 v20zwin-44-03.sfbay.sun.com v20zwin-44-03

10. Add the following line to the /export/home/oracle/.profile file. Replace hostname with the host name of the database server. Make sure the *.env file exists.
ENV=/oracle/product/10.1.0/VIS_<hostname>.env [root] mkdir -p /oracle/product cd /oracle/product [root] ln -s /export/home/oracle/10.1.0 10.1.0

11. Adjust initVIS.ora parameters. Make sure you set cursor_space_for_time to FALSE. Otherwise the database server can consume more memory without exhibiting any additional benefits. 12. Close all open terminals to the database server. Connect to the database server again using telnet or ssh so the new profile gets used. 13. Start up the database as sysdba.
% sqlplus / as sysdba SQL*Plus: Release 10.1.0.4.0 - Production on Mon Aug 20 13:18:00 2007 Copyright (c) 1982, 2005, Oracle. All rights reserved. Connected to an idle instance. SQL> startup ORACLE instance started. Total System Global Area 6979321856 bytes Fixed Size 1310432 bytes Variable Size 3456893216 bytes Database Buffers 3489660928 bytes Redo Buffers 31457280 bytes Database mounted. Database opened.

14. Check the FND_NODES table for the configured application, concurrent and database server nodes.

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

SQL> connect apps/apps Connected. SQL> select NODE_NAME, SERVER_ADDRESS from fnd_nodes; NODE_NAME SERVER_ADDRESS ------------------------------ -----------------------------AUTHENTICATION * X4150-241-01 T2000-240-10 10.6.240.162

15. In the case of clean setups, clean up the fnd_nodes table and start from the scratch.
SQL> exec fnd_conc_clone.setup_clean; PL/SQL procedure successfully completed. SQL> select NODE_NAME, SERVER_ADDRESS from fnd_nodes; no rows selected

16. Start up the listener.


% lsnrctl start LSNRCTL for Solaris: Version 10.2.0.2.0 - Production on 15-JAN-2007 03:22:21 Copyright (c) 1991, 2005, Oracle. All rights reserved. Starting /oracle/product/10.1.0/bin/tnslsnr: please wait... TNSLSNR for Solaris: Version 10.2.0.2.0 - Production System parameter file is /oracle/product/10.1.0/network/admin/VIS_x4150-241-01/listener.ora Log messages written to /oracle/product/10.1.0/network/log/listener.log Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=x4150-24101)(PORT=1521))) Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521)) STATUS of the LISTENER -----------------------Alias LISTENER Version TNSLSNR for Solaris: Version 10.2.0.2.0 Production Start Date 15-JAN-2007 03:22:21 Uptime 0 days 0 hr. 0 min. 0 sec Trace Level off Security ON: Local OS Authentication SNMP OFF Listener Parameter File /oracle/product/10.1.0/network/admin/VIS_x4150-241-01/listener.ora Listener Log File /oracle/product/10.1.0/network/log/listener.log Listening Endpoints Summary... (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=x4150-241-01)(PORT=1521))) The listener supports no services The command completed successfully

10

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

17. Run the AutoConfig script.


% cd $ORACLE_HOME/appsutil/scripts/VIS_`hostname` % ./adautocfg.sh Enter the APPS user password: apps AutoConfig is configuring the Database environment... AutoConfig will consider the custom templates if present. Using ORACLE_HOME location : /oracle/product/10.1.0 Using java command : /oracle/product/10.1.0/jre/1.4.2/bin/java Java version : 1.4.2_04 Classpath : /oracle/product/10.1.0/jre/1.4.2/lib/rt.jar:/oracle/product/10.1.0/jdbc /lib/ojd bc14.jar:/oracle/product/10.1.0/appsutil/java/xmlparserv2.zip:/oracle/p roduct/1 0.1.0/appsutil/java Using Context file : /export/home/oracle/10.1.0/appsutil/VIS_x4150-241-01.xml Context Value Management will now update the Context file Updating Context file...COMPLETED Attempting upload of Context file and templates to database...COMPLETED Updating rdbms version in Context file to db101 Updating rdbms type in Context file to 64 bits Configuring templates from ORACLE_HOME ... AutoConfig completed successfully. The log file for this session is located at: /oracle/product/10.1.0/appsutil/log/VIS_x4150-241-01/09160906/adconfig.log

18. Check the FND_NODES table again.


SQL> select NODE_NAME, SERVER_ADDRESS from fnd_nodes; NODE_NAME SERVER_ADDRESS ------------------------------ -----------------------------AUTHENTICATION * X4150-241-01 T2000-240-10 10.6.240.162

19. Verify and increase the number of Payroll threads, if needed.


SQL> select parameter_value from pay_action_parameters where parameter_name = 'THREADS'; PARAMETER_VALUE 2 SQL> update pay_action_parameters set parameter_value = 4 where parameter_name = 'THREADS 1 row updated. SQL> commit; Commit complete. SQL> select parameter_value from pay_action_parameters where

11

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

parameter_name = 'THREADS'; PARAMETER_VALUE 4

20. Once the application and concurrent servers are configured, check the FND_NODES table again and restart the listener.
SQL> select NODE_NAME, SERVER_ADDRESS from fnd_nodes; NODE_NAME SERVER_ADDRESS ------------------------------ -----------------------------AUTHENTICATION * X4150-241-01 T2000-240-10 10.6.240.162 $ lsnrctl stop LSNRCTL for Solaris: Version 10.2.0.2.0 - Production on 15-JAN-2007 03:22:12 Copyright (c) 1991, 2005, Oracle. All rights reserved. Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521)) % lsnrctl start ... ....... ... The listener supports no services The command completed successfully % netstat -a | grep 1521 *.1521 *.* 0 0 400000 0 LISTEN

21. Edit tcp.invited_nodes in $TNS_ADMIN/sqlnet.ora.


cd $TNS_ADMIN cp sqlnet.ora sqlnet.ora.orig Add the application, concurrent server node names to tcp.invited_nodes diff sqlnet.ora.orig sqlnet.ora < tcp.invited_nodes=(BEN04.etc.sfbay.sun.com) > tcp.invited_nodes=(t2000-240-10.sfbay.sun.com,X4150-24101.sfbay.sun.com)

At this point, restart the listeners on all application server nodes, concurrent server nodes, and the database server node(s). 22. On Oracle Solaris 10 and later systems, disable the Web console. It is not useful for this benchmark project, and it consumes some memory by running a java process as the noaccess user.
# svcadm -v disable webconsole svc:/system/webconsole:console disabled.

23. Add some swap space.

12

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

# mkfile 3072M /extraswap # ls -l /extraswap -rw------T 1 root root 3221225472 Sep 16 10:12 /extraswap # swap -a /extraswap # swap -l swapfile dev swaplo blocks free /dev/dsk/c0t0d0s1 61,65 8 2104504 2104504 /extraswap - 8 6291448 6291448

24. Set the following TCP/IP parameters.


# ndd -set /dev/tcp tcp_time_wait_interval 60000 # ndd -set /dev/tcp tcp_conn_req_max_q 1024 # ndd -set /dev/tcp tcp_conn_req_max_q0 4096 # ndd -set /dev/tcp tcp_ip_abort_interval 60000 # ndd -set /dev/tcp tcp_keepalive_interval 900000 # ndd -set /dev/tcp tcp_rexmit_interval_initial 3000 # ndd -set /dev/tcp tcp_rexmit_interval_max 10000 # ndd -set /dev/tcp tcp_rexmit_interval_min 3000 # ndd -set /dev/tcp tcp_smallest_anon_port 1024 # # # # ndd ndd ndd ndd -set -set -set -set /dev/tcp /dev/tcp /dev/tcp /dev/tcp tcp_slow_start_initial 2 tcp_xmit_hiwat 400000 tcp_recv_hiwat 400000 tcp_max_buf 4194304

# ndd -set /dev/tcp tcp_cwnd_max 2097152 # ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 67500 # ndd -set /dev/udp udp_xmit_hiwat 400000 # ndd -set /dev/udp udp_recv_hiwat 400000 # ndd -set /dev/udp udp_max_buf 4194304

25. Proactively set the shmsys:shminfo_shmmax parameter using prctl on Oracle Solaris 10 or later to avoid the ORA-27102: out of memory error.
% prtconf | grep Mem Memory size: 65408 Megabytes % id -p uid=216377(oracle) gid=2294(dba) projid=3(default) % prctl -n project.max-shm-memory -i project 3 project: 3: default NAME PRIVILEGE VALUE FLAG ACTION RECIPIENT project.max-shm-memory privileged 15.6GB -deny system 16.0EB max deny # prctl -n project.max-shm-memory -r -v 32G -i project 3 # prctl -n project.max-shm-memory -i project 3 project: 3: default NAME PRIVILEGE VALUE FLAG ACTION RECIPIENT project.max-shm-memory

13

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

privileged 32.0GB -deny system 16.0EB max deny

Note that changes done with prctl command on a running system are temporary and will be lost when the system is rebooted. To make the changes permanent, create a project using the projadd command as shown below.
# projadd -p 102 -c 'eBS benchmark' -U oracle -G dba -K 'project.maxshmmemory=(privileged,32G,deny)' OASB

26. Make sure the project is created with the projects -l or cat /etc/project commands.
# cat /etc/project ... OASB:102:eBS benchmark:oracle:dba:project.max-shmmemory=( privileged,34359738368,deny) # projects -l OASB OASB projid : 102 comment: "eBS benchmark" users : oracle groups : dba attribs: project.max-shm-memory=(privileged,34359738368,deny)

27. Create the following indexes as sysdba.


% sqlplus SQL*Plus: Copyright Connected / as sysdba Release 10.1.0.4.0 - Production on Mon Aug 20 16:32:27 2007 (c) 1982, 2005, Oracle. All rights reserved. to:

Oracle Database 10g Enterprise Edition Release 10.1.0.4.0 - 64bit Production With the Partitioning, OLAP and Data Mining options SQL> create index APPS.OE_PRICE_ADJUSTMENTS_GiriIdx on APPS.OE_PRICE_ADJUSTMENTS ( LIST_LINE_ID, LIST_LINE_TYPE_CODE, UPDATED_FLAG) compute statistics; Index created. SQL> create index APPS.RA_CUSTOMER_TRX_ALL_GiriIdx on APPS.RA_CUSTOMER_TRX_ALL (TRX_NUMBER, REQUEST_ID) compute statistics; Index created. SQL> create index pay_asgnment_ltst_balgiriidx on pay_assignment_latest_balances (assignment_id,assignment_action_id) compute statistics; Index created. SQL> create index pay_person_latest_bal_giri on

14

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

pay_person_latest_balances (person_id, assignment_action_id, defined_balance_id, latest_balance_id) compute statistics; Index created.

28. Shutdown the database.


$ sqlplus / as sysdba SQL*Plus: Release 10.1.0.4.0 - Production on Mon Aug 20 16:32:27 2007 Copyright (c) 1982, 2005, Oracle. All rights reserved. Connected to: Oracle Database 10g Enterprise Edition Release 10.1.0.4.0 - 64bit Production With the Partitioning, OLAP and Data Mining options SQL> shutdown Database closed. Database dismounted. ORACLE instance shut down.

29. Since we had to reload the database after a few Load Runner tests, backup the database (*.dbf files) using the snapshot option. See the Taking a Snapshot of an Online Oracle Database section.

Installing Oracle Application Server 11i


The following steps describe how to install the Oracle Application Server 11i software and setup the middle tier. 1. Set up and configure the directory.
# mkdir /ebiz # useradd -d /export/home/oracle -s /bin/ksh oracle # passwd oracle (password: or04ebs) # chown oracle:dba /ebiz

2. 3.

Obtain the Oracle Benchmark APPLTOP tar files (visappl.tar, viscomn.tar, visora.tar), as well as the JDK 1.5 (jdk1.5.0_09.tar) and cache.jar files. Untar the APPLTOP tar files.
# cd /ebiz # tar xf jdk1.5.0_09.tar # tar xf visappl.tar # tar xf viscomn.tar # tar xf visora.tar

15

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

4.

Add the following line to the /export/home/oracle/.profile file.


ENV=/ebiz/visappl/APPSORA.env

5.

Make sure domainname returns proper domain name.


% domainname mpklab.sfbay.sun.com

6.

Edit the /etc/inet/hosts file. Make sure you use the private network IP addresses for the database server, application server, and Load Runner driver PC. Typical entries look like the following.
10.6.241.234 x4150-241-01.sfbay.sun.com x4150-241-01 10.6.240.162 t2000-240-10.sfbay.sun.com t2000-240-10 loghost 129.146.44.113 v20zwin-44-03.sfbay.sun.com v20zwin-44-03

7. 8.

Comment out ENV=/ebiz/visappl/APPSORA.env in the ~/.profile file. Disconnect from the terminal console and reconnect. Go to the scripts directory.
% cd /ebiz/viscomn/admin/scripts

9.

Make a copy of the files.


% cp -R VIS_ben05 VIS_`hostname`

10. Make a copy of the context file.


% grep CTX_FILE adautocfg.sh CTX_FILE="/ebiz/visappl/admin/VIS_ben05.xml" % cp /ebiz/visappl/admin/VIS_ben05.xml /ebiz/visappl/admin/VIS_`hostname`.xml

11. Edit the /ebiz/visappl/admin/VIS_hostname.xml context file.


* Check the database, application server names * Check the domain name * Edit AF_CLASSPATH and CLASSPATH to include /ebiz/cache.jar at the front * Edit 'KeepAliveTimeout' to 90 from 15 seconds * Make sure there aren't any extra entries under jdbc connection * LOAD_BALANCE=YES even though there is only one node <--- remove the extra/unnecessary nodes * Edit the JVM options * -verbose:gc -Xmx512M -Xms512M -XX:MaxPermSize=128M -XX:NewRatio=2 -XX:+PrintGCTimeStamps -XX:+UseTLE -XX:+UseParallelGC -XX:ParallelGCThreads=2 -Xverify: none -Xrs * Add -XX:LargePageSizeInBytes=4M on Niagara / Niagara 2 systems. Otherwise JVM

16

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

uses 256M pages for 'anon' segments that may increase the memory footprint * Add -XX:LargePageSizeInBytes=32M on Panther systems

In the case of multinode deployments (multiple application server nodes), you must use a hardware load balancer such as Oracles Sun Secure Application Switch N1400 to balance the application server load among the application servers. Without the switch, all the requests go to the last added application server (the application server node on which the AutoConfig script was run for the last time). In a multinode deployment, use the host/IP address of the load balancer for disco_machine, webentryhost, and login_page in the $CONTEXT_FILE file. 12. Run the /ebiz/viscomn/admin/scripts/VIS_`hostname`/adautocfg.sh script.
% ./adautocfg.sh Enter the APPS user password: AutoConfig is configuring the Applications environment... AutoConfig will consider the custom templates if present. Using APPL_TOP location : /ebiz/visappl Using java command : /ebiz/jdk1.5.0_09/bin/java Java version : 1.5.0_09 Classpath : /ebiz/jdk1.5.0_09/jre/lib/rt.jar:/ebiz/jdk1.5.0_09/lib/dt.jar:/ebiz/jdk1.5.0_09 /lib/tools.jar:/ebiz/viscomn/java/appsborg2.zip:/ebiz/viscomn/java Using Context file : /ebiz/visappl/admin/VIS_ben02.xml Context Value Management will now update the Context file Updating Context file...COMPLETED Attempting upload of Context file and templates to database...COMPLETED Configuring templates from all of the product tops... Configuring Configuring Configuring Configuring AD_TOP........COMPLETED FND_TOP.......COMPLETED ICX_TOP.......COMPLETED IEO_TOP.......COMPLETED

Configuring ABM_TOP.......COMPLETED Configuring ECX_TOP.......COMPLETED Configuring BIS_TOP.......COMPLETED Configuring GL_TOP........COMPLETED Configuring AMS_TOP.......COMPLETED Configuring CCT_TOP.......COMPLETED Configuring Configuring Configuring Configuring WSH_TOP.......COMPLETED CLN_TOP.......COMPLETED OKE_TOP.......COMPLETED OKL_TOP.......COMPLETED

Configuring OKS_TOP.......COMPLETED Configuring CSF_TOP.......COMPLETED Configuring XNC_TOP.......COMPLETED Configuring IGS_TOP.......COMPLETED Configuring IBY_TOP.......COMPLETED Configuring PA_TOP........COMPLETED Configuring JTF_TOP.......COMPLETED

17

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

Configuring MWA_TOP.......COMPLETED Configuring CN_TOP........COMPLETED Configuring CSI_TOP.......COMPLETED Configuring WIP_TOP.......COMPLETED Configuring CSE_TOP.......COMPLETED Configuring Configuring Configuring Configuring EAM_TOP.......COMPLETED IMT_TOP.......COMPLETED FTE_TOP.......COMPLETED ONT_TOP.......COMPLETED

Configuring AR_TOP........COMPLETED Configuring AHL_TOP.......COMPLETED Configuring OZF_TOP.......COMPLETED Configuring IES_TOP.......COMPLETED Configuring CSD_TOP.......COMPLETED Configuring IGC_TOP.......COMPLETED AutoConfig completed successfully. The log file for this session is located at: /ebiz/visappl/admin/VIS_ben02/log/08201504/adconfig.log

13. Uncomment ENV=/ebiz/visappl/APPSORA.env in the ~/.profile file. Disconnect from the terminal console and reconnect. 14. Connect to the database as the APPS user, and check the FND_NODES table.
% sqlplus apps/apps@VIS SQL*Plus: Release 8.0.6.0.0 - Production on Mon Jan 15 05:22:17 2007 (c) Copyright 1999 Oracle Corporation. All rights reserved. Connected to: Oracle Database 10g Enterprise Edition Release 10.2.0.2.0 - Production With the Partitioning, OLAP and Data Mining options SQL> select NODE_NAME, SERVER_ADDRESS from fnd_nodes; NODE_NAME SERVER_ADDRESS ------------------------------ -----------------------------AUTHENTICATION * X4150-241-01 T2000-240-10 10.6.240.162

15. Add the following two lines to the /ebiz/visora/iAS/Apache/Jserv/etc/jserv.properties file after the wrapper.bin.parameters=-DLONG_RUNNING_JVM=true entry.
#STO - Workaround for bug 4129750 wrapper.bin.parameters=-DCACHEMODE=DISTRIBUTED

16. Increase OACoreGroup JVMs to 10 from 1 in the /ebiz/visora/iAS/Apache/Jserv/etc/jserv.conf file. (This assumes the application server is being configured for 1,000 online users.) 17. Set ApJServLocalRouteAffinity to OFF in the /ebiz/visora/iAS/Apache/Jserv/etc/jserv.conf file. This step ensures no log activity to the /ebiz/visora/iAS/Apache/Jserv/logs/jvm/mod_jserv.log file.

18

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

18. Update APPL_SERVER_ID.


# cd $FND_SECURE # cp <db_server_host>_vis.dbc vis.dbc

19. Start the listener.


% lsnrctl start APPS_VIS LSNRCTL for Solaris: Version 8.0.6.3.0 - Production on 15-JAN-2007 05:33:46 (c) Copyright 1999 Oracle Corporation. All rights reserved. Starting /ebiz/visora/8.0.6/bin/tnslsnr: please wait... TNSLSNR for Solaris: Version 8.0.6.3.0 - Production Log messages written to /ebiz/visora/8.0.6/network/admin/apps_vis.log Listening on: (ADDRESS=(PROTOCOL=tcp)(DEV=10)(HOST=10.6.240.162)(PORT=1626)) Connecting to (ADDRESS=(PROTOCOL=TCP)(Host=t2000-240-10)(Port=1626)) STATUS of the LISTENER -----------------------Alias APPS_VIS Version TNSLSNR for Solaris: Version 8.0.6.3.0 - Production Start Date 15-JAN-2007 05:33:49 Uptime 0 days 0 hr. 0 min. 0 sec Trace Level off Security OFF SNMP OFF Listener Log File /ebiz/visora/8.0.6/network/admin/apps_vis.log Services Summary... FNDFS has 1 service handler(s) FNDSM has 1 service handler(s) The command completed successfully % netstat -a | grep 1626 *.1626 *.* 0 0 49152 0 LISTEN

20. On Oracle Solaris 10 and later systems, disable the Web console. It is not useful for this benchmark project and it consumes some memory by running a java process as noaccess user.
# svcadm -v disable webconsole svc:/system/webconsole:console disabled.

21. Add some swap space.


# mkfile 3072M /extraswap ls -l /extraswap -rw------T 1 root root 3221225472 Jan 15 05:37 /extraswap # swap -a /extraswap # swap -l swapfile dev swaplo blocks free /dev/dsk/c0t0d0s1 32,1 16 2106416 2106416 /extraswap - 16 6291440 6291440

19

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

22. Set the following TCP/IP parameters.


# ndd -set /dev/tcp tcp_time_wait_interval 60000 # ndd -set /dev/tcp tcp_conn_req_max_q 1024 # ndd -set /dev/tcp tcp_conn_req_max_q0 4096 # ndd -set /dev/tcp tcp_ip_abort_interval 60000 # # # # ndd ndd ndd ndd -set -set -set -set /dev/tcp /dev/tcp /dev/tcp /dev/tcp tcp_keepalive_interval 900000 tcp_rexmit_interval_initial 3000 tcp_rexmit_interval_max 10000 tcp_rexmit_interval_min 3000

# ndd -set /dev/tcp tcp_smallest_anon_port 1024 # ndd -set /dev/tcp tcp_slow_start_initial 2 # ndd -set /dev/tcp tcp_xmit_hiwat 400000 # ndd -set /dev/tcp tcp_recv_hiwat 400000 # ndd -set /dev/tcp tcp_max_buf 4194304 # ndd -set /dev/tcp tcp_cwnd_max 2097152 # # # # ndd ndd ndd ndd -set -set -set -set /dev/tcp /dev/udp /dev/udp /dev/udp tcp_fin_wait_2_flush_interval 67500 udp_xmit_hiwat 400000 udp_recv_hiwat 400000 udp_max_buf 4194304

23. Start the application server processes.


# cd $COMMON_TOP/admin/scripts/VIS_`hostname` # adapcctl.sh start # adcmctl.sh start apps/apps # adfrmctl.sh start apps/apps

24. Check the process counts. Run the following script.


counts.sh echo Java count .. ps -eaf | grep java | grep -v grep | wc echo httpd count .. ps -eaf | grep httpd | grep -v grep | wc echo FND count .. ps -eaf | grep FND | grep -v grep | wc echo Forms count .. ps -eaf | grep f60 | grep -v grep | wc echo Reports count .. ps -eaf | grep ar60 | grep -v grep | wc

The script should return something similar to the output below.


Java count .. 16 184 2096 httpd count .. 21 252 2751 FND count ..

20

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

32 70 712 Forms count .. 2 21 199 Reports count .. 0 0 0

If you see less than 32 FND_* processes, most likely the concurrent managers are not up. Check step 25 below for setting up the concurrent managers. 25. Set up the content managers.
* In a web browser (IE 6.0 or later), bring up the Oracle Applications login page * http://<hostname>.<domainname>:8000 * eg., http://t2000-240-10.sfbay.sun.com:8000 * * * * Login -> Apps Logon Links -> Logon to E-Business Suite Home Login as OPERATIONS/WELCOME System Administrator responsibility Concurrent Manager -> Define

* In the applet: View -> Query By Example -> Enter * Search for the following concurrent managers and change the primary concurrent processing nodes: (enter the following strings in 'Manager' field and View -> Query By Example -> Run) 1) 2) 3) 4) Inventory Manager Standard Manager INV Remote Procedure Manager Internal Manager, and

5)Conflict Resolution Manager 6)

After this step, the process counts output should be similar to the output below.
% counts Java count .. 16 184 2096 httpd count .. 22 264 2882 FND count .. 32 381 4118 Forms count .. 2 21 199 Reports count .. 0 0 0

26. If the threads of O2C and/or Payroll batches need to be increased beyond 20, search for Standard Manager. Increase the cache size. Click on Work Shifts and increase Processes.

21

Oracle White PaperOracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems

27. Proactively set the Launch on date to the current date in the Campaign schedule to avoid Lead2Proposal script failures.
* Login as IASN1/welcome * Sales user responsibility * If you see the string "No data exists" under "Cross Sell/Up Sell Sales Campaign", you must take the following action: * Shortcuts -> Sales Campaigns * Status = Active, Start Date = today's date - 365 days i.e., last year's date, End Date = today's date. Go. * Select IeBS Sales Campaign Schedule under Results table * Modify "Launch On" to today's date * Click on Save * Click on "Sales Dashboard" link, scroll down and check the "Cross Sell/Up Sell Sales Campaign" table.

You must see IeBS Sales Campaign Schedule. If not, repeat the steps above until you see IeBS Sales Campaign Schedule under the Cross Sell/Up Sell Sales Campaign table.
Component Version Oracle Applications 11.5.10 Oracle Forms 6.0.8.24.1 Oracle Internet Application Server (Apache) 1.3.19 Oracle Database 10.2.0.2.0 JDK 1.5.0_09

References
TABLE 2. REFERENCES

Oracle 10.2, 11.1.x OS Specific Documentation Sun Storage 7000 Unified Storage Systems Documentation Oracle Architecture and Implementation Guide for Oracles Sun Storage 7000 Unified Storage Systems Oracle Database Deployment on a NFS Share Using Oracles Sun Storage 7000 Unified Storage Systems Disaster Recovery Solution for Oracle Databases Using Oracles Sun Storage 7000 Unified Storage Systems Backup and Recovery Solution for Oracle Databases Using Oracles Sun Storage 7000 Unified Storage Systems

22

Oracle E-Business Suite Deployment Guide Using Oracles Sun Storage 7000 Unified Storage Systems May 2010 Author: Arathi Krishnaiyengar Oracle Corporation World Headquarters 500 Oracle Parkway Redwood Shores, CA 94065 U.S.A.

Copyright 2010, Oracle and/or its affiliates. All rights reserved. This document is provided for information purposes only and the contents hereof are subject to change without notice. This document is not warranted to be error-free, nor subject to any other warranties or conditions, whether expressed orally or implied in law, including implied warranties and conditions of merchantability or fitness for a particular purpose. We specifically disclaim any liability with respect to this document and no contractual obligations are formed either directly or indirectly by this document. This document may not be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without our prior written permission. Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro

Worldwide Inquiries: Phone: +1.650.506.7000 Fax: +1.650.506.7200 oracle.com

Devices. Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. UNIX is a registered trademark licensed through X/Open Company, Ltd. 0310

You might also like