P. 1
OracleArchTuning2008

OracleArchTuning2008

|Views: 122|Likes:
Published by Papa_Igor

More info:

Published by: Papa_Igor on Jan 31, 2011
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

11/24/2012

pdf

text

original

IBM Oracle Solutions Advanced Technical Support - Americas

Oracle Configuration & Tuning with AIX AIX 5L & AIX 6

R. Ballough

Oracle10gR2 RAC for AIX Workshop

© 2007 IBM Corporation

IBM Oracle Solutions - Advanced Technical Support - Americas

Legal information
The information in this presentation is provided by IBM on an "AS IS" basis without any warranty, guarantee or assurance of any kind. IBM also does not provide any warranty, guarantee or assurance that the information in this paper is free from errors or omissions. Information is believed to be accurate as of the date of publication. You should check with the appropriate vendor to obtain current product information. Any proposed use of claims in this presentation outside of the United States must be reviewed by local IBM country counsel prior to such use. IBM,^ , and pSeries are trademarks or registered trademarks of the International Business Machines Corporation. Oracle and Oracle9i are trademarks or registered trademarks of Oracle Corporation. All other products or company names are used for identification purposes only, and may be trademarks of their respective owners.

2

Oracle10gR2 RAC for AIX Workshop

© 2007 IBM Corporation

IBM Oracle Solutions - Advanced Technical Support - Americas

AIX Configuration for Oracle “starting points”
The suggestions presented here are considered to be basic configuration “starting points” for general Oracle workloads Customer workloads will vary Ongoing performance monitoring and tuning is recommended to ensure that the configuration is optimal for the particular workload characteristics

3

Oracle10gR2 RAC for AIX Workshop

© 2007 IBM Corporation

IBM Oracle Solutions - Advanced Technical Support - Americas

Agenda
AIX Configuration/Tuning for Oracle
– Memory – CPU – I/O – Network – Miscellaneous

4

Oracle10gR2 RAC for AIX Workshop

© 2007 IBM Corporation

IBM Oracle Solutions .Americas Oracle Server Architecture – Memory Structures PMON SMON Archive Logs Program Global Area (PGA) System Global Area (SGA) ARC0 Redo Log Buffer LGWR Private SQL Area Shared Pool Database Buffer Cache DBWR User CHKP Control Files Online Redo Logs D000 Database Files 5 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .Advanced Technical Support .

Advanced Technical Support .IBM Oracle Solutions .Americas General Memory Tuning Memory Use testsys 8/2/2005 %comp 100 90 80 70 60 50 40 30 20 10 0 8:03 8:04 8:05 8:06 8:07 8:08 8:09 8:10 8:11 8:12 8:13 8:14 8:15 8:16 8:17 8:18 8:19 8:20 8:21 8:22 8:23 8:24 8:25 8:26 8:27 8:28 8:29 8:30 8:31 8:32 8:33 8:34 8:35 %file 6 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .

a number of the default vmo settings are not optimized for database workloads and should be modified for Oracle environments.Americas Memory Tools .IBM Advanced Technical Support . In AIX 6. the vmo defaults are Great for Oracle! 7 © 2005 IBM Corporation © 2003 IBM Corporation .Virtual Memory Manager (VMM) The AIX “vmo” command provides for the display and/or update of several parameters which influence the way AIX manages physical memory – The “-a” option displays current parameter settings vmo –a – The “-o” option is used to change parameter values vmo –o minfree=1440 – The “-p” option is used to make changes persist across a reboot vmo –p –o minfree=1440 In AIX 5L.

IBM Oracle Solutions .Americas VMM Tuning Definitions: VMM page stealing process = LRUD numperm. seen in ‘vmstat –v’ Parameters: MINPERM% = minimum % real memory for fs buffer cache MAXPERM%.numclient) < MINFREE When does LRUD stop? When total free pages > MAXFREE When (maxclient pages – numclient) > MAXFREE 8 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation . MAXCLIENT% = max % real memory for fs buffer cache When does LRUD start? When total free pages < MINFREE When (maxclient pages . numclient = used fs buffer cache pages.Advanced Technical Support .

2 ML4 MINPERM% 15-20: JFS or JFS2 filesystems without DIO or CIO 5%: RAW logical volumes JFS or JFS2 with DIO or CIO GPFS MAXPERM%. MAXCLIENT% 40-60: JFS or JFS2 filesystems without DIO or CIO <= 20: Raw logical volumes JFS or JFS2 with DIO or CIO GPFS Never more than 20 GB prior to AIX 5.Advanced Technical Support .3 To start. set to vmtune "numperm" value Reduce until vmstat freed (fr) to scanned (sr) ratio is 4:1 9 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .Americas VMM Tuning Pre AIX 5.IBM Oracle Solutions .

MAXCLIENT%=90 make this a threshold which is > (1-computational memory) STRICT_MAXPERM=0 (default) STRICT_MAXCLIENT=1 (default) 10 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .2ML4+ .3 LRU_FILE_REPAGE=0 LRU_POLL_INTERVAL=10ms LRU_FILE_REPAGE=0 tells lrud to page out file pages (filesystem buffer cache) rather than computational pages when numperm > minperm LRU_POLL_INTERVAL indicates the time period after which LRUD pauses and interrupts can be serviced.Americas VMM Tuning – AIX 5. MINPERM% =3 MAXPERM%.AIX 5.Advanced Technical Support . Default value of “0” means no preemption.IBM Oracle Solutions .

All tunables on the prior page are classified as ‘Restricted’.IBM Oracle Solutions . i.1 AIX 6.1 Configured By Default to be ‘correct’ for most workloads.Advanced Technical Support . – Only change if AIX Support Says So – Parameters will not be displayed unless the ‘-F’ option is used for VMO 11 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .Americas VMM Tuning AIX 6.e.

memory for a process is allocated from memory associated with the processor that caused the page fault.Americas Understanding Memory Pools LRUD operates per memory pool Memory pool configuration is controlled by the VMO parameter “memory_affinity” – Memory_affinity=1 = configure memory pools based on physical hardware configuration (DEFAULT) – Memory_affinity=0 = configure roughly uniform memory pools from any physical location Number can be seen with ‘vmstat –v |grep pools’ Size can only be seen using KDB By default. P590 / p595 MCM Architecture 12 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .IBM Oracle Solutions .Advanced Technical Support .

consider disabling Memory Affinity or upgrading AIX level: vmo –r –o memory_affinity=0 (requires a reboot) IY73792 required for 5300-01 and 5300-02 Code changes in TL5/TL6 solve most issues with unbalanced pool sizes Memory_affinity is also a ‘restricted’ tunable for AIX 6.g.Advanced Technical Support .1 13 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation . try basic vmo parameter or Oracle SGA/PGA tuning first If issues remain. use ‘kdb’ to check if memory pool sizes are unbalanced: KDB(1)> memp * VMP memp_frs+010000 00 memp_frs+010780 00 memp_frs+010280 01 memp_frs+010500 02 MEMP NB_PAGES FRAMESETS 000 00B1F9F4 000 001 003 00001BBC 006 007 001 00221C80 002 003 002 00221C80 004 005 NUMFRB 00B073DE 00000000 0021C3CB 0021CDDE Pages in pool Free pages If the pool sizes are not balanced.IBM Oracle Solutions . system paging or excessive lrud scanning activity) if memory pool sizes are unbalanced If there are paging or lrud related issues.Americas Memory Affinity… Not generally a benefit unless processes are bound to a particular processor It can exacerbate any page replacement algorithm issues (e.

8) x 6 x 2) ] / 2 vmo –o minfree= 720 –o maxfree=1448 -p 14 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .3: maxfree = minfree + (MAX(maxpgahead.2: minfree = 120 x # logical CPUs Consider increasing if vmstat “fre” column frequently approaches zero or if “vmstat –s” shows significant “free frame waits” maxfree AIX 5.3. ie Total minfree = minfree * # of memory pools Total maxfree = maxfree * # of memory pools Most workloads do not need to change minfree/maxfree defaults in AIX 5.2: maxfree = minfree + (MAX(maxpgahead.Advanced Technical Support . j2_maxPageReadAhead) * # logical CPUs)/ # mem pools AIX 5.IBM Oracle Solutions .Americas VMM Page Stealing Thresholds Minfree/maxfree values are per memory pool in AIX 5. j2_maxPageReadAhead) * # logical CPUs)/ Example: 6-way LPAR with SMT enabled. maxpgahead=8 and j2_maxPageReadAhead=128.3 or AIX 6 minfree AIX 5. 2 memory pools: minfree = 720 =(120 x 6 x 2) / 2 maxfree = 1488 = [1440 + (max(128.3: minfree = 120 x # logical CPUs /#mem pools AIX 5.

Americas General AIX memory tuning No requirements for allocating SGA SGA may be pinned on AIX. MAXCLIENT) Reduce Oracle SGA or PGA (9i or later) size Add physical memory 15 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation . paging space does not have to be large ½ memory + 4 GB Monitor paging activity: vmstat -s sar -r nmon Resolve paging issues: Reduce Filesystem cache size (MAXPERM.Advanced Technical Support .IBM Oracle Solutions . but IS NOT RECOMMENDED – we have better ways of keeping sga resident in memory Do not over commit real memory!!!! Server should be configured with enough physical memory to satisfy memory requirements Paging space With AIX demand paging.

MAXCLIENT) in AIX 5. but IS NOT RECOMMENDED – we have better ways of keeping sga resident in memory – Do not over commit real memory!!!! – Server should be configured with enough physical memory to satisfy memory requirements Paging space – With AIX demand paging.Advanced Technical Support .IBM Oracle Solutions .2 ML4+ – Reduce Oracle SGA or PGA (9i or later) size – Add physical memory 16 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation . paging space does not have to be large – ½ memory + 4GB Monitor paging activity: – vmstat -s – sar -r – nmon Resolve paging issues: – Reduce Filesystem cache size (MAXPERM.2ML3 or below – Set lru_file_repage=0 in AIX 5.Americas General AIX memory tuning No requirements for allocating SGA – SGA may be pinned on AIX.

SQL> alter system set db_cache_size=2048m scope=both. but has an upper bound by the parameter SGA_MAX_SIZE..Advanced Technical Support .Americas Changing SGA size Memory Oracle 9i or 10g SGA can be dynamically resized.IBM Oracle Solutions . 17 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation . etc. SGA_TARGET (10g) DB_CACHE_SIZE.. PGA_AGGREGATE_TARGET can be dynamically resized SGA_TARGET and PGA_AGGREGATE_TARGET are not hard limits Great way to facilitate the use of DLPAR with memory…. SHARED_POOL_SIZE.

960 SQLPLUS: SQL> show sga SQL> show parameters 18 © 2005 IBM Corporation © 2003 IBM Corporation .928.Americas Determining SGA size Statspack: SGA Memory Summary for DB: test01 Instance: test01 Snaps: 1046 -1047 SGA regions -----------------------------Database Buffers Fixed Size Redo Buffers Variable Size Size in Bytes ---------------16.210.448 2.584 1.371.241.IBM Advanced Technical Support .944 768.513.864.984 ---------------- sum 18.172.

IBM Oracle Solutions .Americas Agenda AIX Configuration/Tuning for Oracle – Memory – CPU – I/O – Network – Miscellaneous 19 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .Advanced Technical Support .

check explain plan 20 © 2005 IBM Corporation © 2003 IBM Corporation .IBM Advanced Technical Support .Americas CPU Considerations Oracle Parameters based on the # of CPUs – CPU_COUNT – DB_WRITER_PROCESSES – PARALLEL_MAX_SERVERS – FAST_START_PARALLEL_ROLLBACK – should be using UNDO instead – CBO – execution plan may be affected.

Americas Configuring virtual processors 21 © 2005 IBM Corporation © 2003 IBM Corporation .IBM Advanced Technical Support .

00% :© 2003 IBM Corporation © 2005 IBM Corporation .Americas Lparstat command # lparstat -i • • • • • • • • • • • • • • • • • • • • • • • • 22 Node Name Partition Name Partition Number Type Mode Entitled Capacity Partition Group-ID Shared Pool ID Online Virtual CPUs Maximum Virtual CPUs Minimum Virtual CPUs Online Memory Maximum Memory Minimum Memory Variable Capacity Weight Minimum Capacity Maximum Capacity Capacity Increment Maximum Physical CPUs in system Active Physical CPUs in system Active CPUs in Pool Unallocated Capacity Physical CPU Percentage Unallocated Weight : erpcc8 ::: Dedicated : Capped : 4.00 : 4.00 :::4 :4 :1 : 8192 MB : 9216 MB : 128 MB :: 1.00 : 1.IBM Advanced Technical Support .00 :4 :4 ::: 100.

UNCAPPED DLPAR considerations Oracle 9i – Oracle CPU count does not recognize change in # cpus – AIX scheduler can still use the added CPUs Oracle 10g/11g – Oracle CPU count recognizes change in # cpus up to 3x the number at database startup 23 © 2005 IBM Corporation © 2003 IBM Corporation .Virtual cpus<= physical processors in shared pool .IBM Advanced Technical Support .Americas CPU Considerations Use SMT where available Micropartitioning considerations .CAPPED Virtual CPUs should be the nearest integer >= capping limit Virtual CPUS should be set to the max peak demand requirement .

Advanced Technical Support .IBM Oracle Solutions .Americas Agenda AIX Configuration/Tuning for Oracle – Memory – CPU – I/O – Network – Miscellaneous 24 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .

Americas Oracle Server Architecture .IBM Oracle Solutions .Files PMON SMON Archive Logs Program Global Area (PGA) System Global Area (SGA) ARC0 Redo Log Buffer LGWR Private SQL Area Shared Pool Database Buffer Cache DBWR User CHKP Control Files Online Redo Logs D000 Database Files 25 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .Advanced Technical Support .

Advanced Technical Support .Americas Flashback database design 26 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .IBM Oracle Solutions .

etc. resource intensive and iterative Use RAID-5 or RAID-10 to create striped LUNs (hdisks) Create AIX Volume Group(s) (VG) w/ LUNs from multiple arrays. adapters..IBM Advanced Technical Support .com/support/techdocs/atsmastr.ibm.nsf/WebIndex/WP100319 27 © 2005 IBM Corporation © 2003 IBM Corporation ..Americas Data Layout for Optimal I/O Performance Stripe and mirror everything (SAME) approach: Goal is to balance I/O activity across all disks. Avoid/Eliminate I/O hotspots Manual file-by-file data placement is time consuming. loops. striping on the front end as well for maximum distribution http://www-1.

4M ASM – stripes by default when > 1 LUN configured per ASM disk group. JFS2. 256k. 16M.IBM Advanced Technical Support . Veritas VxFS) – use AIX PP or LV striping 28 © 2005 IBM Corporation © 2003 IBM Corporation . 2M. Strip size is 128k (Fine-grained) or 1M (Coarse-grained) – In 11g.Americas Data Layout Cont’d GPFS – stripes by default when > 1 LUN configured per filesystem. 4M.128k. Strip size (referred to as block size) may be 16k. 64M RAW or single-instance filesystems (eg JFS. 8M. 32M. 64k. au_size may be 1M. 1M. 2M.

64k.2: 4k. 4M.2 Strip sizes + 2M. 128M – Use AIX Logical Volume 0 offset (9i Release 2 or later) for RAW LVs Use Scalable Volume Groups (VGs). 8k.1: AIX 5. 32k. 16 MB.IBM STG Technical Conference Data Layout – LV & PP striping LV Striping – Oracle recommends stripe width of a multiple of Db_block_size * db_file_multiblock_read_count Usually around 1 MB – Valid LV Strip sizes: AIX 5. 64M. 128k. 512k. or use “mklv –T O” with Big VGs Requires AIX APAR IY36656 and Oracle patch (bug 2620053) PP Striping – Use minimum Physical Partition (PP) size (mklv -t. 1 MB AIX 5. -s parms) Spread AIX Logical Volume (LV) PPs across multiple hdisks in VG (mklv –e x) 29 © 2007 IBM Corporation . 32M.3/6. 256k. 16k.

memory pages released after pages copied to internal buffers – Release Behind Write (RBW) – During sequential writes. Oracle issues o_cio and o_dio calls as appropriate 30 © 2007 IBM Corporation .IBM STG Technical Conference Single Instance Environments . DIO and CIO must be specified at the filesystem level In 10g/11g.Filesystems Filesystems JFS – no longer being enhanced Better for lots of small file creates & deletes JFS2 – generally the preferred single-instance filesystem – Better for large files/filesystems Mount options: – – – – Buffer Caching (default)– stage data in fs buffer cache Direct I/O (DIO)– no caching on reads Concurrent I/O (CIO) – DIO + no write lock (JFS2 only) Release Behind Read (RBR)– During sequential reads. memory pages released after pages written to disk In 9i.

fs buffer cache isn’t used. #360287. set filesystemio_options=ASYNCH and use dio or cio mount option In 10g/11g.Advanced Technical Support .1 31 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation . JFS2 caching: In 9i. To enable caching for JFS/JFS2: Use default filesystem mount options Set Oracle filesystemio_options=ASYNCH DIO tends to benefit heavily random access workloads and CIO tends to benefit heavy update workloads.IBM Oracle Solutions . Consider the following db changes: Increase db_cache_size Increase db_file_multiblock_read_count Read Metalink Notes #257338.1. To disable JFS. non-Cached (Direct) I/O File System caching tends to benefit heavily sequential workloads with low write content.Americas Single-instance environments Cached vs. set filesystemio_options=SETALL When using DIO/CIO.

DIO.for flashback logs. and backup logs Flashback Log files should use CIO. dbca will use a single location – the flash recovery area . archive logs. use a filesystem block size of 4096. else use 2048 Redo Log/Control Files I/O size is always a multiple of 512 bytes Use CIO or DIO and set filesystem block size to 512 Archive Log Files Do not use CIO or DIO ‘rbrw’ mount option can be advantageous Flashback Log Files Writes are sequential.IBM STG Technical Conference Single-instance environments . or rbrw Oracle Binaries Do not use CIO or DIO 32 © 2007 IBM Corporation .Oracle Database Files Data Base Files (DBF) I/O size is db_block_size or db_block_size * db_file_multiblock_read_count Use CIO or no mount options for extremely sequential I/O If block size is >=4096. sized as a multiple of db_block_size By default.

IBM Oracle Solutions . 128 (JFS2) Set equal to (or multiple of) size of largest Oracle I/O request DB_BLOCK_SIZE * DB_FILE_MULTI_BLOCK_READ_COUNT Number of buffer structures per filesystem: j2_dynamicBufferPreallocation Default: 16 Monitor with “vmstat –v”. increase if value of “external pager filesystem I/Os blocked with no fsbuf “is increasing 33 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .I/O Tuning (ioo) READ-AHEAD (Only applicable to JFS/JFS2 with caching enabled) MINPGAHEAD (JFS) or j2_minPageReadAhead (JFS2) Default: 2 Starting value: MAX(2.DB_BLOCK_SIZE / 4096) MAXPGAHEAD (JFS) or j2_maxPageReadAhead (JFS2) Default: 8 (JFS).Americas Single-instance environments .Advanced Technical Support .

3 (default) uses Threaded Asynchronous I/O – AIX 5. maxservers.1 maxreqs=4096 AIX 6. 5. and GPFS CIO access differs between AIX versions: – AIX 5.1 Defaults (set with ioo): aio_minservers=3 per cpu * DYNAMIC aio_maxservers=30 per cpu * DYNAMIC aio_maxreqs=16384 34 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .x Defaults (set in SMIT AIO menu): minservers=1 per system maxservers=10 per CPU in AIX 5.2/5. seen in Ioo as aio_fsfastpath=1 (restricted parameter) AIX parameters AIX 5. maxreqs parameters configured UNLESS asynchronous I/O access is used for other filesystems Threaded Asynchronous I/O is used for asynchronous I/O access to filesystem including JFS. and does not need to have minservers.Advanced Technical Support .2.IBM Oracle Solutions . per SYSTEM in AIX 5.Americas Asynchronous I/O Oracle on AIX uses either Threaded Asynchronous I/O. JFS2.3.1 uses Fastpath Asychronous I/O by default. or Kernel Asynchronous I/O (also called FastPath) All Oracle installations on AIX 5L should have the following parameters set from the SMIT AIO menu: – STATE to be configured at system restart: AVAILABLE – State of fast path: ENABLE AIX 6 does this for you…. Raw device access (including ASM) uses FastPath Asynchronous I/O.3 TL5 with aioo –o fsfastpath=1 uses Fastpath Asynchronous I/O (BEWARE – doesn’t persist across reboots!) – AIX 6.

2/5.maxreqs default Oracle parameters disk_asynch_io = TRUE filesystemio_options = {ASYNCH | SETALL} db_writer_processes = default Monitor usage: Watch alert.1 (non-CIO): maxservers=200 minservers.3: minservers=100 maxservers=200 maxreqs=16384 Typical settings for AIX 6.Americas Asynchronous I/O for filesystem environments AIX parameters OLD FORMULA WHICH GENERALLY DOESN’T WORK: minservers = 10 * # cpus maxservers = (10 * # disks) / # cpus maxreqs = a multiple of 4096 > 4 * #disks * queue_depth GENERAL RECOMMENDATION – WORKS FOR MOST ENVIRONMENTS: Typical settings for AIX 5.Advanced Technical Support .trc files in BDUMP directory for errors: Warning “lio_listio returned EAGAIN” Monitor from AIX “pstat –a | grep aios” Use “-A” option for NMON Iostat –Aq (new in AIX 5.3) 35 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .log and *.IBM Oracle Solutions .

Advanced Technical Support .1 Async I/O: Oracle parameter filesystemio_options is ignored Set Oracle parameter disk_asynch_io=TRUE Worker1threads = GPFS asynch I/O Prefetchthreads= exactly what the name says Worker1threads +prefetchThreads<=550 Usually set prefetchthreads=default (64) and worker1threads=550prefetchthreads Set aio maxservers=(worker1threads/#cpus) + 10 Other settings: GPFS block size is configurable. not used for RAC but may be for binaries.IBM Oracle Solutions .Americas GPFS tunables See metalink note 302806. most will use 512KB-1MB Pagepool – GPFS fs buffer cache. Default=64M mmchconfig pagepool=100M Ipqmaxlen=512 No –r –o ipqmaxlen=512 36 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .

Americas ASM configurations AIX parameters – Async I/O needs to be enabled. where n=# of instances using ASM – DB instance parameters – – – – – disk_asynch_io=TRUE filesystemio_options=ASYNCH Increase Processes by 16 Increase Large_Pool by 600k Increase Shared_Pool by [(1M per 100GB of usable space) + 2M] Cool new thing in AIX 6. but default values may be used ASM instance parameters – ASM_POWER_LIMIT=1 Makes ASM rebalancing a low-priority operation. May be changed dynamically. then increase to a higher value during maintenance windows PROCESSES=25+ 15n.IBM Oracle Solutions .1 – ‘mkvg’ command will not create a VG on an ASM disk – even if you use the ‘-f’ !! 37 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation . It is common to set this value to 0.Advanced Technical Support .

and thus either need PVIDs OR need to be given another device name assigned by major/minor # – # mknod /dev/ocr c <major # of OCR LUN> <minor # of OCR LUN> Why not just put a PVID on all LUNs anyway? Assigning or clearing a PVID will overwrite the ASM header. making data unrecoverable without the use of KFED.1 38 © 2007 IBM Corporation .To PVID or not To PVID? What is a PVID? A physical volume identifier How is it applied? ‘chdev’ writes this identifier on a LUN and updates the ODM such that an hdisk# is mapped directly to this identifier. so PVIDs are not necessary with ASM disk OCR and Voting devices. however.IBM STG Technical Conference ASM LUNs . See Metalink Note 353761. do not fall into this category. This allows the preservation of an assigned hdisk# across reboots and storage reconfigurations What does this look like? # lspv hdisk5 00c3e35ca560f919 None Do I need PVIDs with ASM? “it depends” ASM preserves its own mapping between LUNs and assignments in ASM disk groups. This is a common issue when adding a node to a RAC cluster where customer procedures include adding a PVID.

IBM Oracle Solutions .ibm.Advanced Technical Support .aix.boulder. set parameters for each interface using ‘ifconfig’ or ‘chdev’ Refer to the following URL for a chart on appropriate interface-specific parameters: http://publib.prftungd/doc/prftungd/prftungd.pdf Generally appropriate parameters for gigabit ethernet Oracle interfaces: tcp_sendspace = 262144 tcp_recvspace = 262144 rfc1323=1 39 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .ibm.1 use_isno=0 means that parameters set with ‘no’ override interface-specific parameters If use_isno=0.Americas Network Parameters – all environments use_isno=1 means parameters set at the interface level override parameters set with ‘no’ DEFAULT (restricted) in AIX 6.com/infocenter/systems/topic/com. set parameters globally using ‘no’ command If use_isno=1.

Americas Additional Network Parameters for RAC: Set udp_sendspace = db_block_size * db_file_multiblock_read_count +4k • (generally 65536) Set udp_recvspace = 10 * udp_sendspace – Must be < sb_max.IBM Advanced Technical Support . generally set sb_max=udp_recvspace – Increase if buffer overflows occur Ipqmaxlen=512 for GPFS environments Use Jumbo Frames if supported at the switch layer Examples: no -a |grep udp_sendspace no –o -p udp_sendspace=65536 netstat -s |grep "socket buffer overflows" 40 © 2006 IBM Corporation © 2003 IBM Corporation .

IBM Oracle Solutions .1) AIXTHREAD_SCOPE=S Use a 64-bit kernel Time synchronization – use the “-x” flag with xntpd 41 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .Advanced Technical Support .Americas Miscellaneous parameters /etc/security/limits Set to “-1” for everything except core for Oracle user Sys0 attribute maxuproc > Oracle ‘processes’ parameter (generally 4096 ok) Environment variables (not needed with AIX 6.

IBM Oracle Solutions . iostat.com – Monitor alert.com – vmstat. enabled by default – Insight for Oracle – Tool provided by IBM. lparstat.ibm.Americas Performance Monitoring Toolkit Database Tools: – Statspack (8i-10g) – Must be configured. nfso. netstat.trc files regularly AIX Tools: – NMON (unsupported) – Download from www. schedo – mmfsadm dump config (GPFS) 42 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation . ioo. not enabled by default – Automatic Workload Repository (AWR) – 10g/11g only.ibm. no.Advanced Technical Support .log & . svmon. download from www. ipcs – vmo.

html Oracle (Metalink) Certification Info: http://otn.oracle.Advanced Technical Support .1 IBM Redbooks: (www.ibm.oracle.html Oracle Whitepapers: http://otn.Americas Oracle Documentation Oracle Reference Manuals: http://otn.com/support/techdocs 43 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .oracle.com/documentation/index.pdf Oracle Metalink: http://metalink.html Oracle Database 10g Release 2 Automatic Storage Management Overview and Technical Best Practices http://www.com – 282036.com/redbooks) Techdocs – Technical Sales Library: http://www.oracle.com/technology/products/database/asm/pdf/asm_10gr2_bptw p_sept05.IBM Oracle Solutions .ibm.com/products/database/clustering/RACWhitepapers.oracle.com/support/metalink/index.

Americas QUESTIONS ANSWERS 44 Oracle10gR2 RAC for AIX Workshop © 2007 IBM Corporation .Advanced Technical Support .IBM Oracle Solutions .

You're Reading a Free Preview

Download
scribd
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->