Fri Feb 17 04:45:51 2012 Starting ORACLE instance (normal) LICENSE_MAX_SESSION = 0 LICENSE_SESSIONS_WARNING = 0 Interface type 1 eth1 10.10.10.

0 configured from OCR for use as a cluster interc onnect Interface type 1 eth0 192.168.7.0 configured from OCR for use as a public inter face Shared memory segment for instance monitoring created Picked latch-free SCN scheme 2 Autotune of undo retention is turned on. LICENSE_MAX_USERS = 0 SYS auditing is disabled ksdpec: called for event 13740 prior to event group initialization Starting up ORACLE RDBMS Version: 10.2.0.1.0. System parameters with non-default values: processes = 150 spfile = +DATA/orcl/spfileorcl.ora sga_target = 452984832 control_files = +DATA/orcl/controlfile/current.256.775452311 db_block_size = 8192 compatible = 10.2.0.1.0 log_archive_dest_1 = LOCATION=+DATA/orcl/ log_archive_format = %t_%s_%r.dbf db_file_multiblock_read_count= 16 cluster_database = TRUE cluster_database_instances= 2 db_create_file_dest = +DATA thread = 2 instance_number = 2 undo_management = AUTO undo_tablespace = UNDOTBS2 remote_login_passwordfile= EXCLUSIVE db_domain = dispatchers = (PROTOCOL=TCP) (SERVICE=orclXDB) job_queue_processes = 10 background_dump_dest = /opt/oracle/admin/orcl/bdump user_dump_dest = /opt/oracle/admin/orcl/udump core_dump_dest = /opt/oracle/admin/orcl/cdump audit_file_dest = /opt/oracle/admin/orcl/adump db_name = orcl open_cursors = 300 pga_aggregate_target = 149946368 Cluster communication is configured to use the following interface(s) for this i nstance 10.10.10.1 Fri Feb 17 04:45:52 2012 cluster interconnect IPC version:Oracle UDP/IP IPC Vendor 1 proto 2 PMON started with pid=2, OS id=8244 DIAG started with pid=3, OS id=8246 PSP0 started with pid=4, OS id=8248 LMON started with pid=5, OS id=8250 LMD0 started with pid=6, OS id=8252 LMS0 started with pid=7, OS id=8254 LMS1 started with pid=8, OS id=8264 MMAN started with pid=9, OS id=8291 DBW0 started with pid=10, OS id=8298 LGWR started with pid=11, OS id=8303 CKPT started with pid=12, OS id=8305

SMON started with pid=13, OS id=8307 RECO started with pid=14, OS id=8309 CJQ0 started with pid=15, OS id=8311 MMON started with pid=16, OS id=8313 Fri Feb 17 04:45:54 2012 starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL =TCP))'... MMNL started with pid=17, OS id=8315 Fri Feb 17 04:45:55 2012 starting up 1 shared server(s) ... Fri Feb 17 04:45:55 2012 lmon registered with NM - instance id 2 (internal mem no 1) Fri Feb 17 04:45:57 2012 Reconfiguration started (old inc 0, new inc 4) List of nodes: 0 1 Global Resource Directory frozen * allocate domain 0, invalid = TRUE Communication channels reestablished * domain 0 valid = 1 according to instance 0 Fri Feb 17 04:45:58 2012 Master broadcasted resource hash value bitmaps Non-local Process blocks cleaned out Fri Feb 17 04:45:58 2012 LMS 0: 0 GCS shadows cancelled, 0 closed Fri Feb 17 04:45:58 2012 LMS 1: 0 GCS shadows cancelled, 0 closed Set master node info Submitted all remote-enqueue requests Dwn-cvts replayed, VALBLKs dubious All grantable enqueues granted Fri Feb 17 04:45:58 2012 LMS 1: 0 GCS shadows traversed, 0 replayed Fri Feb 17 04:45:58 2012 LMS 0: 0 GCS shadows traversed, 0 replayed Fri Feb 17 04:45:58 2012 Submitted all GCS remote-cache requests Fix write in gcs resources Reconfiguration complete LCK0 started with pid=20, OS id=8419 Fri Feb 17 04:46:00 2012 ALTER DATABASE MOUNT Fri Feb 17 04:46:00 2012 Starting background process ASMB ASMB started with pid=22, OS id=8433 Starting background process RBAL RBAL started with pid=23, OS id=8456 Fri Feb 17 04:46:10 2012 SUCCESS: diskgroup DATA was mounted Fri Feb 17 04:46:14 2012 Setting recovery target incarnation to 1 Fri Feb 17 04:46:14 2012 Successful mount of redo thread 2, with mount id 1303263921 Fri Feb 17 04:46:14 2012 Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE) Completed: ALTER DATABASE MOUNT Fri Feb 17 04:46:15 2012 ALTER DATABASE OPEN Picked broadcast on commit scheme to generate SCNs Fri Feb 17 04:46:18 2012

LGWR: STARTING ARCH PROCESSES ARC0 started with pid=28, OS id=8835 Fri Feb 17 04:46:18 2012 ARC0: Archival started ARC1: Archival started LGWR: STARTING ARCH PROCESSES COMPLETE ARC1 started with pid=29, OS id=8837 Fri Feb 17 04:46:18 2012 Thread 2 opened at log sequence 1 Current log# 3 seq# 1 mem# 0: +DATA/orcl/onlinelog/group_3.265.775454161 Fri Feb 17 04:46:18 2012 ARC0: STARTING ARCH PROCESSES Fri Feb 17 04:46:19 2012 ARC1: Becoming the 'no FAL' ARCH ARC1: Becoming the 'no SRL' ARCH Fri Feb 17 04:46:19 2012 Successful open of redo thread 2 Fri Feb 17 04:46:19 2012 MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set Fri Feb 17 04:46:19 2012 SMON: enabling cache recovery Fri Feb 17 04:46:19 2012 ARC2: Archival started ARC0: STARTING ARCH PROCESSES COMPLETE ARC0: Becoming the heartbeat ARCH ARC2 started with pid=30, OS id=8839 Fri Feb 17 04:46:20 2012 Successfully onlined Undo Tablespace 4. Fri Feb 17 04:46:20 2012 SMON: enabling tx recovery Fri Feb 17 04:46:20 2012 Database Characterset is ZHS16GBK replication_dependency_tracking turned off (no async multimaster replication fou nd) Starting background process QMNC QMNC started with pid=31, OS id=8986 Fri Feb 17 04:46:25 2012 Completed: ALTER DATABASE OPEN Fri Feb 17 04:52:19 2012 Shutting down archive processes Fri Feb 17 04:52:24 2012 ARCH shutting down ARC2: Archival stopped Fri Feb 17 05:58:58 2012 Reconfiguration started (old inc 4, new inc 6) List of nodes: 1 Global Resource Directory frozen * dead instance detected - domain 0 invalid = TRUE Communication channels reestablished Master broadcasted resource hash value bitmaps Non-local Process blocks cleaned out Fri Feb 17 05:58:58 2012 LMS 0: 0 GCS shadows cancelled, 0 closed Fri Feb 17 05:58:58 2012 LMS 1: 0 GCS shadows cancelled, 0 closed Set master node info Submitted all remote-enqueue requests Dwn-cvts replayed, VALBLKs dubious All grantable enqueues granted

Post SMON to start 1st pass IR Fri Feb 17 05:58:58 2012 LMS 0: 2036 GCS shadows traversed, 0 replayed Fri Feb 17 05:58:58 2012 LMS 1: 2021 GCS shadows traversed, 0 replayed Fri Feb 17 05:58:58 2012 Submitted all GCS remote-cache requests Post SMON to start 1st pass IR Fix write in gcs resources Reconfiguration complete Fri Feb 17 05:58:58 2012 Instance recovery: looking for dead threads Instance recovery: lock domain invalid but no dead threads Fri Feb 17 06:07:50 2012 ospid 8252: network interface with IP address 10.10.10.1 shows failure requested interface 10.10.10.1 is not RUNNING. Check output from ifconfig comman d Fri Feb 17 06:08:50 2012 ospid 8252: network interface with IP address 10.10.10.1 is operational Fri Feb 17 06:14:18 2012 Reconfiguration started (old inc 6, new inc 8) List of nodes: 0 1 Global Resource Directory frozen Communication channels reestablished * domain 0 valid = 1 according to instance 0 Fri Feb 17 06:14:19 2012 Master broadcasted resource hash value bitmaps Non-local Process blocks cleaned out Fri Feb 17 06:14:19 2012 LMS 1: 0 GCS shadows cancelled, 0 closed Fri Feb 17 06:14:19 2012 LMS 0: 0 GCS shadows cancelled, 0 closed Set master node info Submitted all remote-enqueue requests Dwn-cvts replayed, VALBLKs dubious All grantable enqueues granted Fri Feb 17 06:14:19 2012 LMS 1: 2307 GCS shadows traversed, 1189 replayed Fri Feb 17 06:14:19 2012 LMS 0: 2376 GCS shadows traversed, 1199 replayed Fri Feb 17 06:14:19 2012 Submitted all GCS remote-cache requests Fix write in gcs resources Reconfiguration complete Fri Feb 17 06:25:37 2012 Starting background process EMN0 Fri Feb 17 06:27:34 2012 ERROR: Emon failed to start. Shutting down instance: further logons disabled Fri Feb 17 06:27:35 2012 Errors in file /opt/oracle/admin/orcl/bdump/orcl2_pmon_8244.trc: ORA-00443: background process "EMN0" did not start Fri Feb 17 06:37:04 2012 kkjcre1p: unable to spawn jobq slave process, error 1089 Fri Feb 17 06:41:46 2012 Trace dumping is performing id=[cdmp_20120217064146] Fri Feb 17 06:41:57 2012 Errors in file /opt/oracle/admin/orcl/bdump/orcl2_asmb_8433.trc: ORA-15064: communication failure with ASM instance

ORA-03113: end-of-file on communication channel Fri Feb 17 06:41:57 2012 ASMB: terminating instance due to error 15064 Fri Feb 17 06:41:57 2012 Errors in file /opt/oracle/admin/orcl/bdump/orcl2_lmd0_8252.trc: ORA-15064: communication failure with ASM instance Fri Feb 17 06:41:57 2012 Errors in file /opt/oracle/admin/orcl/bdump/orcl2_pmon_8244.trc: ORA-15064: communication failure with ASM instance Fri Feb 17 06:41:57 2012 Errors in file /opt/oracle/admin/orcl/bdump/orcl2_lms0_8254.trc: ORA-15064: communication failure with ASM instance Fri Feb 17 06:41:57 2012 Errors in file /opt/oracle/admin/orcl/bdump/orcl2_smon_8307.trc: ORA-15064: communication failure with ASM instance Fri Feb 17 06:41:57 2012 Errors in file /opt/oracle/admin/orcl/bdump/orcl2_lms1_8264.trc: ORA-15064: communication failure with ASM instance Fri Feb 17 06:41:58 2012 Errors in file /opt/oracle/admin/orcl/bdump/orcl2_lmon_8250.trc: ORA-15064: communication failure with ASM instance Fri Feb 17 06:42:00 2012 System state dump is made for local instance System State dumped to trace file /opt/oracle/admin/orcl/bdump/orcl2_diag_8246.t rc Fri Feb 17 06:42:01 2012 Trace dumping is performing id=[cdmp_20120217064200] Fri Feb 17 07:33:40 2012 Starting ORACLE instance (normal) LICENSE_MAX_SESSION = 0 LICENSE_SESSIONS_WARNING = 0 Interface type 1 eth1 10.10.10.0 configured from OCR for use as a cluster interc onnect Interface type 1 eth0 192.168.7.0 configured from OCR for use as a public inter face Picked latch-free SCN scheme 2 Autotune of undo retention is turned on. LICENSE_MAX_USERS = 0 SYS auditing is disabled ksdpec: called for event 13740 prior to event group initialization Starting up ORACLE RDBMS Version: 10.2.0.1.0. System parameters with non-default values: processes = 150 __shared_pool_size = 125829120 __large_pool_size = 4194304 __java_pool_size = 4194304 __streams_pool_size = 0 spfile = +DATA/orcl/spfileorcl.ora sga_target = 452984832 control_files = +DATA/orcl/controlfile/current.256.775452311 db_block_size = 8192 __db_cache_size = 310378496 compatible = 10.2.0.1.0 log_archive_dest_1 = LOCATION=+DATA/orcl/ log_archive_format = %t_%s_%r.dbf db_file_multiblock_read_count= 16 cluster_database = TRUE cluster_database_instances= 2 db_create_file_dest = +DATA thread = 2

instance_number = 2 undo_management = AUTO undo_tablespace = UNDOTBS2 remote_login_passwordfile= EXCLUSIVE db_domain = dispatchers = (PROTOCOL=TCP) (SERVICE=orclXDB) job_queue_processes = 10 background_dump_dest = /opt/oracle/admin/orcl/bdump user_dump_dest = /opt/oracle/admin/orcl/udump core_dump_dest = /opt/oracle/admin/orcl/cdump audit_file_dest = /opt/oracle/admin/orcl/adump db_name = orcl open_cursors = 300 pga_aggregate_target = 149946368 Cluster communication is configured to use the following interface(s) for this i nstance 10.10.10.1 Fri Feb 17 07:33:41 2012 cluster interconnect IPC version:Oracle UDP/IP IPC Vendor 1 proto 2 PMON started with pid=2, OS id=30243 DIAG started with pid=3, OS id=30245 PSP0 started with pid=4, OS id=30247 LMON started with pid=5, OS id=30249 LMD0 started with pid=6, OS id=30251 LMS0 started with pid=7, OS id=30253 LMS1 started with pid=8, OS id=30263 MMAN started with pid=9, OS id=30273 DBW0 started with pid=10, OS id=30275 LGWR started with pid=11, OS id=30288 CKPT started with pid=12, OS id=30300 SMON started with pid=13, OS id=30306 RECO started with pid=14, OS id=30308 CJQ0 started with pid=15, OS id=30310 MMON started with pid=16, OS id=30312 Fri Feb 17 07:33:43 2012 starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL =TCP))'... MMNL started with pid=17, OS id=30314 Fri Feb 17 07:33:43 2012 starting up 1 shared server(s) ... Fri Feb 17 07:33:43 2012 lmon registered with NM - instance id 2 (internal mem no 1) Fri Feb 17 07:33:45 2012 Reconfiguration started (old inc 0, new inc 4) List of nodes: 0 1 Global Resource Directory frozen * allocate domain 0, invalid = TRUE Communication channels reestablished * domain 0 valid = 0 according to instance 0 Fri Feb 17 07:33:46 2012 Master broadcasted resource hash value bitmaps Non-local Process blocks cleaned out Fri Feb 17 07:33:46 2012 LMS 0: 0 GCS shadows cancelled, 0 closed Fri Feb 17 07:33:46 2012 LMS 1: 0 GCS shadows cancelled, 0 closed Set master node info Submitted all remote-enqueue requests

Dwn-cvts replayed, VALBLKs dubious All grantable enqueues granted Fri Feb 17 07:33:46 2012 LMS 0: 0 GCS shadows traversed, 0 replayed Fri Feb 17 07:33:46 2012 LMS 1: 0 GCS shadows traversed, 0 replayed Fri Feb 17 07:33:46 2012 Submitted all GCS remote-cache requests Fix write in gcs resources Reconfiguration complete LCK0 started with pid=20, OS id=30374 Fri Feb 17 07:33:48 2012 ALTER DATABASE MOUNT Fri Feb 17 07:33:57 2012 Starting background process ASMB ASMB started with pid=22, OS id=30608 Starting background process RBAL RBAL started with pid=23, OS id=30612 Fri Feb 17 07:34:01 2012 SUCCESS: diskgroup DATA was mounted Fri Feb 17 07:34:05 2012 Setting recovery target incarnation to 1 Fri Feb 17 07:34:06 2012 Successful mount of redo thread 2, with mount id 1303219796 Fri Feb 17 07:34:06 2012 Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE) Completed: ALTER DATABASE MOUNT Fri Feb 17 07:34:07 2012 ALTER DATABASE OPEN Picked broadcast on commit scheme to generate SCNs Fri Feb 17 07:34:10 2012 LGWR: STARTING ARCH PROCESSES ARC0 started with pid=25, OS id=30956 Fri Feb 17 07:34:11 2012 ARC0: Archival started ARC1: Archival started LGWR: STARTING ARCH PROCESSES COMPLETE ARC1 started with pid=26, OS id=30958 Fri Feb 17 07:34:11 2012 Thread 2 opened at log sequence 2 Current log# 4 seq# 2 mem# 0: +DATA/orcl/onlinelog/group_4.266.775454171 Fri Feb 17 07:34:11 2012 ARC0: STARTING ARCH PROCESSES Fri Feb 17 07:34:11 2012 ARC1: Becoming the 'no FAL' ARCH ARC1: Becoming the 'no SRL' ARCH Fri Feb 17 07:34:11 2012 Successful open of redo thread 2 Fri Feb 17 07:34:11 2012 MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set Fri Feb 17 07:34:11 2012 ARC2: Archival started ARC0: STARTING ARCH PROCESSES COMPLETE ARC0: Becoming the heartbeat ARCH ARC2 started with pid=28, OS id=30964 Fri Feb 17 07:34:11 2012 SMON: enabling cache recovery Fri Feb 17 07:34:17 2012 Successfully onlined Undo Tablespace 4. Fri Feb 17 07:34:17 2012

SMON: enabling tx recovery Fri Feb 17 07:34:17 2012 Database Characterset is ZHS16GBK replication_dependency_tracking turned off (no async multimaster replication fou nd) Starting background process QMNC QMNC started with pid=31, OS id=31188 Fri Feb 17 07:34:24 2012 Completed: ALTER DATABASE OPEN Fri Feb 17 07:40:11 2012 Shutting down archive processes Fri Feb 17 07:40:16 2012 ARCH shutting down ARC2: Archival stopped Fri Feb 17 08:07:13 2012 Starting background process EMN0 Fri Feb 17 08:07:13 2012 Shutting down instance: further logons disabled EMN0 started with pid=27, OS id=14584 Fri Feb 17 08:07:13 2012 Stopping background process QMNC Fri Feb 17 08:07:13 2012 Stopping background process CJQ0 Fri Feb 17 08:07:14 2012 Stopping background process MMNL Fri Feb 17 08:07:16 2012 Stopping background process MMON Fri Feb 17 08:07:17 2012 Shutting down instance (immediate) License high water mark = 5 Fri Feb 17 08:07:17 2012 Stopping Job queue slave processes Fri Feb 17 08:07:17 2012 Job queue slave processes stopped All dispatchers and shared servers shutdown Fri Feb 17 08:07:24 2012 ALTER DATABASE CLOSE NORMAL Fri Feb 17 08:07:24 2012 SMON: disabling tx recovery SMON: disabling cache recovery Fri Feb 17 08:07:24 2012 Shutting down archive processes Archiving is disabled Fri Feb 17 08:07:29 2012 ARCH shutting down ARC1: Archival stopped Fri Feb 17 08:07:34 2012 ARCH shutting down ARC0: Archival stopped Fri Feb 17 08:07:35 2012 Thread 2 closed at log sequence 2 Successful close of redo thread 2 Fri Feb 17 08:07:38 2012 Completed: ALTER DATABASE CLOSE NORMAL Fri Feb 17 08:07:38 2012 ALTER DATABASE DISMOUNT Fri Feb 17 08:07:38 2012 SUCCESS: diskgroup DATA was dismounted Fri Feb 17 08:07:38 2012 Completed: ALTER DATABASE DISMOUNT

ARCH: Archival disabled due to shutdown: 1089 Shutting down archive processes Archiving is disabled Archive process shutdown avoided: 0 active ARCH: Archival disabled due to shutdown: 1089 Shutting down archive processes Archiving is disabled Archive process shutdown avoided: 0 active Fri Feb 17 08:07:44 2012 freeing rdom 0 Fri Feb 17 08:10:42 2012 Starting ORACLE instance (normal) LICENSE_MAX_SESSION = 0 LICENSE_SESSIONS_WARNING = 0 Interface type 1 eth1 10.10.10.0 configured from OCR for use as a cluster interc onnect Interface type 1 eth0 192.168.7.0 configured from OCR for use as a public inter face Picked latch-free SCN scheme 2 Autotune of undo retention is turned on. LICENSE_MAX_USERS = 0 SYS auditing is disabled ksdpec: called for event 13740 prior to event group initialization Starting up ORACLE RDBMS Version: 10.2.0.1.0. System parameters with non-default values: processes = 150 __shared_pool_size = 130023424 __large_pool_size = 4194304 __java_pool_size = 4194304 __streams_pool_size = 0 spfile = +DATA/orcl/spfileorcl.ora sga_target = 452984832 control_files = +DATA/orcl/controlfile/current.256.775452311 db_block_size = 8192 __db_cache_size = 306184192 compatible = 10.2.0.1.0 log_archive_dest_1 = LOCATION=+DATA/orcl/ log_archive_format = %t_%s_%r.dbf db_file_multiblock_read_count= 16 cluster_database = TRUE cluster_database_instances= 2 db_create_file_dest = +DATA thread = 2 instance_number = 2 undo_management = AUTO undo_tablespace = UNDOTBS2 remote_login_passwordfile= EXCLUSIVE db_domain = dispatchers = (PROTOCOL=TCP) (SERVICE=orclXDB) job_queue_processes = 10 background_dump_dest = /opt/oracle/admin/orcl/bdump user_dump_dest = /opt/oracle/admin/orcl/udump core_dump_dest = /opt/oracle/admin/orcl/cdump audit_file_dest = /opt/oracle/admin/orcl/adump db_name = orcl open_cursors = 300 pga_aggregate_target = 149946368 Cluster communication is configured to use the following interface(s) for this i nstance 10.10.10.1

Fri Feb 17 08:10:43 2012 cluster interconnect IPC version:Oracle UDP/IP IPC Vendor 1 proto 2 PMON started with pid=2, OS id=19118 DIAG started with pid=3, OS id=19128 PSP0 started with pid=4, OS id=19138 LMON started with pid=5, OS id=19149 LMD0 started with pid=6, OS id=19151 LMS0 started with pid=7, OS id=19153 LMS1 started with pid=8, OS id=19163 MMAN started with pid=9, OS id=19173 DBW0 started with pid=10, OS id=19175 LGWR started with pid=11, OS id=19177 CKPT started with pid=12, OS id=19187 SMON started with pid=13, OS id=19195 RECO started with pid=14, OS id=19205 CJQ0 started with pid=15, OS id=19210 MMON started with pid=16, OS id=19212 Fri Feb 17 08:10:45 2012 starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL =TCP))'... MMNL started with pid=17, OS id=19214 Fri Feb 17 08:10:45 2012 starting up 1 shared server(s) ... Fri Feb 17 08:10:45 2012 lmon registered with NM - instance id 2 (internal mem no 1) Fri Feb 17 08:10:46 2012 Reconfiguration started (old inc 0, new inc 4) List of nodes: 0 1 Global Resource Directory frozen * allocate domain 0, invalid = TRUE Communication channels reestablished * domain 0 valid = 0 according to instance 0 Fri Feb 17 08:10:48 2012 Master broadcasted resource hash value bitmaps Non-local Process blocks cleaned out Fri Feb 17 08:10:48 2012 LMS 0: 0 GCS shadows cancelled, 0 closed Fri Feb 17 08:10:48 2012 LMS 1: 0 GCS shadows cancelled, 0 closed Set master node info Submitted all remote-enqueue requests Dwn-cvts replayed, VALBLKs dubious All grantable enqueues granted Fri Feb 17 08:10:48 2012 LMS 0: 0 GCS shadows traversed, 0 replayed Fri Feb 17 08:10:48 2012 LMS 1: 0 GCS shadows traversed, 0 replayed Fri Feb 17 08:10:48 2012 Submitted all GCS remote-cache requests Fix write in gcs resources Reconfiguration complete LCK0 started with pid=20, OS id=19270 Fri Feb 17 08:10:49 2012 ALTER DATABASE MOUNT Fri Feb 17 08:10:52 2012 Starting background process ASMB ASMB started with pid=22, OS id=19359 Starting background process RBAL

RBAL started with pid=23, OS id=19369 Fri Feb 17 08:10:57 2012 SUCCESS: diskgroup DATA was mounted Fri Feb 17 08:11:02 2012 Setting recovery target incarnation to 1 Fri Feb 17 08:11:02 2012 Successful mount of redo thread 2, with mount id 1303254529 Fri Feb 17 08:11:02 2012 Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE) Completed: ALTER DATABASE MOUNT Fri Feb 17 08:11:03 2012 ALTER DATABASE OPEN Picked broadcast on commit scheme to generate SCNs Fri Feb 17 08:11:06 2012 LGWR: STARTING ARCH PROCESSES ARC0 started with pid=28, OS id=19693 ARC1 started with pid=29, OS id=19695 Fri Feb 17 08:11:06 2012 ARC0: Archival started ARC1: Archival started LGWR: STARTING ARCH PROCESSES COMPLETE Thread 2 opened at log sequence 2 Current log# 4 seq# 2 mem# 0: +DATA/orcl/onlinelog/group_4.266.775454171 Fri Feb 17 08:11:07 2012 ARC1: STARTING ARCH PROCESSES Fri Feb 17 08:11:07 2012 ARC0: Becoming the 'no FAL' ARCH ARC0: Becoming the 'no SRL' ARCH Fri Feb 17 08:11:07 2012 ARC2: Archival started ARC1: STARTING ARCH PROCESSES COMPLETE ARC1: Becoming the heartbeat ARCH ARC2 started with pid=30, OS id=19697 Fri Feb 17 08:11:07 2012 Successful open of redo thread 2 Fri Feb 17 08:11:07 2012 MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set Fri Feb 17 08:11:07 2012 SMON: enabling cache recovery Fri Feb 17 08:11:08 2012 Successfully onlined Undo Tablespace 4. Fri Feb 17 08:11:08 2012 SMON: enabling tx recovery Fri Feb 17 08:11:08 2012 Database Characterset is ZHS16GBK replication_dependency_tracking turned off (no async multimaster replication fou nd) Starting background process QMNC QMNC started with pid=32, OS id=19900 Fri Feb 17 08:11:17 2012 Completed: ALTER DATABASE OPEN Fri Feb 17 08:17:06 2012 Shutting down archive processes Fri Feb 17 08:17:11 2012 ARCH shutting down ARC2: Archival stopped Fri Feb 17 09:13:17 2012 Starting background process EMN0 EMN0 started with pid=30, OS id=10932 Fri Feb 17 09:13:17 2012

Shutting down instance: further logons disabled Fri Feb 17 09:13:17 2012 Stopping background process QMNC Fri Feb 17 09:13:17 2012 Stopping background process CJQ0 Fri Feb 17 09:13:19 2012 Stopping background process MMNL Fri Feb 17 09:13:20 2012 Stopping background process MMON Fri Feb 17 09:13:21 2012 Shutting down instance (immediate) License high water mark = 5 Fri Feb 17 09:13:21 2012 Stopping Job queue slave processes Fri Feb 17 09:13:21 2012 Job queue slave processes stopped All dispatchers and shared servers shutdown Fri Feb 17 09:13:27 2012 PMON failed to acquire latch, see PMON dump Fri Feb 17 09:13:27 2012 ALTER DATABASE CLOSE NORMAL Fri Feb 17 09:13:27 2012 SMON: disabling tx recovery SMON: disabling cache recovery Fri Feb 17 09:13:27 2012 Shutting down archive processes Archiving is disabled Fri Feb 17 09:13:32 2012 ARCH shutting down ARC1: Archival stopped Fri Feb 17 09:13:37 2012 ARCH shutting down ARC0: Archival stopped Fri Feb 17 09:13:38 2012 Reconfiguration started (old inc 4, new inc 6) List of nodes: 1 Global Resource Directory frozen * dead instance detected - domain 0 invalid = TRUE Communication channels reestablished Master broadcasted resource hash value bitmaps Non-local Process blocks cleaned out Fri Feb 17 09:13:38 2012 LMS 0: 0 GCS shadows cancelled, 0 closed Fri Feb 17 09:13:38 2012 LMS 1: 0 GCS shadows cancelled, 0 closed Set master node info Submitted all remote-enqueue requests Dwn-cvts replayed, VALBLKs dubious All grantable enqueues granted Post SMON to start 1st pass IR Fri Feb 17 09:13:38 2012 LMS 1: 2167 GCS shadows traversed, 0 replayed Fri Feb 17 09:13:38 2012 LMS 0: 2250 GCS shadows traversed, 0 replayed Fri Feb 17 09:13:38 2012 Submitted all GCS remote-cache requests Post SMON to start 1st pass IR Fix write in gcs resources Reconfiguration complete

Fri Feb 17 09:13:38 2012 Thread 2 closed at log sequence 2 Successful close of redo thread 2 Fri Feb 17 09:13:40 2012 Completed: ALTER DATABASE CLOSE NORMAL Fri Feb 17 09:13:40 2012 ALTER DATABASE DISMOUNT Fri Feb 17 09:13:40 2012 SUCCESS: diskgroup DATA was dismounted Fri Feb 17 09:13:40 2012 Completed: ALTER DATABASE DISMOUNT ARCH: Archival disabled due to shutdown: 1089 Shutting down archive processes Archiving is disabled Archive process shutdown avoided: 0 active ARCH: Archival disabled due to shutdown: 1089 Shutting down archive processes Archiving is disabled Archive process shutdown avoided: 0 active Fri Feb 17 09:13:46 2012 freeing rdom 0 Fri Feb 17 09:15:50 2012 Starting ORACLE instance (normal) LICENSE_MAX_SESSION = 0 LICENSE_SESSIONS_WARNING = 0 Interface type 1 eth1 10.10.10.0 configured from OCR for use as a cluster interc onnect Interface type 1 eth0 192.168.7.0 configured from OCR for use as a public inter face Picked latch-free SCN scheme 2 Autotune of undo retention is turned on. LICENSE_MAX_USERS = 0 SYS auditing is disabled ksdpec: called for event 13740 prior to event group initialization Starting up ORACLE RDBMS Version: 10.2.0.1.0. System parameters with non-default values: processes = 150 __shared_pool_size = 134217728 __large_pool_size = 4194304 __java_pool_size = 4194304 __streams_pool_size = 0 spfile = +DATA/orcl/spfileorcl.ora sga_target = 452984832 control_files = +DATA/orcl/controlfile/current.256.775452311 db_block_size = 8192 __db_cache_size = 301989888 compatible = 10.2.0.1.0 log_archive_dest_1 = LOCATION=+DATA/orcl/ log_archive_format = %t_%s_%r.dbf db_file_multiblock_read_count= 16 cluster_database = TRUE cluster_database_instances= 2 db_create_file_dest = +DATA thread = 2 instance_number = 2 undo_management = AUTO undo_tablespace = UNDOTBS2 remote_login_passwordfile= EXCLUSIVE db_domain = dispatchers = (PROTOCOL=TCP) (SERVICE=orclXDB)

job_queue_processes = 10 background_dump_dest = /opt/oracle/admin/orcl/bdump user_dump_dest = /opt/oracle/admin/orcl/udump core_dump_dest = /opt/oracle/admin/orcl/cdump audit_file_dest = /opt/oracle/admin/orcl/adump db_name = orcl open_cursors = 300 pga_aggregate_target = 149946368 Cluster communication is configured to use the following interface(s) for this i nstance 10.10.10.1 Fri Feb 17 09:15:53 2012 cluster interconnect IPC version:Oracle UDP/IP IPC Vendor 1 proto 2 PMON started with pid=2, OS id=14307 DIAG started with pid=3, OS id=14309 PSP0 started with pid=4, OS id=14311 LMON started with pid=5, OS id=14315 LMD0 started with pid=6, OS id=14329 LMS0 started with pid=7, OS id=14342 LMS1 started with pid=8, OS id=14352 MMAN started with pid=9, OS id=14362 DBW0 started with pid=10, OS id=14364 LGWR started with pid=11, OS id=14366 CKPT started with pid=12, OS id=14368 SMON started with pid=13, OS id=14370 CJQ0 started with pid=15, OS id=14382 RECO started with pid=14, OS id=14373 MMON started with pid=16, OS id=14395 Fri Feb 17 09:15:56 2012 starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL =TCP))'... MMNL started with pid=17, OS id=14404 Fri Feb 17 09:15:56 2012 starting up 1 shared server(s) ... Fri Feb 17 09:15:56 2012 lmon registered with NM - instance id 2 (internal mem no 1) Fri Feb 17 09:15:57 2012 Reconfiguration started (old inc 0, new inc 4) List of nodes: 0 1 Global Resource Directory frozen * allocate domain 0, invalid = TRUE Communication channels reestablished * domain 0 valid = 0 according to instance 0 Fri Feb 17 09:15:58 2012 Master broadcasted resource hash value bitmaps Non-local Process blocks cleaned out Fri Feb 17 09:15:58 2012 LMS 0: 0 GCS shadows cancelled, 0 closed Fri Feb 17 09:15:58 2012 LMS 1: 0 GCS shadows cancelled, 0 closed Set master node info Submitted all remote-enqueue requests Dwn-cvts replayed, VALBLKs dubious All grantable enqueues granted Fri Feb 17 09:15:58 2012 LMS 0: 0 GCS shadows traversed, 0 replayed Fri Feb 17 09:15:58 2012 LMS 1: 0 GCS shadows traversed, 0 replayed

Fri Feb 17 09:15:58 2012 Submitted all GCS remote-cache requests Fix write in gcs resources Reconfiguration complete LCK0 started with pid=20, OS id=14459 Fri Feb 17 09:16:00 2012 ALTER DATABASE MOUNT Fri Feb 17 09:16:07 2012 Starting background process ASMB ASMB started with pid=22, OS id=14636 Starting background process RBAL RBAL started with pid=23, OS id=14640 Fri Feb 17 09:16:11 2012 SUCCESS: diskgroup DATA was mounted Fri Feb 17 09:16:19 2012 Setting recovery target incarnation to 1 Fri Feb 17 09:16:19 2012 Successful mount of redo thread 2, with mount id 1303251531 Fri Feb 17 09:16:19 2012 Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE) Completed: ALTER DATABASE MOUNT Fri Feb 17 09:16:20 2012 ALTER DATABASE OPEN Picked broadcast on commit scheme to generate SCNs Fri Feb 17 09:16:24 2012 LGWR: STARTING ARCH PROCESSES ARC0 started with pid=28, OS id=15086 Fri Feb 17 09:16:24 2012 ARC0: Archival started ARC1: Archival started LGWR: STARTING ARCH PROCESSES COMPLETE ARC1 started with pid=29, OS id=15088 Fri Feb 17 09:16:25 2012 Thread 2 opened at log sequence 2 Current log# 4 seq# 2 mem# 0: +DATA/orcl/onlinelog/group_4.266.775454171 Fri Feb 17 09:16:25 2012 ARC0: STARTING ARCH PROCESSES Fri Feb 17 09:16:25 2012 ARC1: Becoming the 'no FAL' ARCH ARC1: Becoming the 'no SRL' ARCH Fri Feb 17 09:16:25 2012 ARC2: Archival started ARC0: STARTING ARCH PROCESSES COMPLETE ARC0: Becoming the heartbeat ARCH ARC2 started with pid=30, OS id=15090 Fri Feb 17 09:16:25 2012 Successful open of redo thread 2 Fri Feb 17 09:16:25 2012 MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set Fri Feb 17 09:16:25 2012 SMON: enabling cache recovery Fri Feb 17 09:16:26 2012 Successfully onlined Undo Tablespace 4. Fri Feb 17 09:16:26 2012 SMON: enabling tx recovery Fri Feb 17 09:16:26 2012 Database Characterset is ZHS16GBK replication_dependency_tracking turned off (no async multimaster replication fou nd) Starting background process QMNC

QMNC started with pid=31, OS id=15221 Fri Feb 17 09:16:32 2012 Completed: ALTER DATABASE OPEN Fri Feb 17 09:22:24 2012 Shutting down archive processes Fri Feb 17 09:22:29 2012 ARCH shutting down ARC2: Archival stopped