Oracle GoldenGate

Overview & Demo / Instructions
Background, Overview of GG, Next Steps etc.

Agenda ‡ Oracle Golden Gate ± ± Overview Deep-dive Architecture ‡ Demo November 2010 2 .

GoldenGate provides the ability to capture and deliver updates of critical data as the changes occur and provide continuous synchronized data across heterogeneous environments.Overview of Oracle Golden Gate ‡ Oracle GoldenGate provides real-time data integration to support high availability capabilities across heterogeneous systems to achieve business continuity. ‡ ‡ November 2010 3 . Use Cases: Online banking. Claims processing and Online shopping can use GoldenGate to operate without any disruption.

sub-second latency GoldenGate Reporting Database ETL ODS ETL EDW Flexible / Extensible Open.Overview of Golden Gate « Contd. RealTime Change Data Capture Query Offloading Performance Non-intrusive.Resilient against interruptions and failures Data Distribution Global Data Centers SOA/EDA November 2010 4 . Provides Low-impact capture Routing Transformation and Delivery of transactional data across Heterogeneous environments in Real time Zero Downtime Migration and Upgrades New DB/ OS/HW/App Active-Active High Fully Active Availability Distributed Database Key Features Log Based. low-impact. modular architecture .Supports heterogeneous sources and targets Heterogeneous Source Systems Real-time BI EDW Reliable Maintains transactional integrity .

encrypted for routing to target(s).Oracle GoldenGate Capture: Committed transactions are captured (and can be filtered) real time. transforming the data as required. Delivery: applies data with transaction integrity. from the DB Redo logs. Route: data is compressed. Pump: distributes data for routing to target(s). Trail: stages and queues data for routing. Capture Trail Pump LAN/WAN Internet TCP/IP Trail Delivery Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Ora Database(s) November 2010 5 .

Trail: stages and queues data for routing. from the DB Redo logs. transforming the data as required.Oracle GoldenGate Capture: Committed transactions are captured (and can be filtered) real time. Delivery: applies data with transaction integrity. encrypted for routing to target(s). Capture Trail Pump LAN/WAN Internet TCP/IP Trail Delivery (SQL) Source Oracle & Non-Oracle Database(s) Bi-directional Target Database(s) November 2010 6 . Route: data is compressed. Pump: distributes data for routing to target(s).

Multi-Master Broadcast /Fan-out Data Distribution Integration/Consolidation/Fan-in Data Warehouse Data Distribution via Messaging BPM November 2010 7 .GoldenGate Deployment Topologies Unidirectional Query Offloading Zero-Downtime Migration Bi-Directional Hot Standby or Active-Active for HA Peer-to-Peer Load Balancing.

Architecture Components (Processes) CAPTURE ‡ ‡ ‡ ‡ ‡ ‡ Log-based VAM-based Local/Remote Queuing Filtering Parallel Coordination Local/Remote DELIVERY ‡ ‡ ‡ ‡ ‡ ‡ ‡ Native database API ODBC Batched Operations Filtering Transaction/Operations Grouping Parallel Coordination Local/Remote PUMP (routes from one side to other) ‡ ‡ ‡ ‡ ‡ Filtering Local/Remote TCP/IP Compression Encryption MANAGER (Start/Stop/Report on thresholds. Thresholds) Receive/Route requests from UI On-disk Components ‡ ‡ ‡ ‡ ‡ ‡ ‡ Trail Fil s ck i t Fil s ( a t r . liv ry) ata fi iti Fil s (S E EFS/T ET EFS) fig rati Fil s iscar Fil s rt/L g Fil s Ex c ta l s November 2010 ¤ ¢¡ £ ¢¡   8 . . trail purging etc.) ‡ ‡ ‡ ‡ ‡ Queue (Trail) Management Process Management (Dynamic) Monitoring and Administration (Lag reports) Reporting (Events. Errors.

Oracle GoldenGate Components Communications and Startup GGSCI Interactive Interface GGSCI Manager Manager Interactive Interface Network Source Capture Source Trail Pump Collector Target Trail Delivery Target Target Database TCP/IP Process Start Shared Memory (for Monitoring) November 2010 9 .

GoldenGate Capture GoldenGate Parameter File GoldenGate Event Log Messaging Subsystem Checkpoint Manager Parser Memory Manager Transaction Logs GoldenGate Checkpoint File Transaction Log Reader Redo API (Log reader interface) Formatting Filtering Transformation and Mapping Serialization and Routing Metadata Manager Metadata Manager SQL Interface Transformation Engine GoldenGate Trail Files Database Access To gather Metadata (to interpret log data) & for SQL interface for data lookup. Command and Control Capture Source Database GoldenGate Command Interpreter November 2010 10 . advanced filtering etc.

GoldenGate Delivery GoldenGate Parameter File GoldenGate Event Log Messaging Subsystem Checkpoint Manager Parser Memory Manager GoldenGate Checkpoint File GoldenGate Trail Reader Read API Formatting Filtering Transformation and Mapping SQL Generation GoldenGate Trail Files Metadata Manager SQL Interface Transformation Engine Command and Control Database Access For Metadata access & SQL interface GoldenGate Command Interpreter Delivery Target Database November 2010 11 .

GoldenGate Instantiation ‡ Start delivery at or after given backup CSN (245 in this case) ± Current source Commit Sequence Number (CSN) is 356 ‡ Once Delivery is current the source and target are in sync Current CSN is 356 CSNs 222 through 356 Consistent as Deliver of CSN 356 transactions In Sync! after CSN 245 Source Database Capture Commit Ordered Source Trail Pump Commit Ordered Target Trail Delivery Target Database Take Backup as of CSN 245 November 2010 12 Apply Backup as of CSN 245 .

SOURCEISTABLE ± Create Parameter file for Load1: Edit params load1 Target: ‡ Create initial data load task µload2¶ ± ADD REPLICAT load2.Initial Data Load Source: ‡ Create the Initial data extract process µload1 ± ADD EXTRACT load1. SPECIALRUN ± Create Parameter file for Load2: Edit params load2 ‡ Start Initial Load: ± START EXTRACT load1 ± INFO EXTRACT load1 November 2010 13 .

exttrail /ora/app/stage/GoldenGate-Zip/ggs/dirdat/rt. 4. Create an Extract groups on Source ‡ ‡ ADD EXTRACT ext1.CHKPTAB 2. checkpointtable chkptab EDIT PARAMS rep1 Create a parameter file for the online Replicat group Start Online Change Sync: ‡ ‡ ‡ START EXTRACT ext1 START EXTRACT dpump START REPLICAT rep1 November 2010 14 . the trail files will be created having a prefix µrt¶/¶lt¶ which will be used by the Replicat/Extract processes also running on the target /source system(s) ADD EXTTRAIL /ora/app/stage/GoldenGate-Zip/ggs/dirdat/lt. PASSWORD ggs_owner ADD CHECKPOINTTABLE GGS_OWNER. EXTTRAILSOURCE /ora/app/stage/GoldenGate-Zip/ggs/dirdat/lt 3. Create a parameter file for the online Extract group ‡ ‡ ‡ ‡ EDIT PARAMS ext1 On the source/target system. TRANLOG. BEGIN NOW ADD EXTRACT dpump. Create a GoldenGate Checkpoint table ‡ EDIT PARAMS . EXTRACT EXT1 ADD RMTTRAIL /ora/app/stage/GoldenGate-Zip/ggs/dirdat/rt. EXTRACT dpump Create a Trail on Source & Target 5. 6. Create a Replicat group on the Target ‡ ‡ ADD REPLICAT rep1./GLOBALS ± GGSCHEMA GGS_OWNER CHECKPOINTTABLE GGS_OWNER.Online Change Synchronization 1.CHKPTAB ‡ DBLOGIN USERID ggs_owner.

the Extract process writes data into memory before the same is sent over the network ‡ Any failures in the network could then cause the Extract process to abort (³abend´) ‡ Additionally. Data Pump can be used to perform these November 2010 15 . Extract process writes to a local trail for Data Pump to read and write over the network to the remote trail located on the target system ‡ The advantages of Data Pump can be seen as it protects against a network failure as in the absence of a storage device on the local system.Significance of Data Pump ‡ When Data Pump is not used. if there are any complex data transformations or filtering. the Extract process writes to a remote trail that is located on the target system using TCP/IP ‡ When Data Pump is configured.

Sign up to vote on this title
UsefulNot useful