You are on page 1of 72

Oracle GoldenGate: Whats All The Fuzz About?

Borkur Steingrimsson, Rittman Mead Consulting Oracle Open World 2010, San Francisco, September 2010
T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Introduction
Brkur Steingrimsson Principal Consultant at Rittman Mead Consulting Blog ! http://www.rittmanmead.com/blog/ 15 years of dabbling in Oracle technology ! Discoverer ! DW ! OWB / ODI ! OBIEE ! GG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Introduction
Brkur Steingrimsson Principal Consultant at Rittman Mead Consulting Blog ! http://www.rittmanmead.com/blog/ 15 years of dabbling in Oracle technology ! Discoverer ! DW ! OWB / ODI ! OBIEE ! GG

I can pronounce Eyjafjallajkull better than most of you


T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Rittman Mead America


Oracle BI&DW Project Specialists providing consulting, training and support Clients in the UK, USA, Europe, Middle-East Voted UKOUG BI Partner of the Year 2008 Group companies in UK and India Come and see us to discuss your requirements in more detail

T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Rittman Mead Oracle BI Training Days 2010


Running in London, Atlanta and Bangalore, Fall 2010 Three days of intense OBIEE 11gR1 hands-on training Led by the Rittman Mead 11g Beta Testing team Limited places still available : http://www.rittmanmead.com/trainingdays2010

T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Agenda
Introduction to GoldenGate Technical Things ! Installation ! Platforms / Services ! Development ! Deployment Demo ! Interface; command line & GUI ! DML & DDL ! Log files GoldenGate and ODI

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Oracle GoldenGate

So you heard about Oracle GoldenGate?

Whats all the Fuzz about?

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Introduction to Oracle GoldenGate


Acquired in 2009 from GoldenGate Best-of-Breed & Easy-to-Deploy product ! Change Data Capture engine (CDC) ! Replicate and integrate transactional data ! Sub-second speed ! Multiple enterprise system support Carry data between (heterogenous) systems ! Oracle databases ! DB/2 ! MSSQL ! ... and so on Support for different hardware platforms

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Oracle GoldenGate
Supported Oracle Versions ! 9i Release 2 ! 11g Release 2 CDC ! Real-Time ! Log-based ! Large data volume ! Low-impact and footprint DML and DDL replication ETL - E-LT ! Filter ! Mapping ! Transformations
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Whats in the Box?


Oracle GoldenGate Management Pack Oracle GoldenGate Veridata Oracle GoldenGate Application Adapters Oracle GoldenGate for Mainframes A full Oracle Active Data Guard license ! Stand-by databases A full Oracle XStreams - Oracle Streams API - License Oracle GoldenGate Statement of Directions tells us that ! Given the strategic nature of Oracle GoldenGate, Oracle Streams will continue to be supported, but will not be actively enhanced. Rather, the best elements of Oracle Streams will be evaluated for inclusion with Oracle GoldenGate.
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Technical Things
Local installation of Oracle GoldenGate on each participating box ! Oracle GoldenGate ! Protocols: TCP/IP ! Managers default listen on port 7809 Movement on data can be encrypted Windows can run the Manager as a service ! Create scripts to start up on Unix Increasing number of platforms supported ! iOS4 support for iPad is probably in the making ;) EXTRACT and REPLICAT groups are created and configured to move data around

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

From the Doco: Architecture

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Availability
Zero-downtime operations ! Enable uninterrupted business operations during system upgrade, migration, and maintenance activities. Disaster recovery and data protection ! Immediate failover with up-to-the-minute data to minimize recovery time ! Deploy with Oracle Database across database versions or operating systems ! Non-Oracle environments. Data distribution ! Synchronize data for distributed applications in real time across geographies for reliable access to timely data. Query offloading ! Ensure high performance for production systems while still supporting necessary read-only activities by replicating data between heterogeneous sources and targets.
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Real-Time Data Integration


Real-time data warehousing
! Provide continuous, real-time capture and delivery of the most-recent change data between OLTP systems and the data warehouse. Oracle GoldenGate integrates easily with Oracle Data Integrator Enterprise Edition 11g and other extract, transform, and load (ETL) solutions. Oracle GoldenGate 11g is certified to capture from and deliver to Oracle Exadata Storage Server to enable real-time data warehousing or data consolidation solutions.

Operational reporting
! Offload reporting activity from production databases to lower- cost secondary systems with current data for real-time reporting. Oracle GoldenGate 11g is certified to support major Oracle applications, including Oracle E-Business Suite, JD Edwards, PeopleSoft and Siebel CRM, for operational reporting solutions.

Operational data integration


! Integrate operational data between OLTP systems in real time. Enable service-oriented architectures, including Oracle SOA Suite, to operate with real-time data by publishing changed data via Java Message Service (JMS) using Oracle GoldenGate Application Adapters.
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

White Paper Points


Real-time data ! Immediately captures, routes, transforms, and delivers transactional data to other systems with sub-second latency. Improves organizational decisionmaking through enterprise-wide visibility into accurate, up-to-date information. Heterogeneous support ! Supports heterogeneous databases and platforms to increase IT flexibility. Extracts data from existing IT investments and lowers your total cost of ownership while unifying data from all enterprise systems. Reliability ! Delivers all committed records to the target, even in the event of network outages. Moves data without requiring system interruption or outage windows. High performance with low impact ! Moves thousands of transactions per second with negligible impact on source and target systems. Enables to access critical information in real time without bogging down production systems.
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

White Paper Points


Transaction integrity ! Maintains transaction commit boundaries and atomicity, consistency, isolation, and durability (ACID) properties as transactions are moved between source and target systems. Ensures data consistency and referential integrity across multiple masters, back-up systems, and reporting databases. Integration ! Integrates with Oracle Data Integrator Enterprise Edition and complements other ETL solutions. Via Oracle GoldenGate Application Adapters, it allows to capture from, or deliver to, Java Message Servicebased messaging solutions such as Oracle WebLogic. Flexible topology support ! Moves data in one-source-to-one-target, one-to-many, many-to- one, many-tomany, cascading, and bidirectional configurations.

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

White Paper Points


Conflict detection and resolution ! Enables conflict detection and resolution in multi-master configurations where two systems can modify separate instances of the same table. Event based infrastructure ! Triggers immediate actions based on specific database operations captured and stored in Trail Files Routing and compression ! Utilizes TCP/IP to send data and eliminate geographical distance constraints. Applies additional compression to the data as it is routed. Data encryption ! Securely transmits data for domestic and international applications with variable key length encryption.

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

White Paper Points


Deferred apply ! Applies data immediately or at a deferred time chosen by the user, without losing transaction integrity. Automated memory management ! Automatically adjusts transaction memory based on the size and number of transactions being capturing. Bounded Recovery ! Persists uncommitted operations to disk to enable fast and simple data recovery for long running transactions in the event that the replication process is paused or interrupted.

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Having Said That ...

There is no magic!

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Having Said That ...

There is no magic!
But it is quite DBA centric - so perhaps there is some magic?
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Whats New in 11g?


Certification for operational reporting solutions on Oracle Applications such as Oracle E-Business Suite, Oracle PeopleSoft, and Oracle JD Edwards. Support for more data types and direct loads for Oracle Database, and certification on Oracle Exadata. Expanded heterogenous support via: ! Log-based capture from, and delivery to IBM DB2 v9.7, ! Native delivery to Oracle TimesTen databases. ! Capture from JMS-based messaging systems ! MySQL v5 For the Oracle Database, simplified recovery to significantly reduce recovery windows for long running transactions in case of process interruptions. Increased transaction tracing flexibility to easily identify bottlenecks and tune the data integration solution for optimum performance Tighter integration with ODI11g (well, from ODIs side)
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Building Blocks
Extract groups Replication groups Trails Maps Files parameter files scripts and the OBEY command

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

From the Doco: Supported Topoligies

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Installation
Each node will have the Oracle GoldenGate software installed ! Download the platform-specific zip files from EDelivery.oracle.com - Operating system - 32bit or 64 bit - 10.4 or the new 11g release - Database vendor & version ! Unzip the downloaded file in to a new directory Create default directories to store our metadata Configure the Manager on each node ! Which port (default is 7809) ! Service name ! Windows: Configure to run as Service & Install Event Messages Bobs your uncle
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Configuration
The GGSCI utility (GoldenGate Command Interpreter) is our first entry point to the installation ! Command-Line interface ! Configure the Manager process ! Manage extractions and replications ! Edit parameters - Global - extract / replicat specific ! Help command - Often with examples ! Run scripts ! View statistics ! ... and then some
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Configuration: Create Subdirs

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Configuration: Edit Parameters

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Configuration: Edit Parameters

port 7809

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Configuration: Edit Parameters

port 7809

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Configuration: Edit Parameters

port 7809 MGRSERVNAME Oracle_GG_Mgr

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Configuration: Install Service

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Configuration: Install Service

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Initial Load
We want to have special loads that get all the data sources & targets in synch We can filter, transform and map the source to target or just pass the data through directly SOURCEISTABLE keyword allows us to by-pass trail files on extract SPECIALRUN keyword makes for a one-time run and not a continuous process BULKLOAD tells the replicate process to interface with SQL*Ldr

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Initial Load
We want to have special loads that get all the data sources & targets in synch We can filter, transform and map the source to target or just pass the data through directly SOURCEISTABLE keyword allows us to by-pass trail files on extract SPECIALRUN keyword makes for a one-time run and not a continuous process BULKLOAD tells the replicate process to interface with SQL*Ldr

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Initial Load: Create Extract


Using the GGSCI Command-line Interpreter (on the source box) ! ADD EXTRACT OOW_IEXT, SOURCEISTABLE ! EDIT PARAM OOW_IEXT extract OOW_IEXT userid oow_gg, password password1 discardle E:\oracle\GG\GG11g\dirrpt\OOW_IEXT.dsc, purge rmthost winxpvm.rmcvm.com, mgrport 7810 rmttask replicat, group OOW_IREP table OOW_GG.BOB; table OOW_GG.DEMO_TABLE;

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Initial Load: Create Replicat


Using the GGSCI Command-line Interpreter (on the target box) ! ADD REPLICAT OOW_IREP, SPECIALRUN ! EDIT PARAM OOW_IREP replicat OOW_IREP discardle E:\oracle\GG\GG11g_TRG\dirrpt\OOW_IREP.dsc, purge --BULKLOAD assumetargetdefs userid oow_gg_trg, password password1 map OOW_GG.BOB, target OOW_GG_TRG.BOB, colmap (A=B,B=A); map OOW_GG.DEMO_TABLE, target OOW_GG_TRG.DEMO_TABLE, colmap (ID=ID, DATA=DATA, ENTRY_DATE=ENTRY_DATE);
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

From the Doco: Filter Examples

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Continuous Feed: Create Extract


Using the GGSCI Command-line Interpreter (on the source box) ! ADD EXTRACT OOW_EX1 ! ADD RMTTRAIL E:\oracle\GG\GG11g_TRG\dirdat\O1 extract OOW_EX1 ! EDIT PARAM OOW_IEX extract OOW_EX1 userid oow_gg, password password1 discardle E:\oracle\GG\GG11g_1110\dirrpt\OOW_EX1.dsc, purge --Connect to the remote host and write to trail. Path is relevant to remote host rmthost winxpvm.rmcvm.com, mgrport 7810 rmttrail E:\oracle\GG\GG11g_TRG\dirdat\O1 table OOW_GG.*;

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Continuous Feed: Create Replicat


Using the GGSCI Command-line Interpreter (on the target box) ! ADD REPLICAT OOW_REP1 ! EDIT PARAM OOW_REP1 replicat OOW_REP1 discardle E:\oracle\GG\GG11g_1110_TRG\dirrpt\OOW_REP1.dsc, purge assumetargetdefs userid oow_gg_trg, password password1 HANDLECOLLISIONS map OOW_GG.*, target OOW_GG_TRG.*;

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

From the Doco: Parameter Examples


Sample Extract parameter le EXTRACT capt USERID ggs, PASSWORD ********* DISCARDFILE /ggs/capt.dsc, PURGE RMTHOST sysb, MGRPORT 7809 RMTTRAIL /ggs/dirdat/aa TABLE fin.*; TABLE sales.*; Sample Replicat parameter le REPLICAT deliv USERID ggs, PASSWORD **** SOURCEDEFS /ggs/dirdef/defs DISCARDFILE /ggs/deliv.dsc, PURGE GETINSERTS MAP fin.account, TARGET fin.acctab, COLMAP (account = acct, balance = bal, branch = branch); MAP fin.teller, TARGET fin.telltab, WHERE (branch = NY); IGNOREINSERTS MAP fin.teller, TARGET fin.telltab, WHERE (branch = LA);

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Oracle GoldenGate Director (2.0.0.3)

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Oracle GoldenGate Director Web (2.0.0.3)

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Some debugging tools


Logfiles ! E:\oracle\GG\GG11g\ggserr.log ! E:\oracle\diag\rdbms\winxp11g\winxp11g\trace\ggs_ddl_trace.log SQL> select sequence#,status from v$log; ALTER EXTRACT OOW_EX1, BEGIN NOW ALTER REPLICAT OOW_REP1, extseqno 38 SEND EXTRACT OOW_EX1, ROLLOVER SEND EXTRACT OOW_EX1, SKIPTRANS ...

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

GGSCI (winxpvm) 49> send extract oow_ex1, showtrans Sending SHOWTRANS request to EXTRACT OOW_EX1 ... Oldest redo log le necessary to restart Extract is: Redo Log Sequence Number 39, RBA 10782224 -----------------------------------------------------------XID: 5.28.1323 Items: 564442 Extract: OOW_EX1 Redo Thread: 1 Start Time: 2010-09-17:18:35:02 SCN: 0.1402704 (1402704) Redo Seq: 39 Redo RBA: 10783248 Status: Running GGSCI (winxpvm) 50> send extract oow_ex1, skiptrans 5.28.1323 FORCE Sending skiptrans request to EXTRACT OOW_EX1 ... Transaction [XID 5.28.1323, Redo Thread 1, Start Time 2010-09-21:18:35:02, SCN 0 .1402704 (1402704)] skipped.
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Oracle GoldenGate: Whats All The Fuzz About?


Demo DML in Action

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

DDL Support
DDL operations are written to the redo log ! CREATE / DROP ! ALTER ! RENAME ! GRANT (etc) ! Database Import Various parameters control the replication process ! DDLOPTIONS ! DDLERROR ! DDLSUBST ! PURGEDDLHISTORY ! PURGEMARKERHISTORY

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

DDL Support
tables clusters indexes functions packages procedure tablespaces roles sequences synonyms triggers types views materialized views users

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

DDL Support
Mapping occurs between source and target ! Renaming of base objects and derived objects ! Only propagate certain DDL actions - EXCLUDE | INCLUDE - OPTYPE - OBJTYPE - OBJNAME - INSTR[WORDS] - INSTRCOMMENTS[WORDS]

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

From the Doco: DDL Parameters Syntax

DDL & INCLUDE UNMAPPED & OPTYPE alter & OBJTYPE table & OBJNAME users.tab* & INCLUDE MAPPED OBJNAME * & EXCLUDE MAPPED OBJNAME "temporary.tab*"

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Enable DDL Logging


Edit parameters for the Extract group using the GGSCI command-line tool ! edit param oow_ex1 - DDL INCLUDE MAPPED - DDLOPTIONS REPORT Edit parameters for the Replicat group using the GGSCI command-line tool ! edit param oow_rep1 - DDLOPTIONS MAPDERIVED - DDLERROR DEFAULT IGNORE Restart each group ! stop extract oow_ex1 ! start extract oow_ex1 ! stop replicat oow_rep1 ! start replicat oow_rep1
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

From The Doco: MAPDERIVED

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

DDL Operation Detected on Source


SQL> grant insert on oow_gg.oow_test_ddl to public; SQL> drop procedure oow_gg.generate_test_ddl; DDL operation included [INCLUDE MAPPED], optype [GRANT], objtype [OBJECT PRIVILEGE], objowner [OOW_GG], objname [OOW_TEST_DDL]. Writing DDL operation to extract trail file. DDL found, operation [drop procedure oow_gg.generate_test_ddl (size 40)], start SCN [1316328], commit SCN [1316351] instance [winxp11gvm] DDL operation included [INCLUDE MAPPED], optype [DROP], objtype [PROCEDURE], objowner [OOW_GG], objname [GENERATE_TEST_DDL]. Writing DDL operation to extract trail file.
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

DDL Replicated on Target


From the ggserr.log Setting current schema for DDL operation to [SYS]. Restoring current schema for DDL operation to [OOW_GG_TRG]. From the ggs_ddl_trace.log DDL operation [drop procedure "OOW_GG_TRG"."GENERATE_TEST_DDL" ], sequence [30], DDL type [DROP] PROCEDURE, real object type [PROCEDURE], validity [], object ID [], object [OOW_GG_TRG.GENERATE_TEST_DDL], real object [OOW_GG_TRG.GENERATE_TEST_DDL], base object schema [], base object name [], logged as [SYS]
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Setting up DDL Replication


DDL replication uses a specific schema with supporting tables to keep track of DDL operations Set the DDL schema in the ./GLOBALS parameter file ! GGSCHEMA oow_gg_ddl ! SQL> grant execute on UTL_FILE to oow_gg_ddl; -- Allows schema to write trace to the USER_DUMP_DEST/ggs_ddl_trace.log Disable the Oracle RECYCLEBIN (requires database restart) ! alter system set recyclebin=off scope=spfile; Run as SYSDBA ! marker_setup.sql --Creates the tables to hold the DDL actions ! ddl_setup.sql --Creates the DDL trigger ! role_setup.sql --Creates a role, GGS_GGSUSER_ROLE, with DML grants to the DDL objects. Grant this to all GG users ! ddl_[dis|en]able.sql --Enables/Disables the DDL trigger
T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Oracle GoldenGate: Whats All The Fuzz About?


Demo DDL in Action

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

OWB and ODI Support


Oracle Warehouse Builder and Oracle Data Integrator provide knowledge modules to interact with Oracle GoldenGate ! Knowledge Modules are Code Templates in OWB lingo ! These are pre-scripted templates that will auto-magically configure OGG for the sources and targets we need http://www.rittmanmead.com/2010/03/22/configuring-odi-10-1-3-6-to-use-oraclegolden-gate-for-changed-data-capture/ ! For a detailed walk-through example

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

ODI setup for OGG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

ODI setup for OGG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

LOCAL_TEMP_DIR : C:\TEMP SRC_LSCHEMA : GG_TEST_SRC SRC_DB_USER : oow_gg SRC_DB_PASSWORD : password1 SRC_OGG_PATH : C:\GOLDENGATE\GOLDENGATE_SRC STG_HOST : winxpvm.rmcvm.com STG_MANAGER_PORT : 7910 STG_OGG_PATH : C:\GOLDENGATE\GOLDENGATE_STG COMPATIBLE : 10

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

ODI setup for OGG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

ODI setup for OGG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

ODI setup for OGG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

ODI setup for OGG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

ODI setup for OGG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

This readme file provides a detail of the different steps to be executed manually in order to complete the setup of the CDC using OGG. UPLOAD FILES TO SOURCE MACHINE The files for the source machine have been generated in C:\TEMP/ODIS_to_ODIT1/src These files must be copied on the source machine, to the following location C:\GoldenGate \GoldenGate_Src using the same directory structure. For instance, files contained in C:\TEMP/ODIS_to_ODIT1/src/dirprm should end up in C:\GoldenGate \GoldenGate_Src/dirprm UPLOAD FILES TO STAGING MACHINE The files for the staging machine have been generated in C:\TEMP/ODIS_to_ODIT1/stg These files must be copied on the target machine, to the following location C:\GoldenGate \GoldenGate_Tgt using the same directory structure. For instance, files contained in C:\TEMP/ODIS_to_ODIT1/stg/dirprm should end up in C:\GoldenGate \GoldenGate_Tgt/dirprm RUN THE SOURCE OBEY FILE Connect to the source machine using a command line tool such as cmd on Windows or a shell on UNIX/Linux and execute the following command: C:\GoldenGate\GoldenGate_Src/ggsci paramfile C:\GoldenGate\GoldenGate_Src/diroby/ODISS.oby GENERATE THE DEFINITION FILE Connect to the source machine using a command line tool such as cmd on Windows or a shell on UNIX/Linux and execute the following command: C:\GoldenGate\GoldenGate_Src/defgen paramfile C:\GoldenGate\GoldenGate_Src/dirprm/ODISD.prm COPY DEFINITION FILE Copy the definition file C:\GoldenGate\GoldenGate_Src/dirdef/ODISC.def from the source machine to C:\GoldenGate\GoldenGate_Tgt/dirdef/ODISC.def on the staging machine. RUN THE STAGING OBEY FILE Connect to the staging machine using a command line tool such as cmd on Windows or a shell on UNIX/Linux and execute the following commands: C:\GoldenGate\GoldenGate_Tgt/ggsci paramfile C:\GoldenGate\GoldenGate_Tgt/diroby/ODIT1T.oby Sunday, 26 September 2010

ODI setup for OGG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

ODI setup for OGG

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Create the normal mappings in ODI

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Create the normal mappings in ODI

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Some Different Examples


Replicate datamarts and dimension tables to a dedicated query box ! Takes the query load off the DW box that was being maxed out with growing classic ETL processes ! 2 days of setup ! Point front end to new DB instance ! Can now start working on introducing OGG to the classic environment whilst still having the query box free ! Point front end back to old DB when done reengineering with OGG Keep Oracle Application Express applications in synch on dev/test/prod ! APEX applications being used (not developed) on all boxes ! Change once and dont bother with re-deploying; Very Rapid Rollout

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Conclusion
Oracle GoldenGate offers very reliable, zero down-time movement of data Useful for ! Replication ! Migration ! DR ! Data distribution ! CDC Relatively straight forward to set up ! But highly customizable ! Hundreds of parameters and settings to play with ! Secure and Encrypted ... and Fun :)

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010

Thank You For Your Attention

Questions?

T : +44 (0) 8446 697 995 E : enquiries@rittmanmead.com W: www.rittmanmead.com

Sunday, 26 September 2010