You are on page 1of 82

<Insert Picture Here>

Oracle PTS GoldenGate Workshop for partners

Agenda
• • • • • • Introduction Use Cases Break / VirtualBox Installation & Import Architecture Configuration Overview ands!on "a#s

Oracle $olden$ate %volution
Company Strength and Ser ice 1c2uired +y Oracle in 3$$0

GoldenGate Soft"are esta+lished in /00#

Glo+al sales and support

!apid Gro"th in Strategic Partners

*sta+lished, -oyal Customer .ase

#$$% customers&&& '$$$% solutions implemented( in )# countries

$olden$ate is &trategic to Oracle
' .est4in4class leader in real4time data solutions ' Complements e5isting Oracle products ' Continuous 1 aila+ility for heterogeneous systems ' !eal4time data access for !eporting ' !eal4time data for .I, *P6, *5adata ' 7ero4do"ntime migrations 8 upgrades to Oracle 9ata+ase and 1pplications ' Over 400 customers with 4,000+ implementations across Fortune 500 companies: Financial Services, Communications, Healthcare, Public Sector, Retail !tilities in"ustries ' Top ) of # largest commercial +anks ' Top ) of ) +usiest 1T6 net"orks ' Top : of /$ financial data ser ices companies ' Top ' of # telecommunications pro iders ' Top ) of # largest food ; drug stores

'

port2olio() 3ames /obielus.Industr( )roof )oints #Oracle will become more competitive in "ata inte$ration tools an" ma% enhance its hi$h&availabilit% pro"ucts b% bu%in$ 'ol"en'ate() *e" Frie"man.traction to support real&time "ata warehousin$ an" -.t1s +uite a catch 2or Oracle in that it1s a si$ni2icant a""ition to its "ata warehousin$ an" -. as well as master "ata mana$ement an" other operational use cases() Rob /arel. Forrester0 #. 'artner <*his is a critical re+uirement to enable hi$h volume "ata e.. Forrester .

o downtime during planned outage ' "oad #alancing & *ata distri#ution !eal4Time Information 1ccess for Intelligence .usiness Operations Continuous 1 aila+ility of Critical 1pplications and 9ata ' Continuous Uptime in event of disaster ' . Impro e *fficiencies ' Choose #est s(stem for need ' /oderni0e "egac( &(stems ' Offload for reporting . 9ecisioning ' Instantl( availa#le *ata for +eporting ' Access to -e( Information for Anal(sis ' Across eterogeneous &(stems -o"er IT Spend .ime *ata 4hile -o"ering IT Costs and Gaining Operational *fficiencies !eal4Time .Customers *emand Continuous +eal .

-usiness . le$ac%.Oracle $olden$ate The Solution for *nterprise4"ide !eal Time 9ata =eeds 5atabase an" applications. O7*P. an" per2ormance o2 critical "ata across enterprise s%stems( : . 6i. reliabilit%. Reportin$ 2or Customers.e" sources. enablin$ companies to "ramaticall% improve the availabilit%. O78P !eal4time information 6ission Critical 8pplications 5ata. "istribute" s%stems.ntelli$ence. Partners 9mplo%ees !eal4time 1ccess Oracle 'ol"en'ate "elivers real&time access o2 real&time in2ormation.

Oracle )roducts for *ata /ovement
Comparing Ho" They Work

9isaster !eco ery ; 9ata Protection !edo in 6emory .uffer
9irect 6emory 1ccess

1cti e 9ata Guard

9irect Write to -ogs

H*T*!OG*=*OAS

!eal Time 9ata Integration ; High 1 aila+ility
!ead On49isk -ogs

GoldenGate

?ast S@-

9ata Integration for 9ata Warehouse ; SO1

S@- @uery

9ata Integrator

Set4+ased, Comple5 S@-

>

Complementar( and Used ,ogether
1cti e 9ata Guard and GoldenGate

Heterogeneous 9istri+uted Oracle Su+set GoldenGate !eplicas Oracle 9. Primary

Oracle 1cti e 9ata Guard

Oracle 9. Stand+y

9ata 9istri+ution 8 SynchroniCation
' *nterprise4"ide heterogeneous replication ' 7ero do"ntime operations ' =on4in asi e +y reading data+ase logs ' Supports acti e4acti e scenarios ' *nsures transactional consistency ' High olumeB lo" latency ' Guaranteed deli ery across "ide area net"orks Oracle GoldenGate

9isaster !eco ery ; 9ata Protection
' ?ast failo er to physical stand+y data+ase ' ?astest solution for Oracle ' Oracle 9ata+ase only ' 1llo"s stand+y to +e open for reads to le erage customer in estment ' Transparent data protection to repair corrupted +locks on primary or stand+y

Oracle 1cti e 9ata Guard

0

Complementar( and Used ,ogether
1cti e 9ata Guard and GoldenGate
Central Hub 8ctive 5ata 'uar" Ph%sical Stan"b%

'ol"en'ate *ar$ets 'ol"en'ate Source *ar$et

*5ample of ho" a glo+al hu+ ; spoke manufacturing operation may +e deployed using +oth 1cti e 9ata Guard and GoldenGate

'ol"en'ate Source *ar$et

'ol"en'ate *ar$et

/$

Complementar( and Used ,ogether
9ata Integrator *nterprise *dition and GoldenGate
Oracle 9ata Integrator *nterprise *dition

Oracle GoldenGate

*4-T Transformation
Heterogeneous Targets

!eal4time 9ata
Heterogeneous Sources

!eal4Time 9ata Integration and !eplication
' ' ' ' 1astest real!time solution &u#!second latenc( for real!time feeds $uarantee deliver( eliminates data loss %liminates down!time for migration and upgrades ' "east intrusive to source s(stems ' "everage %",/%," for complex transformation

.ulk 9ata 6o ement and Transformation
' $UI design environment for %," developers ' 1astest %!", &olution ' Optimi0ed &%,!#ased transformation for high volume transformations ' *ata lineage for improved managea#ilit( ' Integrates to *ata 2ualit(

Oracle GoldenGate

Oracle 9ata Integrator *nterprise *dition

//

4 on target data warehouse ' )eriodic mini!#atches 567 min8 ' .usiness Intelligence Oracle GoldenGate ' +eal time extracts from Source / *6P 9*PT Oracle 9ata Integrator ** ' igh )erformance 3%!".ransform in the *ata#ase ' .ever go #ack to sources transactional s(stems ' .ime *ata Integration OracleDs Ani2ue Offering for !eal Time .on!invasive on sources ' Continuous streaming load into O*& &chema of target ' "atenc( in seconds Oracle 9ata Integrator On49isk -ogs Oracle GoldenGate Source 3 *6P 9*PT 9I6 ?1CT 9I6 Oracle GoldenGate On49isk -ogs *6P 9*PT 9I6 9I6 O9S Schema 9W Schema /3 .Oracle +eal .

illion Transactions each year.+eal!time Business *elivers Value & +OI 0$E reduced reco ery time for mission4critical transactional application WorldDs . and Cero outages /$$E paperless en ironment dri es efficiency and impro es patient care across hospital Montefiore Swedbank /$$E a aila+ility during phased upgrade for 3'5: critical C!6 application HSN FG producti ity gains in manufacturing plant "ith real4 time data AMD .usiest 1T6 =et"ork !emains Continuously 1 aila+le Bank of America VocaLINK Processing > / .

ulk Operations  Compression  One4to46any. !o". 6any4to4One  Cascade             Transaction Integrity Transparent Capture Guaranteed 9eli ery Conflict 9etection. Column ?iltering  G6-.Oracle $olden$ate Advantages 6o ement 6anagement Integration  Speed H Su+second -atency  Iolume H Thousands of TPS  -og4+ased Capture  =ati e.atch * ent 6arkers  Heterogeneous 9ata Sources  6apping  Transformation  *nrichment  9ecoupled 1rchitecture  Ta+le. 1SCII. -ocal 1pply  *fficient IO and . !esolution 9ynamic !oll+ack Incremental T96 Initial 9ata -oad GAI4+ased 6onitoring and Configuration Proacti e 1lerts *ncryption !eal4Time 9eferred or . S@?ormats  @ueue Interface  Stored Procedures  Aser *5its  *T.Integration  Ja a8J6S Integration .and"idth Asage  .idirectional  Group Transactions  .

Oracle $olden$ate9 *ata#ases and )latforms 9ata+ases O8S and Platforms Capture9  Oracle  IB/ *B:  /icrosoft &2" &erver  &(#ase A&%  Ingres  .eradata  %nscri#e  &2"//)  &2"//.) "inux &un &olaris ) .ete00a  An( O*BC compati#le data#ases  %.+UBC ) OpenV/& IB/ AI. ) ." products  =/& message >ueues or topics ?indows :@@@< :@@A< .eoview< .on&top )!U. IB/ 0/O& IB/ O&/AD@ IB/ O&/C@@ . *eliver(9  All listed a#ove  /(&2"< ) .

Targets 6aintains Transactional Integrity 4 !esilient against interruptions and failures *5tensi+le . transformation. modular architecture 4 Heterogeneous sources . routing.Oracle $olden$ate . -o" Impact. ?le5i+le !elia+le 16 /F . Su+4second latency Open. and delivery of database transactions across heterogeneous environments in realtime Key 9ifferentiatorsL Performance =on4intrusi e.echnolog( *ifferentiators Oracle GoldenGate provides low-impact capture.

Agenda • • • • • • Introduction Use Cases Break / VirtualBox Installation & Import Architecture Configuration Overview ands!on "a#s .

CO & Improved +OI 9ata 9istri+ution .I *9W @uery Offloading ' ighl( 1lexi#le ' 1ast *eplo(ments ' "ower .eeds ' *eplo( for Continuous Availa#ilit( and +eal!time *ata Access for +eporting / BI 9isaster !eco ery. 1cti eN 7ero 9o"ntime 6igration and Apgrades 7o$ -ase".eeds ' &tandardi0e on &ingle .Oracle $olden$ate Use Cases %nterprise!wide &olution for +eal .echnolog( for /ultiple . Real& *ime Chan$e 5ata Capture Operational !eporting OGG !eporting 9ata+ase *TO9S *T*9W Heterogeneous Source Systems !eal4time .ime *ata . 9ata Protection Stand+y MOpen .

-e( )la(s for Oracle $olden$ate /0 .

CO via platform changes  "ow latenc( data movement #etween O".2uer( Offloading Use Case 9ata+ase TieringL Sa e 6illions and 9ri e !e enue Business Challenges9  %nsure continuous availa#ilit( of Air . evolving our overall approach in parallel with the future of online travel commerce.ime *ata Integration for ElookersF >uer( activit( on lower cost platform +esults9  H@I . /&F T.9ata+ases on -inu5 “GoldenGate…provided the glue to move the data across systems.ravel &hopping %ngine 5A.” . #abre 3$ .CO reduction J millions of dollars in savings  igher customer satisfaction ! improved response times and availa#ilit( 9ata+ase Tiering *na+les Top Performance. !" of #ystems "lanning $ "erformance.James arding.&%8 throughout upgrades and migrations  Optimi0e s(stem performance to handle growth and scale< while reducing .8day <-ookupsO /#F 6yS@.$$$ p8hour. Anlimited Scala+ility 8ir *ravel Shoppin$ Sche"ule 8vailabilit% Chan$es 8ccounts -illin$ Oracle 9ata+ases Sche"ule 8vailabilit% !p"ates Fare Rule !p"ates GoldenGate Transaction Apdates Ap to >$$.) 5E#ookersF8 and search data#ase 5ElookersF8 $olden$ate &olutions9  Gero *ata#ase *owntime during hardware and data#ase migration for A.&%  *ata#ase .iering insures high availa#ilit(< top performance and lower costs  +eal!.

asel. A. Sy+ase . international client +ase for "ealth management. S"itCerland. 6S S@. *nterprise4Wide 9ata 6o ement CO6P1=P OI*!II*W Head2uartered in 7urich and .S is the market leader in retail and commercial +anking& Oracle P!OII9*SL ' 9ata distri+ution among internal applications ' 9ata distri+ution for read4only archi ing and reporting ' 9ata+ase High 1 aila+ility and 9isaster Tolerance ' 9ata+ase rolling upgrade8acti e migration ' Topology includes one4"ay and multi4master on Oracle instances !*SA-TS  !eplaced Sy+ase !eplication Ser er product and standardiCed on GoldenGate for all data mo ement  !educed costs +y eliminating mid4tier ser ers  !eplicating all heterogeneous data+ases across the enterprise protects against do"ntime& CH1--*=G*S 8 OPPO!TA=ITI*S  -arge.S is one of the "orldQs leading financial firms& It ser es a discerning. Heterogeneous en ironment for /$$ +ack office applications  =umerous installations that re2uire a fle5i+le solution& MOracle. Comple5 .Ser erN for +oth production and de elopment& 3/ . A.Continuous Availa#ilit( Use Case 9ata 9istri+ution . in estment +anking and asset management& In S"itCerland.

-ene2its Pro"ucts Oracle Oracle Oracle S@Ser er Oracle 9ata 6art !eportingL .'mit (u)her*ee.+eal!time *ata Integration Use Case Operational +eporting & BI . boom & full speed ahead.eporting #ervices. Pa%roll.usiness ChallengesL  Common real4time reporting functionality across 19P product suites  1+ility to do cross4product reporting  Incremental re enue opportunity and impro ed customer ser ice  !eporting gets mo ed off from <productionO data+ases GoldenGate SolutionL  -i e !eporting for real4time data consolidation from '$% source systems into a centraliCed target  6inimal footprint and data latency  6aintains data integrity  1+ility to support data transformations and data security <19P !eportingO R Consolidate Product -ine 9ata to Off4load !eal4Time !eporting 40+ Source S%stems in 8SP 9nvironment: HR. '+" 33 .usiness O+Sects. Crystal “%ith GoldenGate it was boom. #enior +irector of . boom.” .

" for data re>uiring heav( transformationsL 5ual 8ctive Customer Claims Processing MS1S . . +irector of +ata %arehousing.iberty (utual 3) ." investment to achieve near real!time data feedsL GoldenGate SolutionL  +eal!.IN !esultsL  +educed claims litigation costs #( :@I !   Teradata Warehouse ena#led #( faster and more responsive emplo(ee intelligence on claims dataL Improved resource utili0ation efficienc( #( 7I /anagement team can now d(namicall( monitor reserve threshold to increase profita#ilit(L “*ata is not a #usiness pro#lemK It is the foundation of our a#ilit( to #e profita#le in a rapidl( changing marketplaceL” .3 6ainframe 9.-ric "ost.ime C*C co!exists with Informatica %.usiness ChallengesL  )rovide up!to!second data in centrali0ed   Operational Systems 9.ime *ata ?arehousing captures NC@  million transactions per da( from heterogeneous operational sourcesL +eal!.3 -AW enterprise data warehouse for #usiness users 5customer claims processing for maMor incidents8 Integrate data from multiple operational s(stems 5*B: on 0/O& and "U?8 "everage existing %.ime Business Intelligence Use Case Active *ata ?arehouse Improves Customer &ervice Active %nterprise Intelligence .+eal .

Agenda • • • • • • Introduction Use Cases Break / VirtualBox Installation & Import Architecture Configuration Overview ands!on "a#s .

ote9 Virtual#ox vAL:LH for ?indows .VirtualBox Installation & Import • Cop( #oth ?orkshop *V*s to a single director( on (our local harddrive *ownload and install lateset VirtualBox version from http9//virtual#oxLorg – .+o5 – ?ile 4> Import 1ppliance – Choose &o f file .) is included on *V* • After Installation9 – Start Iirtual.

Agenda • • • • • • Introduction Use Cases Break / VirtualBox Installation & Import Architecture Configuration Overview ands!on "a#s .

Oracle $olden$ate *ata Capture and *eliver( Oracle $olden$ate.ransactional *ata /anagement9 • )rimaril( used for change data capture and deliver( from data#ase transaction logs • Can optionall( #e used for initial load directl( from data#ase ta#les – %speciall( useful for s(nchroni0ing heterogeneous data#ases – *ata#ase!specific methods ma( #e prefera#le for homogeneous configurations .

trans !ormin" t$e data as re(uired# Capture ' ource Trai& LAN / WAN / Internet (TCP/IP) Tar" et Trai& De&i)er Sour ce Dat abase( s) 3> D e&i)er Tar" et Trai& ' ource Trai& Capture Bi di r ect i onal Tar get Dat abase( s) .ow It ?orks9 /odular Architecture Capture: Committed c$an" es are captured (and can %e !i&tered) as t$e occur % readin" t$e trans action &o" s # Trai& !i&es : ' ta" es and (ueues data !or routin" # Route: Data is compres s ed. encr pted !or routin" to tar" ets # De&i)er : App&ies data *it$ trans action inte" rit .

tract Transaction Lo" 'er)er Co&&ector Rep&icat Tar"et Data%ase Trai& -ana"er -ana"er .Change *ata Capture & *eliver( 'ource Data%ase Net*or. (TCP/IP) +.

Change *ata Capture & *eliver( using a *ata )ump 'ource Data%ase Net*or.tract Transactio n Lo" Loca& Trai& Data Pump 'er)er Co&&ector Remote Trai& Rep&icat Tar"et Data%ase -ana"er -ana"er . (TCP/IP) +.

)repare %nvironment9 /anager ! Overview -ana"er • )erforms s(stem management and monitoring tasks – &tarting $olden$ate &erver Collector processes – &tarting *(namic &erverCollector< +eplicat or $$&CI processes – %rror and lag reporting – $olden$ate trail management / purging • )arameter 1ile – mgrLprm file in $$& L/dirprm director( • %vent information written to ggserrLlog file • &tart with9 GGSCI> START MANAGER .

Change Capture9 %xtract ! Overview • %xtract can #e configured to9 +.tract – Capture changed data from data#ase logs – *istri#ute data from local trails to remote s(stems 5data pump8 – Capture data directl( from source ta#les for initial data load .

asks J Change Capture &ource &(stem • Add a primar( %xtract 5reading from source transaction logs8 with an associated parameter file • Optionall(< add a local trail and a data pump %xtract 5reading from the local trail8 with an associated parameter file • Add a remote trail • &tart the %xtract5s8 .Configuration .

*ata )umps ! Overview Data Pump • *ata is stored in a local trail file on the source s(stem • A second %xtract process< the *ata )ump9 – +eads this trail and sends to one or more targets – /anipulates the data or passes it through without change • +easons for using9 – – – – A safeguard against network or target failures .o #reak complex filtering and transformation into phases .o s(nchroni0e one source with multiple targets .o consolidate data from man( sources .

*ata )umps J One to /an( .rails Trai& Primar +.tract Trai& Data Pump Trai& Trai& .

arget &(stems Data Pump 1 Trai& Primar +.*ata )umps J One to /an( .tract Trai& Data Pump / Trai& Data Pump 0 Trai& .

arget &(stem9 'er)er Co&&ector – A &erver Collector process reassem#les and writes the data to a $olden$ate remote trail – A +eplicat process reads this trail and applies it to the target data#ase .Change *eliver(9 &erver Collector • On the .

a#le< row< operation – )erform data transformation – )erform data#ase operations Must as (our application performed them Rep&icat .Change *eliver(9 +eplicat • +eplicat can9 – +ead data out of $olden$ate trail files – )erform *ata 1iltering • .

asks . +%)"ICA.arget &(stem • Create a checkpoint ta#le in the target data#ase – *B"O$I. )A+A/& • Add (our initial +eplicat checkpoint into $olden$ate trails – A** +%)"ICA.est Practice • Create a parameter file for +eplicat – %*I..AB"% .Change *eliver( Configuration . – A** C %C-)OI. )0 . • &tart the +eplicat process – &..A+.

1I"%8 "ocal trail 5%.+AI"8 "ocal file 5%...rails and 1iles ! Overview • %xtract writes data to an( of9 – – – – +emote trail 5+/..%xtract .+AI"8 +emote file 5+/..1I"%8 • %xtract trails and files are unstructured< with varia#le length records – I/O performed using large #lock writes • %xtract writes checkpoints for trails during change capture9 – $uarantees no data lost during restart – /ultiple +eplicat processes ma( process the same trail • %xtract does not write checkpoints for files '$ .

rails and files can #e transported online using .o multiple trails • 1or distri#ution to multiple s(stems/disk storage devices • 1or parallel processing #( downstream processes • .C)/I) or sent in #atch using an( file transfer method '/ .rails and 1iles ! *istri#ution • %xtract can write – .o local trails< then distri#ute over I) with a *ata )ump to remote trails – .%xtract .

%xtract .ransactions are output in commit order • Operations in the transaction are grouped together< in the order the( were applied – B( default< onl( the primar( ke( and changed columns are recorded • 1lags indicate the first and last records in each transaction '3 .rails and 1iles ! Contents • %ach record in the trail contains an operation that has #een committed in the source data#ase • .

rails and 1iles ! Cleanup • .est – Configure /anager to purge used trail data Practice .emporar( storage re>uirement is small if processes keep pace .%xtract .rail files can #e purged once consumed – .

8 – Identifies the se>uence in which transactions were committed – *ata#ase platform independent – /ore efficient than using heterogeneous data#ase!supplied transaction num#ers '' .rails ! $olden$ate *ata 1ormat • B( default< trails are formatted in the $olden$ate *ata 1ormat • %ach ..um#er 5C&.rail file has a trail file header and trail records • eader Info9 Compati#ilit( "evel – Identifies the trail file format #( $olden$ate version num#ers – Allows customers to use different versions of $olden$ate %xtract< trail files< and +eplicat together • *ata 1ormat9 Commit &e>uence .

uning $uide • %xample9 Logdump> open dirdat/rt00000 .Viewing .rail 1ile Contents J "ogdump utilit( • .he "ogdump utilit( allows (ou to – *ispla( or search for information that is stored in $olden$ate trail files – &ave a portion of a $olden$ate trail to a separate trail file • &tart "ogdump from $olden$ate installation director( using logdump command • "ogdump is documented in the Oracle $olden$ate .rou#leshooting and .

tract Net*or.Initial "oad 'ource Data%ase Ta%&es +. (TCP/IP) Rep&icat 2r D3 3u&. Load 4ti&it Tar"et Data%ase 'er)er Co&&ector 1i&es -ana"er -ana"er $olden$ate initial load methods9     *irect "oad ! %xtract sends data directl( to +eplicat to appl( concurrentl( using &2" *irect Bulk "oad 5Oracle8 ! +eplicat uses Oracle &2"O"oader A)I to improve performance 1ile to +eplicat 5%xtract writes to a file that +eplicat applies using &2"8 1ile to data#ase utilit( 5%xtract writes to a file formatted for a *B #ulk load utilit(8 .

-* *5tract parametersL !6TT1SK !*P-IC1T. G!OAP <name> 199 !*P-IC1T <name>.Initial "oad9 *irect "oad 6anager Source 9ata+ase *5tract 6anager Target 9ata+ase !eplicat 199 *GT!1CT <name>. SP*CI1-!A= . SOA!C*IST1.

-* *5tract parametersL !6TT1SK !*P-IC1T.Initial "oad9 *irect Bulk "oad 5to Oracle8 6anager Source 9ata+ase Source 9ata+ase *5tract 6anager Oracle Target !eplicat S@-T-oader 1PI 199 *GT!1CT <name>. G!OAP <name> 199 !*P-IC1T <name>.A-K-O19 . SP*CI1-!A= !eplicat parametersL . SOA!C*IST1.

-* !6TT!1I-<name> .Initial "oad9 1ile to +eplicat 6anager Source 9ata+ase *5tract ?iles !eplicat Target 9ata+ase 199 *GT!1CT <name> *5tract parametersL SOA!C*IST1.

CP or S@--O19*! .CP 6anager Source 9ata+ase *5tract ?ile ?ile ?ile SSIS 199 *GT!1CT <name> *5tract parametersL SOA!C*IST1.-* !6T?I-* <name> ?O!61T1SCII .Initial "oad9 1ile to *ata#ase Utilit( S@-T -oader Target 9ata+ase .

Online versus Batch "oad • Change data capture & deliver( can #e run either continuousl( 5online8 or as a special run 5#atch run8 to capture changes for a specific period of timeL • Initial load is alwa(s a special run 5#atch run8L .

TG ) 9elete. TG / Insert.egin.egin. TG ) Insert.egin. TG 3 .Checkpointing Capture< )ump< and *eliver( save positions to a checkpoint file so the( can recover in case of failure .egin. TG ) Commit. TG 3 Commit. TG 3 . TG ) . TG ' Commit. TG ' . TG ) Insert. TG 3 Apdate.egin. TG 3 Commit. TG / Insert. TG ) Start of Oldest Open MAncommittedN Transaction Capture Checkpoint Current Write Position Current !ead Position Source 9ata+ase Capture Commit Ordered Source Trail . TG 3 Insert. TG / .egin.

TG / Insert. TG 3 Apdate. TG ) Insert. TG 3 .egin.egin.egin. TG ) Commit. TG ' . TG 3 . TG 3 Commit.egin.Checkpointing Capture< )ump< and *eliver( save positions to a checkpoint file so the( can recover in case of failure . TG / Insert. TG ) 9elete. TG ) Insert. TG ) Start of Oldest Open MAncommittedN Transaction Pump Checkpoint . TG ' Commit.egin. TG 3 Commit.egin.egin. TG / . TG 3 Commit. TG 3 Capture Checkpoint Current !ead Position Current Write Position Current Write Position Current !ead Position Source 9ata+ase Capture Commit Ordered Source Trail Pump Commit Ordered Target Trail . TG 3 Insert. TG ) . TG 3 Insert.

TG ) 9elete. TG ) Insert.egin.egin.Checkpointing Capture< )ump< and *eliver( save positions to a checkpoint file so the( can recover in case of failure . TG 3 Commit. TG ) Commit.egin. TG 3 . TG 3 Capture Checkpoint Current !ead Position Current Write Position Current !ead Position Current Write Position Current !ead Position Source 9ata+ase Capture Commit Ordered Source Trail Pump Commit Ordered Target Trail 9eli ery Target 9ata+ase . TG 3 Apdate. TG / Insert. TG 3 .egin. TG ) Insert.egin. TG ) . TG ' Commit. TG 3 Insert. TG / .egin. TG 3 Commit. TG 3 Insert. TG 3 Commit.egin. TG ' . TG ) Start of Oldest Open MAncommittedN Transaction Pump Checkpoint 9eli ery Checkpoint . TG / Insert.

Agenda • • • • • • Introduction Use Cases Break / VirtualBox Installation & Import Architecture Configuration Overview ands!on "a#s .

Start Change Capture . +na%&e Transaction Lo""in") 0# Per!orm Initia& Load ()arious met$ods) Tar"et Data%ase Transaction Lo" -ocal Trail 9ata Pump !emote Trail *5tract Rep&icat 6# Con!i"ure 7 'tart C$an"e De&i)er 3& Configure .Configuring Oracle $olden$ate 'ource Data%ase 1# Prepare t$e +n)ironment (Insta&& 2rac&e 5o&den5ate.

)repare the %nvironment &et up each s(stem9 • • • Install Oracle $olden$ate software on source and target Configure and start $olden$ate /anager on source and target If heterogeneous source/target< generate source definitions and cop( to target )repare the data#ase – – %nsure data#ase access #( $olden$ate %na#le transaction logging • .

$olden$ate Installation Access the /edia )ack • Access the product media pack 5software and documentation8 at http9//edeliver(LoracleLcom &elect )roduct )ack9 Oracle 1usion /iddleware Identif( the proper release of $olden$ate for (our source and target environments9 – Operating s(stem and version – *ata#ase and version • • .

$olden$ate Installation $olden$ate *irectories *irector( dirchk dirdat dirdef dirpcs dirprm dirrpt dirs>l dirtmp Contents $olden$ate checkpoint files $olden$ate trail and extract files *ata definitions produced #( *%1$%. and used to translate heterogeneous data )rocess status files )arameter files )rocess report files &2" scripts .emporar( storage for transactions that exceed allocated memor( .

$olden$ate Configuration )arameters< )rocess $roups and Commands • $olden$ate processes are configured #( A&CII parameter filesL • A process group consists of9 – An %xtract or +eplicat process – Associated parameter file – Associated checkpoint file – An( other files associated with that process %ach process group on a s(stem must have a uni>ue group nameL • )rocesses are added and started using the $olden$ate &oftware Command Interface 5$$&CI8 with the group nameL • $$&CI commands also add trails< check process status< etcL .

$olden$ate Configuration $$&CI %xamples &tart a /anager process GGSCI> START MGR • Add an %xtract group GGSCI> ADD EXTRACT myext TRANL!G "EGIN N!# • Add a local trail GGSCI> ADD EXTTRAIL /gg$/dirdat/rt EXTRACT myext • &tart an %xtract group GGSCI> START EXTRACT myext • Use OB%P command to run text command files9 GGSCI> !"E% $tartmgr&o'y .

$olden$ate Configuration $"OBA"& versus )rocess )arameters • $"OBA"& parameters appl( to all processes – &et when /anager starts – +eside in Q$olden$ate install director(R/$"OBA"& • )rocess parameters appl( to a specific process 5/anager< %xtract< &erver Collector< +eplicat< Utilities8 – &et when the process starts – Override $"OBA"& settings – +eside #( default in the dirprm director( in files named QprocessnameRLprm – /ost appl( to all ta#les processed #ut some can #e specified at the ta#le level .

$olden$ate Configuration %diting )arameter 1iles • %dit parameter files to configure $olden$ate processes • .he $"OBA"& parameter file is identified #( its file path GGSCI> EDIT (ARAMS &/GL!"ALS • /anager and utilit( parameter files are identified #( ke(words GGSCI> EDIT (ARAMS MGR GGSCI> EDIT (ARAMS DE)GEN • %xtract and +eplicat parameter files are identified #( the process group name GGSCI> EDIT (ARAMS *group name> .

ransformation • $olden$ate provides the capa#ilit( to transform columns #( using a set of #uilt!in functions • .$olden$ate Configuration 1unctions ! *ata .ransformation functions can #e applied for either %xtract or +eplicat • If (ou re>uire more complex functions< (ou also have the a#ilit( to call (our own logic through user exits .

$olden$ate Configuration 1unctions ! *ata .ransformation • Using column conversion functions (ou can9 – – – – – )erform string and num#er conversions %xtract portions of strings or concatenate columns Compare strings or num#ers )erform a variet( of date mappings Use single or nested I1 statements to evaluate num#ers< strings< and other column values to determine the appropriate value and format of target columns • 1unctions are identified with the S prefix .

utilit( program – *%1$%.his source definition file is used to interpret la(outs for data stored in $olden$ate trails • At start up +eplicat reads the definition file specified with the &OU+C%*%1& parameter • &erver Collector uses the Jd argument to specif( which definition file to read at startup • Can also capture target definitions on target s(stem and cop( to source s(stem for %xtract to use . produces a file containing la(out definitions of the source files and ta#les – .$olden$ate Configuration &ource *efinition Configuration • Problem J Understanding source and target la(outs across disparate s(stems and data#ases • Solution J the *%1$%.

Agenda • • • • • • Introduction Use Cases Break / VirtualBox Installation & Import Architecture Configuration Overview ands!on "a#s .

-a+ *5ercise /L Getting Started Setup en ironment and data+ase schemas .

"a# 69 $etting &tarted 6yS@6yS@.!1=CH .!1=CHU1T6 !o"s /F$$ V/#$$$ '$ VF$/3 >$$ VF$'3 Oracle Oracle OS -oginL oracle 8 oracle GG OS -oginL orgg 8 oracle GG HomeL 8u$/8oraclegg Oracle Target SchemaL orgg Ta+le 1CCOA=T 1CCOA=TUT!1=S .!1=CHU1T6 T*--*! T*--*!UT!1=S !o"s $ $ $ $ $ $ Transaction Lo" T*--*! T*--*!UT!1=S Redo Lo" .OS -oginL mys2l 8 oracle GG OS -oginL mygg 8 oracle GG HomeL 8u$/8mys2lgg 6yS@Source 9ata+aseL 6P.!1=CH .1=K Ta+le 1CCOA=T 1CCOA=TUT!1=S .

-a+ *5ercise 3L Installing and Configuring Oracle GoldenGate Soft"are .

"a# :9 $olden$ate Install & Configuration 6yS@6yS@.!1=CH .!1=CHU1T6 '$ VF$/3 >$$ VF$'3 $ GGSUCH*CKPO=T $ .!1=CH .1=K Ta+le 1CCOA=T 1CCOA=TUT!1=S Transaction Lo" T*--*! T*--*!UT!1=S GGSUCH*CKPOI=T T*--*!UT!1=S Redo Lo" .OS -oginL mys2l 8 oracle GG OS -oginL mygg 8 oracle GG HomeL 8u$/8mys2lgg GG 9.!1=CHU1T6 T*--*! $ $ $ $ Oracle Oracle OS -oginL oracle 8 oracle GG OS -oginL orgg 8 oracle GG HomeL 8u$/8oraclegg GG 9. -oginL orgg8orgg 8u$/8oraclegg 8dirchk 8dirdat 8dirdef 8dirpcs 8dirprm 8dirrpt 8dirs2l 8dirtmp SchemaL orgg Ta+le 1CCOA=T 1CCOA=TUT!1=S !o"s $ $ Oracle Target 9ata+aseL 6P. -oginL mygg8mygg 8u$/8mys2lgg 6yS@Source 8dirchk 8dirdat 8dirdef 8dirpcs 8dirprm 8dirrpt 8dirs2l 8dirtmp !o"s /F$$ V/#$$$ .

to OracleN .-a+ *5ercise )L Setting up the Initial -oad Process M6yS@.

OS -oginL mys2l 8 oracle GG OS -oginL mygg 8 oracle GG HomeL 8u$/8mys2lgg GG 9.tract +L2AD /& Initial -oad M arious methodsN Rep&icat RL2AD 2rac&e Tar"et +."a# A9 Initial "oad & Change Capture 6yS@6yS@. -oginL orgg8orgg +.tract +-A'TR Data Pump P-A'TR 'er)er Co&&ector Remote Trai& Rep&icat R-A'TR Transaction Lo" Loca& Trai& 3& Change Capture -ana"er -5R )& Change 9eli ery -ana"er -5R !edo -og . -oginL mygg8mygg Oracle Oracle OS -oginL oracle 8 oracle GG OS -oginL orgg 8 oracle GG HomeL 8u$/8oraclegg GG 9.

to OracleN .-a+ *5ercise 'L Setting up One4"ay !eplication M6yS@.

"a# C9 One!?a( +eplication 6yS@6yS@.OS -oginL mys2l 8 oracle GG OS -oginL mygg 8 oracle GG HomeL 8u$/8mys2lgg GG 9.'8L 'ource 2rac&e Tar"et 'er)er Co&&ector Rep&icat R-A'TR Oracle Oracle OS -oginL oracle 8 oracle GG OS -oginL orgg 8 oracle GG HomeL 8u$/8oraclegg GG 9.tract +-A'TR Data Pump P-A'TR Transaction Lo" Loca& Trai& Remote Trai& !edo -og -ana"er -5R -ana"er -5R . -oginL orgg8orgg +. -oginL mygg8mygg .

i4directional !eplication .-a+ *5ercise #L Setup .

-oginL mygg8mygg Oracle Oracle OS -oginL oracle 8 oracle GG OS -oginL orgg 8 oracle GG HomeL 8u$/8oraclegg GG 9."a# 79 Bi!*irectional +eplication 6yS@6yS@.OS -oginL mys2l 8 oracle GG OS -oginL mygg 8 oracle GG HomeL 8u$/8mys2lgg GG 9. -oginL orgg8orgg 6yS@9ata+ase !eplicat M6P!TN !emote Trail 9ata Pump MO!9PN -ocal Trail Transaction -og *5tract MO!GTN Transaction -og -ocal Trail 9ata Pump M6P9PN !emote Trail Oracle 9ata+ase !eplicat MO!!TN *5tract M6PGTN .

-a+ *5ercise FL -e eraging Oracle GoldenGate Transformations .

*! ' 1CCOA=TU.1=K&1CCOA=TUT!1=S ' 1CCOA=TU=A6.*! ' T!1=SU=A6.*! ' T!1=SUTS ' T!1=SUTPP* ' T!1=SU-OC ' T!1=SU16T .1-1=C* 6P. -oginL orgg8orgg O!GG&1CCOA=TU.*! ' T!1=SUTS ' 1CCOA=TU.1=K&1CCOA=T ' 1CCOA=TU=A6. <CO66ITTI6*ST16PON Oracle Oracle OS -oginL oracle 8 oracle GG OS -oginL orgg 8 oracle GG HomeL 8u$/8oraclegg GG 9. -oginL mygg8mygg WG*T*=I M<GGH*19*!O.OS -oginL mys2l 8 oracle GG OS -oginL mygg 8 oracle GG HomeL 8u$/8mys2lgg GG 9.ransformations 6yS@6yS@.1-1=C* 6P.1-UHISTO!P ' 1CCOA=TU=A6."a# B9 .*! ' T!1=SU=A6.*! ' 1CCOA=TUT!1=SUTS ' 1CCOA=TUT!1=SUTPP* ' 1CCOA=TUT!1=SU-OC ' 1CCOA=TUT!1=SU16T O!GG&1CCOA=TUT!1=SUHISTO!P ' 1CCOA=TU=A6.

-a+ *5ercise :L -e eraging Oracle GoldenGate ?iltering .

"a# T9 1iltering 6yS@6yS@. -oginL orgg8orgg 6P.OS -oginL mys2l 8 oracle GG OS -oginL mygg 8 oracle GG HomeL 8u$/8mys2lgg GG 9.1-1=C* O!GG&OI*!9!1?T HISTO!P ' 1CCOA=TU=A6.*! ' T!1=SUTS <$ ' 1CCOA=TU.1-1=C* . -oginL mygg8mygg Oracle Oracle OS -oginL oracle 8 oracle GG OS -oginL orgg 8 oracle GG HomeL 8u$/8oraclegg GG 9.*! ' 1CCOA=TU.1=K&1CCOA=T ' 1CCOA=TU=A6.