Professional Documents
Culture Documents
info@kpipartners.com
www.kpipartners.com
1-888-988-4KPI
ODI 12c Best Practices Handbook
Preface
This eBook requires the reader to have a basic
familiarity with Oracle Data Integrator (ODI) and its
components. Please refer to our ODI blogs for a
quick introduction and understanding various
concepts of ODI.
ODI is a very powerful extract, load and transform
(ELT) product when handled correctly. Unfortunately,
a few common mistakes may lead to negative
results in integration projects. This e-book compiles a
few best practices that help avoid the most
common mistakes observed in integration projects
involving ODI.
Introduction
ODI delivers high-performance data movement and
transformation among enterprise platforms with its
open and integrated ELT architecture
The latest ODI 12c version has many new features and
functionalities that deliver extreme performance,
higher productivity and is a future-ready solution that
enables you to keep up with the latest trends
including big data analytics, cloud computing, and
real-time BI
Cloud
Oracle Data Integrator • Certified for leading
technologies to deliver
fast time to value
Apps
High Performance ELT • High-performance, low
cost of ownership ELT
architecture
Declarative Design • Lightweight
Database
deployment
Extensible Knowledge
• Flexible, easy-to-enrich
Modules functionality
Big Data
Benefits
• Leverages set-based transformations
Next Generation ELT Architecture • Improves performance for loading, no
network hop
• Takes advantage of existing
infrastructure: hardware and software
Extract Load
Transform Transform
Knowledge Modules
Simpler Physical Design and Shorter Implementation Time
Pluggable Knowledge Modules Architecture
Reverse Load from
Journalize Check Integrate;
Engineer Source to Data Service
(CDC) Constraints Transform
Metadata Staging
Extended Connectivity
Leverages Existing IT, Faster Implementation Cloud
• Big Data: Spark, Hive, Pig, Hbase, Sqoop & Oozie
• Best for Oracle: Merge, Spatial, Multi-Table Insert, Big Data
Optimizer Hints and more
• Real-Time: CDC with GoldenGate
Applications
• Applications: E-Business Suite, Siebel, PeopleSoft,
JD Edwards Enterprise One, JD Edwards World,
SAP ERP and SAP BW
Databases
• Heterogeneous: Optimizations for all major
RDBMS: IBM DB2, Microsoft SQL Server, Teradata,
Netezza etc.
Legacy
Topics
Repository Management
Knowledge Modules
Topology Configurations
Enforcing Data Quality
Migration Utility
Repository Management
ODI 12c repositories include a Master and Work
repository. Master repository holds the topology and
security information, whereas the work repository holds
the model/project information.
Repository Management
• Ensure when backups are performed, both Master
and Work repositories backups are created
Repository Management
Each ODI repository gets a unique ID at the time of
creation. While creating multiple repositories, you
should make sure that all repositories are created with
strictly different IDs (even on different environments like
dev/qa/prod), and you should define and document
the process for moving objects between repositories
using import export, or versioning.
Knowledge Modules
Knowledge Modules (KMs) are powerful framework
used at integration points in ODI. A large number of
KMs are available out of the box and support a large
number of database features. Its essential these KM’s
are used in according to the use case and not to
over-complicate mappings when simpler KM’s can do
the job.
KM Features
• The KM choice is critical when designing mappings. KM selection drives the features
available and the performances of the mappings.
• Start with simple KMs, do not over-engineer by selecting complex KMs or activating
complex options. Pay close attention to the KM options as simpler KM’s might be
sufficient in certain cases.
• KMs with extra features have an extra cost in terms of performance. For example,
performing simple insert only is faster and efficient than performing an incremental
update. If the use case deems only inserts are necessary or of targets are truncated
prior to load, using incremental update KM is an over-kill and could degrade the
performance.
• Similarly, activating or deactivating some of the KM features may bring in few
additional steps that may impact the performance.
Topology Configuration
• In ODI, all executions are performed on a Logical Architecture (Logical schemas,
logical agent), that resolves to a Physical Architecture (real/physical source/targets
data servers/schemas and ODI run-time agents) with the help of Context.
• Contexts allow you to switch the execution of the artifacts from one environment
(context) to another easily.
• Another common mistake is forgetting to perform the logical/physical architecture
mapping in a given context. This is a topology administration mistake that leads to
executions not working in a given context. Ensure all the logical resources are
mapped to physical resources in every context used.
• You should never specify/use any qualified physical object names such as the
database name or schema name in the mappings from Designer components.
Because they may change depending on the execution context. It’s a good
practice to use substitution methods in such cases to make the design context
independent.
Migration Utility
ODI being Oracle’s strategic data integration product,
oracle’s older integration suite, OWB is slowly entering
wilderness. Oracle has provided a migration tool for
customers using OWB to quickly migrate to ODI. Some
of the key things to keep in mind while performing
migration:
Migration Utility
Ensure OWB and ODI clients connecting to the repository are closed before running the
migration utility. It can not read the OWB metadata if there is an active OWB repository
connection. Migration would also slow down if any an ODI connection is active.
References
For ODI beginners, these resources provide valuable
insights and could get you started on the ODI
voyage: