Document: Oracle Data Integrator 11g (11.1.1.

3) Installation and Configuration Guide with WebLogic server

Description:
This document is prepared to show easy steps to installation and configuration of ODI.

History:
Version Description Change Author Publish Date

0.1 0.1

Initial Draft Reviewed

Gourav Atalkar Amit Sharma

9-Oct-2010 1-Nov-2010

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

1

Installation of Oracle Data Integrator Title
1). Introduction to oracle data integrator 2). Software and Hardware requirements 3). Installation of oracle 10g Enterprise Edition 4). Creation of Repository 5). Installation of WebLogic Server 6). Installation of Oracle Data Integrator 7). Configuring and deploying ODI Console

Page No.
3 7 9 13 19 25 33

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

2

Introduction to Oracle Data Integrator
A widely used data integration software product, Oracle Data Integrator provides a new declarative design approach to defining data transformation and integration processes, resulting in faster and simpler development and maintenance. Based on a unique E-LT architecture (Extract - Load Transform), Oracle Data Integrator not only guarantees the highest level of performance possible for the execution of data transformation and validation processes but is also the most cost-effective solution available today. Oracle Data Integrator provides a unified infrastructure to streamline data and application integration projects.

Here are the key reasons why companies choose Oracle Data Integrator for their data integration needs: Faster and simpler development and maintenance: The declarative rules driven approach to data integration greatly reduces the learning curve of the product and increases developer productivity while facilitating ongoing maintenance. This approach separates the definition of the processes from their actual implementation, and separates the declarative rules (the "what") from the data flows (the "how"). Data quality firewall: Oracle Data Integrator ensures that faulty data is automatically detected and recycled before insertion in the target application. This is performed without the need for programming, following the data integrity rules and constraints defined both on the target application and in Oracle Data Integrator. Better execution performance: traditional data integration software (ETL) is based on proprietary engines that perform data transformations row by row, thus limiting performance. By implementing an E-LT architecture, based on your existing RDBMS engines and SQL, you are capable of executing data transformations on the target server at a set-based level, giving you much higher performance. Simpler and more efficient architecture: the E-LT architecture removes the need for an ETL Server sitting between the sources and the target server. It utilizes the source and target servers to
Business Intelligence Solution Providers http://www. learnhyperion.wordpress.com 3

perform complex transformations, most of which happen in batch mode when the server is not busy processing end-user queries. Platform Independence: Oracle Data Integrator supports all platforms, hardware and OSs with the same software. Data Connectivity: Oracle Data Integrator supports all RDBMSs including all leading Data Warehousing platforms such as Oracle, Exadata, Teradata, IBM DB2, Netezza, Sybase IQ and numerous other technologies such as flat files, ERPs, LDAP, XML. Cost-savings: the elimination of the ETL Server and ETL engine reduces both the initial hardware and software acquisition and maintenance costs. The reduced learning curve and increased developer productivity significantly reduce the overall labor costs of the project, as well as the cost of ongoing enhancements.

Oracle Data Integrator Component Architecture:
The Oracle Data Integrator platform integrates in the broader Fusion Middleware platform and becomes a key component of this stack. Oracle Data Integrator provides its run-time components as Java EE applications, enhanced to fully leverage the capabilities of the Oracle WebLogic Application Server. Oracle Data Integrator components include exclusive features for Enterprise-Scale Deployments, high availability, scalability, and hardened security.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

4

Repositories:
The central component of the architecture is the Oracle Data Integrator Repository. It stores configuration information about the IT infrastructure, metadata of all applications, projects, scenarios, and the execution logs. The Oracle Data Integrator Repository is composed of one Master Repository and several Work Repositories. Objects developed or configured through the user interfaces are stored in one of these repository types. There is usually only one master repository that stores the following information: 1) Security information including users, profiles and rights for the ODI platform 2) Topology information including technologies, server definitions, schemas, contexts, languages and so forth. 3) Versioned and archived objects. The work repository is the one that contains actual developed objects. Several work repositories may coexist in the same ODI installation (for example, to have separate environments or to match a particular versioning life cycle). A Work Repository stores information for: 1) Models, including schema definition, data stores structures and metadata, fields and columns definitions, data quality constraints, cross references, data lineage and so forth. 2) Projects, including business rules, packages, procedures, folders, Knowledge Modules, variables and so forth. 3) Scenario execution, including scenarios, scheduling information and logs. When the Work Repository contains only the execution information (typically for production purposes), it is then called an Execution Repository.

ODI Studio and User Interfaces:
Administrators, Developers and Operators use the Oracle Data Integrator Studio to access the repositories. ODI Studio provides four Navigators for managing the different aspects and steps of an ODI integration project: 1) Designer Navigator is used to design data integrity checks and to build transformations such as for example: • Automatic reverse-engineering of existing applications or databases • Graphical development and maintenance of transformation and integration interfaces • Visualization of data flows in the interfaces • Automatic documentation generation • Customization of the generated code

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

5

2) Operator Navigator is the production management and monitoring tool. It is designed for IT production operators. Through Operator Navigator, you can manage your interface executions in the sessions, as well as the scenarios in production. 3) Topology Navigator is used to manage the data describing the information system's physical and logical architecture. Through Topology Navigator you can manage the topology of your information system, the technologies and their datatypes, the data servers linked to these technologies and the schemas they contain, the contexts, the languages and the agents, as well as the repositories. The site, machine, and data server descriptions will enable Oracle Data Integrator to execute the same integration interfaces in different physical environments. 4) Security Navigator is the tool for managing the security information in Oracle Data Integrator. Through Security Navigator you can create users and profiles and assign user rights for methods (edit, delete, etc) on generic objects (data server, datatypes, etc), and finetune these rights on the object instances (Server 1, Server 2, and so forth).

Run-Time Agent:
At design time, developers generate scenarios from the business rules that they have designed. The code of these scenarios is then retrieved from the repository by the Run-Time Agent. This agent then connects to the data servers and orchestrates the code execution on these servers. It retrieves the return codes and messages for the execution, as well as additional logging information – such as the number of processed records, execution time and so forth - in the Repository. The Agent comes in two different flavors: • • The Java EE Agent can be deployed as a web application and benefit from the features of an application server. The Standalone Agent runs in a simple Java Machine and can be deployed where needed to perform the integration flows.

Oracle Data Integrator Console:
Business users (as well as developers, administrators and operators), can have read access to the repository, perform topology configuration and production operations through a web based UI called Oracle Data Integrator Console. This web application can deployed in a Java EE application server such as Oracle WebLogic. To manage and monitor the Java EE and Standalone Agents as well as the ODI Console, Oracle Data Integrator provides a new plug-in that integrates in Oracle Fusion Middleware Control Console.

System Requirements
Business Intelligence Solution Providers http://www. learnhyperion.wordpress.com 6

Operating system: Windows, UNIX, Sun Solaris, HP-UX, IBM AIX, Red Hat Enterprise Linux on Intel-compatible x86 RAM: Minimum: 512 MB Disk space: Minimum: 300 MB of free space to install the software and 1 GB of free space on the drive that contains the temporary directory used by ODI components. JDK (java development toolkit): Install jdk-6u18-windows-i586 Repository Database: The Repository can be installed on any relational database engine supporting ANSI ISO 89 syntax, such as Oracle, Microsoft SQL Server, Sybase AS Enterprise, IBM DB2 UDB, IBM DB2/400, etc. The storage space requirements for repositories are the following: • Master Repository: 30 Mb of storage space. • Work Repository: 40 Mb of storage space. Note that the storage space required may vary depending on the size of your models and projects, and on the volume of execution logs you keep in this repository. A TCP/IP network.

Downloading the ODI Installer and Repository Creation Utility

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

7

http://www.oracle.com/technetwork/middleware/data-integrator/downloads/index.html

Downloading the WebLogic Server Installer
http://www.oracle.com/technetwork/middleware/downloads/index-087510.html

Installation of Oracle 10g Database
Business Intelligence Solution Providers http://www. learnhyperion.wordpress.com 8

Step: 1) Run the installer of Oracle 10g Database.

Step: 2) Enter database password for system account.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

9

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

10

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

11

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

12

Creation of Repository
Step:1) Now copy the rcu_home directory to c drive and then run the following command:

On Windows operating systems:
cd RCU_HOME\bin rcu.bat

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

13

Step: 2) Select the create radio button for creating new master and work repository into database.

Step:3) Enter your database type we are using oracle 10g that’s why we are specifying oracle database. Enter your system name in host name textbox, next is port name for oracle it is 1521 and service name is orcl . After that you need to specify user name and password for one schema which has DBA privileges. Click ‘Next’.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

14

Step: 4) It will create all the related metadata into database.

Step: 5) Now select Oracle data integrator from the component list and give appropriate name to schema which contains master and work repository.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

15

Step: 6) Enter password for schema which contains master and work repository.

Step: 7) Enter details for master repository and work repository.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

16

Step: 8) This screen will show you the default table space name and temporary table space name for the master and work repository. Click ‘Next’ to proceed.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

17

Step: 9) This screen shows the details of Repository. Click on create button for creating repository.

Step: 10) Repository is create now.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

18

Installation of WebLogic Server
WebLogic Server is used to configure the Oracle data Integrator Console. Download it from following link: http://www.oracle.com/technetwork/middleware/downloads/index-087510.html and run the installer wls1033_oepe111150_win32 .

Step: 1) Click ‘Next’ to continue.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

19

Step: 2) This installation wizard will ask you to select Middleware home directory, by default it will install into your default windows directory.

Step:3) If you want to receive the security updates from oracle enter your email address and your oracle support password otherwise bypass it.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

20

Step: 4) Select the type of installation you want to perform. Select custom for advance option.

Step: 5) Select the components you want to install other then default components.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

21

Step: 6) This screen will show you list of java virtual machine installation components.

Step: 7) Here you have to provide the directories where you want to install the weblogic server components.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

22

Step: 8) This will install the windows service to make indicated functionality available after machine reboot. You can select ‘No’ if not required. Click ‘Next’.

Step: 9) Select the location for shortcut if you want to show oracle shortcut to all profile select All users it’s recommended. Click ‘Next’.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

23

Step: 10) This screen shows the installation summary.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

24

Installation of oracle Data Integrator
Step: 1) Run the installer from the Disk 1 directory of Oracle data Integrator unzipped folder.

Step: 2) Select all the components check box for installing all the components from the given list.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

25

Step: 3) This screen will shows the prerequisite checks for oracle data integrator.

Step: 4) Specify the installation location for ODI by default it will installed into the weblogic server directory.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

26

Step: 5) If you have previously created the repository you can configure the ODI else you can skip it.

Step: 6) Specify database type, Connection string, repository user name and password that you have specified previously during the time of repository creation. Click ‘Next’.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

27

Step: 7) Enter the password for the user SUPERVISOR it is SUNOPSIS.

Step: 8) Select the work repository.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

28

Step: 9) Specify details of agent name and port. Click ‘Next’.

Step: 10) This screen will shows the installation summary. Click ‘Install’ to continue.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

29

Step: 11) This screen will shows the installation progress.

Step: 12) Click ‘Next’.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

30

Step: 13) Click ‘Finish’.

Step: 13) Go to Start programs oracle oracle Data Integrator ODI Studio. When you first time start the ODI Studio it will ask you for the root of JDK bin directory for java.exe.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

31

This is the Oracle Data Integrator start Page

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

32

Configuring and Deploying the ODI Console
Oracle Data Integrator Console:
The new Oracle Data Integrator Console replaces and unifies the former 10g Metadata Navigator and Lightweight Designer components. This web interface for production operations has been rewritten using the ADF-Faces Ajax Framework for a rich user experience. Using this console, production users can set up an environment, export and import the repositories, manage run-time operations, monitor the sessions, diagnose the errors, browse design-time artifacts and generate lineage reports. This web interface integrates seamlessly with Oracle Fusion Middleware Control Console and allows Fusion Middleware administrators to drill down into the details of any Oracle Data Integrator designtime and run-time object.

Pre Requisite:
1) Oracle Data Integrator 11g (11.1.1) installed on client machine. 2) Master Repository and Work Repository created in oracle database. 3) WebLogic Server 11g R1 installed on same client machine.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

33

Step:1) After the complete installation of odi and web logic server now go to the start programs oracle web logic web logic server 11g R1 tools configuration wizard

Step: 2) You will get following screen select create a new weblogic domain. And press next.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

34

Step: 3) Select the Following options as shown below.

Step: 4) Give a meaningful domain name.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

35

Step: 5) Provide the Administrator User Name and Password ,required to login into domain account.

Step: 6) Select the required JDK from the options

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

36

Step: 7) Provide the details of the MASTER Repository account

Step: 8) Provide the details of the WORK Repository account

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

37

Step: 9) Click Next and test the accounts. If you have error in this step , its means the account information is wrong , Please go back and do the required changes and once the account are correct ,you will get a Test successful message.

Step: 10) Click the Following as we need to do few settings changes.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

38

Step: 11) If required change the Listener address to the required IP address or hostname you want to domain to be and similarly the Port No. For this post the default is used.

Step: 12) Configure the Machine Name with Node Manager Listener address and Port.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

39

Step: 13) Assign the Server; although by default the odi_server1 is assigned but I have assigned Adminserver too so that I can access the odiconsole from 7001 port itself.

Step: 14) Make sure you check the option oraclediagent and odiconsole under Application.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

40

Step: 15) Check the JDBC Services and odiMasterRepository and odiWorkRepository

Step: 16) Confirm all the setting and options are correct and click on Create.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

41

Step: 17) Finally, you will get a Domain created with the Admin Server URL. Check mark Start Admin Server.

Step:18) if you have not start the services of admin server then Go to start program weblogic server User projects Admin server start admin server for weblogic server domain.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

42

Step: 19) It will show the following start screen and the service for the admin server is started now.

Step: 20) Again Go to start program weblogic server User projects Admin server admin server console or your Web Browser and type in the following address – http://localhost:7001/console/login/LoginForm.jsp Change the local host and port to whatever is listed in the Admin Server URL above .

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

43

Step: 21) Once logged in, Under Environment – > click on Servers.

Step: 22) You will able to see all the Server.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

44

Step: 23 ) Click on Adminserver . You will be taken to a page as shown below, click Deployments and you will be able to see odiconsole, oraclediagent.

Step:24) Expand odiconsole and you will be able to see odiconsole under Modules. Click that and you will be taken to another page.

Step: 25) Go to Testing tab and expand odiconsole there finally we got our URL. Click the URL on default. http://localhost:7001/odiconsole

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

45

Step: 26) Once logged in you will be able to see the Master and Work Repository.

Step: 27) Use the required SUPERVISOR account to login

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

46

Step: 28) Sample Master Repository Console Screen.

Step: 29) Sample Work Repository Console Screen.

Business Intelligence Solution Providers

http://www. learnhyperion.wordpress.com

47