Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Look up keyword
Like this
16Activity
0 of .
Results for:
No results containing your search query
P. 1
External Loading Overview

External Loading Overview

Ratings: (0)|Views: 742|Likes:
Published by ypraju

More info:

Published by: ypraju on Dec 22, 2009
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as DOC, PDF, TXT or read online from Scribd
See more
See less

12/20/2012

pdf

text

original

 
External Loading Overview 
PenchalaRaju.Yanamala
You can configure a session to use IBM DB2, Oracle, Sybase IQ, and Teradataexternal loaders to load session target files into their respective databases.External loaders can increase session performance by loading informationdirectly from a file or pipe rather than running the SQL commands to insert thesame data into the database.Use multiple external loaders within one session. For example, if a mappingcontains two targets, you can create a session that uses an Oracle externalloader connection and a Sybase IQ external loader connection.For information about creating external loader connections, seeExternal Loader Connections.
Before You Begin
Before you run external loaders, complete the following tasks:
Disable constraints.
You disable constraints built into the tables receiving thedata before performing the load. For information about disabling constraints, seethe database documentation.
Turn off or disable database logging.
To preserve high performance, you canincrease commit intervals and turn off database logging. However, to performdatabase recovery on failed sessions, you must have database logging turnedon.
Configure code pages.
IBM DB2, Oracle, Sybase IQ, and Teradata databaseservers must use the same code page as the target flat file code page. TheIntegration Service creates the control files and target flat files using the targetflat file code page. If you use a code page other than 7-bit ASCII for the targetflat file, run the Integration Service in Unicode data movement mode.
Configure the external loader connection as a resource.
If the IntegrationService is configured to run on a grid, configure the external loader connectionas a resource on the node where the external loader is available. For moreinformation, see the PowerCenter Administrator Guide.
External Loader Behavior 
When you run a session that uses an external loader, the Integration Servicecreates a control file and a target flat file. The control file contains informationsuch as data format and loading instructions for the external loader. The controlfile has an extension of .ctl. You can view the control file and the target flat file inthe target file directory.When you run a session, the Integration Service deletes and recreates the targetfile. The external loader uses the control file to load session output to thedatabase. The Integration Service processes datetime data before loading to thedatabase in the following ways:If the session is configured to trim subseconds, the Integration Serviceprocesses datetime data with a precision of 19.
 
If the session is not configured to trim subseconds, the Integration Serviceprocesses datetime data based on the precision specified in the target flat file.Precision ranges from 19 to 29. Subseconds are trimmed according to theprecision specified.If the precision specified in the target file is greater than that specified for thedatabase, the Integration Service limits the precision to the maximum precisionspecified for the database.The Integration Service waits for all external loading to complete before itperforms post-session commands, runs external procedures, and sends post-session email.The Integration Service writes external loader initialization and completionmessages in the session log. For more information about the external loader performance, check the external loader log. The loader saves the log in the samedirectory as the target flat files. The default extension for external loader logs is.ldrlog.The behavior of the external loader depends on how you choose to load the data.You can load data to a named pipe or to a flat file.
Loading Data to a Named Pipe
The external loader starts to load data to the database as soon as the dataappears in the pipe. The loader deletes the named pipe as soon as it completesthe load.On UNIX, the Integration Service writes to a named pipe that is named after theconfigured target file name.On Windows, the Integration Service writes data to a named pipe using thespecified format:\\.\pipe\<pipe name>The pipe name is the same as the configured target file name.
Staging Data to a Flat File
When you stage data to a flat file on Windows or UNIX, the Integration Servicewrites data to a flat file, which is named after the configured target file name. Theexternal loader starts loading data to the target database after the IntegrationService writes all the data to the target flat file. The external loader does notdelete the target flat file after loading it to the database. Make sure the target filedirectory can accommodate the size of the target flat file.
Note:
The Integration Service rounds numerical values based on the scale of theport when staging data to a flat file. It does not round results when you use anexternal loader that loads the data to a named pipe or if you configure the targetfor a normal load.If a session aborts or fails before the Integration Service writes all the data to theflat file target, the external loader does not start. If a session aborts or fails after 
 
the Integration Service writes all the data to the flat file target, the external loader completes loading data to the target database before the external loader exits.
Partitioning Sessions with External Loaders
When you configure multiple partitions in a session using a flat file target, theIntegration Service creates a separate flat file for each partition. Some externalloaders cannot load data from multiple files. When you use an external loader ina session with multiple partitions, you must configure the target partition typeaccording to the external loader you use.When you use an external loader that can load data from multiple files, you canchoose any partition type available for a flat file target. You also choose anexternal loader connection for each partition. The Integration Service creates anoutput file for each partition, and the external loader loads the output from eachtarget file to the database. Use any partition type for the target when you use thefollowing loaders:Oracle, with parallel load enabledTeradata TpumpTeradata Warehouse Builder If you use a loader that cannot load from multiple files, use round-robinpartitioning to route the data to a single target file. You choose an external loader connection for each partition. However, the Integration Service uses the loader connection for the first partition. The Integration Service creates a single outputfile, and the external loader loads the output from the target file to the database.If you choose any other partition type for the target, the Integration Service failsthe session. Use round-robin partition type for the target when you use thefollowing loaders:IBM DB2 EEIBM DB2 EEE Autoloader Oracle, with parallel load disabledSybase IQTeradata MultiLoadTeradata Fastload
Loading to IBM DB2
When you load to IBM DB2 targets, use one of the following external loaders:
IBM DB2 EE external loader 
. Performs insert and replace operations ontargets. The external loader can also restart or terminate load operations. TheIBM DB2 EE external loader invokes the db2load executable located in theIntegration Service installation directory. The IBM DB2 EE external loader canload data to an IBM DB2 server on a machine that is remote to the IntegrationService.
IBM DB2 EEE Autoloader 
. Performs insert and replace operations on targets.The external loader can also restart or terminate load operations. The IBM DB2EEE external loader invokes the IBM DB2 Autoloader program to load data. TheAutoloader program uses the db2atld executable. The IBM DB2 EEE externalloader can partition data and load the partitioned data simultaneously to thecorresponding database partitions. The IBM DB2 EEE loader requires that the

Activity (16)

You've already reviewed this. Edit your review.
1 hundred reads
1 thousand reads
Chad Zima liked this
Ramesh Veginati liked this
faridsk liked this
Aslam Hussain liked this
Aslam Hussain liked this
natrajdreams liked this

You're Reading a Free Preview

Download
scribd
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->