y

Hi To undrstand DTM, you should first know understand Intergartion Service. The Integration Service is used to move data from sources to targets based on workflow and mapping metadata stored in a repository. Data Transformation Manager (DTM) process. The Integration Service starts a DTM process to run each Session and Command task within a workflow. The DTM process performs following Tasks:-1.Session validations, 2.Creates threads to initialize the a.Session, b.Read data, c.Write data, d.transform data. 3.Handles Pre- and Post- session operations. You can Increase DTM buffer size of the session if need, but by default it is AUTO. I would suggest you to go through the Workflow Administration Guide.

o

Like (0)

o
mahesh_infa
3 posts since Oct 15, 2010

Nov 26, 2010 11:50 PM (in response to MdAdilShariff)

Re: what is DTM? Hi Shariff, Thanks for ur detailed response. It was really helpful to understand DTM. Regards, Mahesh 

Like (0)

y

saibabu.gvs
33 posts since Oct 1, 2010

Dec 3, 2010 10:33 AM (in response to mahesh_infa)

Re: what is DTM? Hi Mahesh Below is the more detailed explanation The Integration Service process starts the DTM process to run a session. The DTM process is also known as the pmdtm process. The DTM is the process associated with the session task. The DTM process performs the following tasks: Retrieves and validates session information from the repository. Performs pushdown optimization when the session is configured for pushdown optimization. Adds partitions to the session when the session is configured for dynamic partitioning. Forms partition groups when the session is configured to run on a grid. Expands the service process variables, session parameters, and mapping variables and parameters.

A target load order group is the collection of source qualifiers. Blocking Data You can include multiple input group transformations in a mapping. it stops blocking the source. and SQL. consider the following DTM process actions: Reading source data. and targets linked together in a mapping. it processes the data in the buffers and continues to read from the source. the DTM reads sources in a target load order group concurrently. and it processes target load order groups sequentially. the DTM process reads source data and passes it to the transformations for processing. Target Load Order Groups and Source Pipelines In the mapping shown in Figure 10-5. Creates and runs mapping. Validates source and target code pages. Reading Source Data You create a session based on a mapping. Runs pre-session shell commands. o Like (0) y HoneyInformatica 1 posts since Jan 6. After the DTM fills the buffers. The DTM reads and processes a block of rows at a time. Blocking data. it does not read more source rows until the transformation logic allows the DTM to stop blocking the source. Blocking is the suspension of the data flow into an input group of a multiple input group transformation. transformations. Runs post-session stored procedures. By default. Sends post-session email. Figure 10-5 shows a mapping that contains two target load order groups and three source pipelines: Figure 10-5. When the DTM stops blocking a source. Verifies connection object permissions. SQL. Each target load order group contains one or more source pipelines. it reads data from the source connected to the input group until it fills the reader and transformation buffers. You can configure the order that the DTM processes target load order groups. and transformation threads to extract. transform. A source pipeline consists of a source qualifier and all of the transformations and target instances that receive data from that source qualifier. Block processing. When it finishes processing Target Load Order Group 1. When the DTM blocks data. 2011 Feb 6. To help understand DTM processing. Mappings contain one or more target load order groups. However. stored procedures. The DTM blocks data at one input group when it needs a specific row from a different input group to perform the transformation logic. sometimes the transformation logic of a multiple input group transformation requires that the DTM block data on one input group while it waits for a row from a different input group. writer. The DTM sometimes blocks the flow of data at a transformation in the mapping while it processes a row of data from a different source. It first processes Target Load Order Group 1 by reading Source A and Source B at the same time. and shell commands. transformations. After the DTM reads and processes the row it needs. reader.Creates the session log. and load data. the DTM processes the target load order groups sequentially. The DTM passes data to the input groups concurrently. Sends a request to start worker DTM processes on other nodes when the session is configured to run on a grid. The DTM reads the sources in a mapping at different times depending on how you configure the sources. 2011 7:12 AM (in response to mahesh_infa) Re: what is DTM? When you run a session. and targets in the mapping. the DTM begins to process Target Load Order Group 2 by reading Source C. .

the DTM processes one row in a block. Configure array-based mode for Custom transformation procedure. the session processes one row in a block. When you log row errors. Connect CURRVAL. By default. When you configure the data access mode for a Custom transformation procedure to be row-based. the data access mode is array-based.Block Processing The DTM reads and processes a block of rows at a time. For optimal performance. the DTM processes one row in a block: Log row errors. The number of rows in the block depend on the row size and the DTM buffer size. . When you connect the CURRVAL port in a Sequence Generator transformation. the DTM processes one row in a block. In the following circumstances. connect only the NEXTVAL port in mappings. and the DTM processes multiple rows in a block.

Sign up to vote on this title
UsefulNot useful