Informatica Pushdown Tips

Applies to:
Informatica with Pushdown feature (version 8x)

Summary
Pushdown Optimization is for better performance. Along with enabling this Pushdown property, certain guidelines should be followed while developing the mapping. This document discusses about the guidelines, tuning tips and practices to be followed to achieve the Pushdown for simple/complex mappings.

Author Bio
Author(s): Manimala Rajangam Company: Merill Lynch Created on: April 27, 2010 Manimala Rajangam, Merill Lynch(acquired by Bank Of America), Analyst. Playing the role of lead developer in Informatica.

Informatica Technology Network © 2010 Informatica Corporation. All Rights Reserved.

http://technet.informatica.com 1

......................................... 6 Informatica Technology Network © 2010 Informatica Corporation............................................................................................... 6 Session Log information ...... 3 Mapping level Steps: ............................................................................................................................................................................................................................................................ http://technet..................................................................... All Rights Reserved..................................... 4 Workflow level Steps:............................................................com 2 ................ 3 Document Usage ........................................................................................................................................................................................................................................................................ 6 Limitations:.Informatica Pushdown Tips Table of Contents Purpose of the document ............................ 3 Session level Steps: ................................................................................................ 3 Steps to be followed ................................................................................................................................... 3 Details of Document .................... 6 Benefits:........informatica...............................................................................................................................................................................................................................................................

the ways to tune the mapping for better performance is discussed. Details of Document Preface Pushdown is a specific feature which is available in Informatica to optimize the load. If the same filter is given in source filter or in any filter transformation in the mapping. target-side and Full.com 3 . Else we have to opt for either “To Source” or “To Target”. Reason: Full pushdown is possible only when the connections used for source. “To Target” and “Full” pushdown. http://technet. Push down can be of source-side. the filter will be appended to the pushdown query. There are few steps to be followed for better performance which is given in detail below: Steps to be followed Mapping level Steps: • Create a mapping with a compatible source. target and other tables (which are used as lookup) are in the same database then pushdown is the better option to load your target in spite of normal Relational reader/writer which takes more time to read/write records. Also.Informatica Pushdown Tips Purpose of the document This document provides a brief overview of Push down optimization in Informatica.informatica. View will be created based on the query in SQL override. Document Usage The target audience of this document is: • Informatica Architects / Informatica Developer. Reason: Unconnected lookups will always be outer joined with source in the push down query. lookup and target are same (in turn which means the tables should be in the same database). Optimizer queries will not be the same for “To Source”. the filter condition should be given along with the SQL override query. If the source. But if they were given in the SQL Informatica Technology Network © 2010 Informatica Corporation. lookup and target connections. So it always creates a view for that unconnected lookup. best way is to use SQL Override query or Lookup override query with that filter condition which will give better performance in spite of using the source filter or lookup filter. For better performance. All Rights Reserved. It describes the operational features and capabilities of this optimization technique. a separate view will not be created if the filter condition is given in the source filter. • Incase if the lookup table or source table should be restricted with filter condition. Better performance is achieved while using Full pushdown. But for source filter.

LKP_EMPLOYEE(emp_name)) This could error out pushdown while configuring the pushdown for “FULL”.informatica. • Grant select access to all the lookup tables if they are in different schema in the same database.LKP_EMPLOYEE(emp_name)). Here the emp_id value should be assigned to a variable port and then do a lookup to department table to retrieve dept_id but the variable port cannot be pushed to a query while using push down optimization. • • Not all expression functions can be pushed by the pushdown optimization. :LKP. All Rights Reserved. Two expression transformations should be used in this case. So that the number of records read will reduced. Informatica Technology Network © 2010 Informatica Corporation. http://technet. Avoid two lookup conditions in the single output port For example: out_emp_id=iif ( isnull( :LKP. For example: Let us say emp_name is available in the source for which we have to lookup Employee table to get the emp_id and then pass this emp_id to get dept_id from department table.’DEFAULT’.com 4 .We cannot view the reason also. And in the second expression transformation. For the nested variables one or more expression transformations should be used.Informatica Pushdown Tips Override a separate view will be created after filtering those records. Please refer the Informatica help PDFs to know the functions which are supported for each database. This can be achieved in a single expression transformation if we do not use Pushdown. so always the expression functions or the lookup call can be given in the output ports. So whenever the pushdown preview fails it shows the query conversion is blocked in the mapping. • Expression functions in the variable ports cannot be pushed. Where first expression transformation should have a lookup on employee table and the value returned should be assigned to an output port out_emp_id. Else Informatica will fail to create a view when it tries to create a view on a table in other schema. this out_emp_id can be passed to the lookup on department table where the returned value can be assigned to another output port in second expression transformation.

If sequence is used. Preview the pushdown optimization after configuring the session for push down Informatica Technology Network © 2010 Informatica Corporation. http://technet. select the pushdown type. enable the option for the view creation by pushdown (shown above).Informatica Pushdown Tips Session level Steps: • Create a session. If the source have SQL override or the mapping uses lookup. enable the option for the sequence creation (shown above). The views or the sequence will be created in the same schema. • After the run the views will be dropped. which is configured for source and target. • • Uncheck the “Pre 85 timestamp compatibility” session property. if its checked while creating a session. All Rights Reserved.informatica.com 5 .

As all temporary views will be created and dropped after the run. • The session will fail even if there is a single failure while loading the target table. Storage space can be reduced. • Only the total number of records that were read and processed will be available. Pushdown will work only if all the lookup. even if the stop on error session property is set as “0”. Benefits • • Better performance gain. Bad records cannot be identified while using push down unlike the normal run. • The busy percentages for the transformations will not be available. Informatica Technology Network © 2010 Informatica Corporation.informatica. source and target connections are in the same database. So it’s always better to check the cost of the query created after previewing the pushdown query. All Rights Reserved.com 6 . Limitations • • • • • • Not all transformations can be pushed Not all expression functions can be pushed. the committed partitions cannot be rolled back incase of errors. http://technet. Session Log information • The session log will not have the transformations details for the processed records. • Debugger will not work when a session is configured for push down.Informatica Pushdown Tips Workflow level Steps: Push down can be configured for both ASCII and UNICODE Integration services.(like the truncate or overflow error) CPU skew might go up. If the target is partitioned along with push down.

Informatica Pushdown Tips Conclusion Performance gain can be highly achieved by Pushdown Optimization. Compare the mapping with and without pushdown to measure the gain.com 7 .informatica. All Rights Reserved. http://technet. Informatica Technology Network © 2010 Informatica Corporation.

com 8 . or seek to hold. http://technet. Informatica responsible or liable with respect to the content of this software asset. You agree that you will not hold. All Rights Reserved. Informatica Technology Network © 2010 Informatica Corporation. including any liability resulting from incompatibility between the content within this asset and the materials and services offered by Informatica.informatica.Informatica Pushdown Tips Disclaimer and Liability notice Informatica offers no guarantees and assumes no responsibility or liability of any type with respect to the content of this software asset.

Sign up to vote on this title
UsefulNot useful