Professional Documents
Culture Documents
=====================
Passive Transformation:
======================
1. Source Qualifier:
======================
-An Active, connected
Properties:
-----------
1. SQL query: Sql override, --> by writing sql query, we can filter/restrict the
data from source itself --- 2
2. User defined join: Homogeneous join - tables from same type of data base
5. Pre-SQL: SQL, before data fetch (e.g index creation in source) ---
1
6. Post-SQL: SQL, After data fetch (e.g index drop in source) ---
3
2. Filter Transformation:
=========================
--An Active, Connected
Filter transformation is used to filter out record any where in the pipeline
Properties:
===========
salary:
=======
10000
50000
null not isnull(salary)
80000
6000
12000
I have a ff and it has record for all the countries, i want to load india data to
target
India
india
INDIA
3. Expression Transformation:
=============================
-- Passive, connected
salary * *
new_salary * salary+
(salary*0.1)
variable: intermediate calculation -- you can't take variable port as output
v_c=a+b;
o_c=v_c
e=d+v_c;
Order of execution:
1. Input
2. Variable
3. Output
'+1-('||substr(replacechr(0,PHONE_NUMBER,'.',null),1,3)||')-'||
substr(replacechr(0,PHONE_NUMBER,'.',null),4)
'
first_name uppercase
IIF(condition,true,false)
IIF(SALARY>10000,EMAIL||'@gmail.com',EMAIL||'@yahoo.com')
A b
a b
'+1-'||REPLACECHR(0,PHONE_NUMBER,'.','')
'T_FF_EMPLOYEES_'||to_char(SYSTIMESTAMP(),'YYYYMMDDHH24MI')||'.csv'
-----------------------------------------------------------------------------------
--------------------
4. Joiner:
==========
An active, connected
4 Types of join:
1. Normal join
2. Master Outer
3. Detail Outer
4. Full Outer Join
Performance in Joiner:
SQL: Order by
Informatica: Sorter
salary * * *
descending
hire_date * * *
ascending
can I select more than one key port in sorter? ---- Yes
properties:
distinct
Arun
Babu
Chandra
babu
null
8000
null
6000
9000
normal order:
null
null
null
9000
8000
6000
9000
8000
6000
null
null
null '
-----------------------------------------------------------------------------------
--------------------------------
6. Aggregator:
==============
-- Active, connected
min()
max()
sum()
avg()
count()
Irrespective of number of record --> you will get only one record in output
--> last record will get aggregate value
Group by:
Properties:
-----------------------------------------------------------------------------------
-------------------------------------------------
7: Router Transformation:
=========================
-An Active, connected
IIF(condition,IIF(condition,true,false),'NON-LEAP')
salary * * *
department_id *
Properties:
===========
Top/Bottom: Top
Number of Rank: 5
-------------------------------------------------------------
9. Sequence Generator:
=======================
-- Passive, Connected
-- Auto increment numbers
Properties:
-----------
1. Start value: 10000000
2. increment by: 1
3. End value: 92142342353544454
4. current value: 10000000
5. cycle: enable/disable
6. Reset: enable/disable
7. Number cached values: 1000
10000000
10000100
10000000
10000200
1 4
2 5
3 1
4
5
1
2
3
4
5
1
2
3
4
5
1
2
3
Infa ---> Union acts as Union ALL --> it will not remove duplicate
Union ==> Union + Sorter(distinct)
-------------------------------------------------------------------------------
Connected lookup:
=================
lookup sql override: by writing sql query we can restrict the data from
lookup table itself
lookup filter:
UnConnected lookup:
===================
-- Expression Transformation
:LKP.LKPTRANS(lookup_field)
why unconnected:
lookup reusablity
Conditional lookup:
IIF(isnull(name),:LKP.lkptrans(ssn),name)
-----------------------------------------------------------------------------------
-
ADD_TO_DATE (TO_DATE('01-JAN-1970','dd-mon-yyyy'),'DD',(1526357743/60/60/24))
-------------------------------------------------------------------------------
12. Update Strategy:
===================
- An Active, Connected
dd - Data Driven
dd_insert 0
dd_update 1
dd_delete 2 (instead of delete, we will soft delete -- Inactive)
dd_reject 3
13. Normalizer:
===============
-- An Active, connected Transformation
commit
rollback
TC_COMMIT_BEFORE
TC_COMMIT_AFTER
TC_ROLLBACK_BEFORE
TC_ROLLBACK_AFTER
TC_CONTINUE_TRANSACTION
1
2
3
4
5
1
2
3
4
5
1
2
3
4
5
india 1
india 0
india 0
uk 1
uk 0
uk 0
usa 1
usa 0
-----------------------------------------------------------------------------------
----
customer
product
account
user
employee
region
location
time
Method - 1 - Flag
Method - 2 - Version
Method - 3 - Date
Surrogate Key:
-----------------------------------------------------------------------------------
-------