The filter transformation allows mapping jobs to filter out unwanted records from incoming data by applying conditions. It connects to incoming ports and filters records that do not meet specified criteria like containing null values or date fields outside a useful range. The filtered output is then passed to downstream transformations or target definitions. Examples show how to filter for specific department IDs, salary ranges, or records with commission values. The attached document provides a sample mapping using the filter transformation.
The filter transformation allows mapping jobs to filter out unwanted records from incoming data by applying conditions. It connects to incoming ports and filters records that do not meet specified criteria like containing null values or date fields outside a useful range. The filtered output is then passed to downstream transformations or target definitions. Examples show how to filter for specific department IDs, salary ranges, or records with commission values. The attached document provides a sample mapping using the filter transformation.
The filter transformation allows mapping jobs to filter out unwanted records from incoming data by applying conditions. It connects to incoming ports and filters records that do not meet specified criteria like containing null values or date fields outside a useful range. The filtered output is then passed to downstream transformations or target definitions. Examples show how to filter for specific department IDs, salary ranges, or records with commission values. The attached document provides a sample mapping using the filter transformation.
It is use to filter out the unwanted records from the
incoming data in a mapping. We connect all the required port from incoming data and add required condition in filter and link the output port of filter transformation with the following transformations (or Target Definitions). Business Purpose: A business may chose not to process records which do not meet a data quality criterion, such as containing a null value in a field which may cause a target constraint violation or eliminate from the process date field values which will not provide useful data
Filter Transformation is an active transformation as it is
changing the no of output row (by keeping only those which meets the filter condition) CONNECTED
Filter Transformation examples
1. Create a mapping to load the employees from department 50 into the
target? department_id=50
2. Create a mapping to load the employees whose salary is in the range of
10000 to 50000? salary >=10000 AND salary <= 50000
3. Create a mapping to load the employees who earn commission
(commission should not be null)? IIF(ISNULL(commission),FALSE,TRUE)
EXAMPLE: Create a mapping to load the target table with Dept1 records only.
Please check the attached doc for a better idea about