Sunday, February 21, 2016

filter out rows with null values in informatica

Various time ,we need to filter null values in informatica. We can remove them for further processing or other scenarios also . Check Informatica scenarios of filtering out rows with null values .
To filter our rows with null values , we can use it in Source qualifier's over ride SQL or you can use  filter transformation in informatica.
Must check : Normalizer Transformation in informatica
To filter out rows containing null values or spaces, use the ISNULL and IS_SPACES functions to test the value of the port. For example, if we want to filter out rows that contain NULLs in the FIRST_NAME port, use the following condition:
IIF(ISNULL(FIRST_NAME),FALSE,TRUE)
This condition states that if the FIRST_NAME port is NULL, the return value is FALSE and the row should be discarded. Otherwise, the row passes through to the next transformation.
Must check : Lookup Transformation in informatica

informatica isnull filter condition
how to handle null values in informatica
informatica filter is not null
filter null values in sql
filter null values in sql server
powershell filter null values
qlikview filter null values
isnull in informatica syntax

Saturday, February 20, 2016

Rank transformation in informatica

Rank Transformation in Informatica , is a connected and active /Passive transformation which select top/bottom rows of   input. It is something similar to Rank analytical data function or oracle. Only difference is that, it also filter out the remaining rows  (which are not a part of top/bottom threshold).

Must check : Please also check how to create Aggregator Transformation

How Rank Transformation works in Informatica?

It first cache all the input data and then performs the rank calculation per group , filter out the unwanted records.

Steps to create an Rank transformation:

  • In the Mapping Designer, open a Mapping.
  • Click Transformation > Create. Select Rank transformation.
  • Enter a name and click Done.
  • You will see one port RANKINDEX port already there. This port store the ranking of each   record  and can be used to populate target as well
  • Add all additional port from source input which  are going to be use in following transformation.
  • Open the port tab and first check the Group by option for desired column ( for example deptno in our case)
  • Also  check the Rank (R) option for the port which you want to do ranking. For example salary in our case.
Note: We can define Group by indicator for multiple port, but  Ranking can be done   on single port only.
  • Go to the properties tab, select the Top/Bottom value as Top and the Number of Ranks property as per need.
  • Click OK.
  • Connect output ports of Rank Transformation to other transformation or target
Must Read : Learn more about informatica coding standard
Example of Rank Transformation in Informatica:
A good example of Rank transformation with different type of join can be found here.
For more explanation on Rank transformation , you can read it here and also check here for informatica interview question on Rank transformation
Incoming Search Terms :-

Sunday, January 10, 2016

Lookup Transformation in Informatica with Example

Lookup Transformation in Informatica , is a connected/Unconnected and Passive (post 9 Active and Passive transformationwhich let you look up data flat file/relation tables ,views or synonym.The Integration Service queries the lookup source based on the lookup ports in the transformation and a lookup condition. Lookup transformation returns the result of the lookup to the target or another transformation.
You can use lookup Transformation in mapping for below type of tasks:
  • Getting  related value:  Retrieve value from the lookup table based on a value in the source. For example, the source has an employee ID. Retrieve the employee name from the lookup table.
  • Perform a calculation: Retrieve a value from a lookup table and use it in a calculation. For example, retrieve  a sales tax percentage, calculate a tax, and return the tax to a target.
  • Update slowly changing dimension tables: Determine whether rows exist in a target  and accordingly you can create  a new record or update the existing one.

Types of Lookup Transformation in Informatica:

A. Based on the Source Type:

  • Flat File Lookup Transformation
  • Relational Lookup  Transformation

B. Based on Connection Type:

connected Lookup transformation 

Unconnected Lookup Transformation

unconnected lookup transformation part 2
unconnected lookup transformation part 2
unconnected lookup transformation part 1
unconnected lookup transformation part 1

3. Based on Cached Type

  • Cached Lookup Transformation
  • UnCached Lookup Transformation
You can keep Lookup Transformation as uncached by unchecking the Cache option in properties tab.

 

Example  of Lookup Transformation :

Incoming Search Terms :-

Normalizer Transformation in Informatica with Example

Normalizer Transformation in Informatica , is a connected and active transformation  which let you to normalize your data  by receiving a row with information scatter in multiple columns to multiple row a for each instance of column data.For example a student have score for each subject scattered in 5 columns ,with the help of normalizer transformation you can create multiple rows for each subject (Normalization of Database) .
Normalizer Transformation help in normalizing your data , making it for flexible by eliminating redundancy and inconsistent  dependency. It help you representing data in more better manner.
Normalizer Transformation is a Active  transformation as  it create multiple row for each input row.
Normalizer Transformation is a Connected Transformation.
Check here for filter transformation example in informatica

How to use Normalizer transformation in Informatica:

Use the following procedure to create a Normalizer transformation in Informatica mapping.
  • In the Mapping Designer, open a Mapping.
  • Click Transformation > Create. Select Normalizer transformation.
  • You can also select Transformation by clicking  function  button on Informatica Designer
  • Enter a name and click Done.
  • You can create ports in Normalizer transformation  by selecting and dragging it from input transformation to Normalizer transformation.You can manually create input ports on the Normalizer Ports tab by double clicking on it.
    Normalizer Transformation step 5
    Normalizer Transformation step 5
  • Click the Transformation tab and configure transformation properties. ( change Tracing Level as per your need)
  • Click OK.
  • Connect output ports of Normalizer Transformation to other transformation or target
Incoming Search Terms

 

Union Transformation in Informatica with Example

Union Transformation in Informatica , is a connected and active transformation which let you to merge data from multiple pipelines or pipeline branches into one pipeline branch. Union Transformation merges data of similar source  based on UNION ALL SQL statement. 

Business scenarios of Union Transformation in Informatica

As name predict , Union transformation is used to merge data from multiple pipelines into single one.

Is Union Transformation Active or Passive ?

Union Transformation is a Active  transformation as  it combines two or more data streams into one. Although no of rows from multiple input and Output is same, but order in which these row are coming to output can change.

Is Union Transformation Connected or Unconnected ?

Union Transformation is a Connected Transformation.

How Union Transformation work ?

The Integration Service processes all input groups in parallel. It  reads sources connected to the Union transformation and pushes blocks of data into the input groups of the transformation. The Union transformation processes the blocks of data based on the order it receives the blocks from the Integration Service irrespective.

Configuring Union Transformation Properties:

Modify the Union Transformation properties by clicking on the Properties tab.

How to use Union transformation in Informatica:

Use the following procedure to create an Union transformation in Informatica mapping.

Steps to create an Union transformation:

  • In the Mapping Designer, open a Mapping.
  • Click Transformation > Create. Select Union transformation.
  • You can also select Transformation by clicking  function  button on Informatica Designer
  • Enter a name and click Done.
  • You can create ports in Union transformation  by selecting and dragging it from input transformation to Union transformation.You can manually create input ports on the Group Ports tab by double clicking on it.
    Union Transformation step 3
    Union Transformation step 3
  • Double-click the title bar of the Union transformation to open the transformation
  • Click the Groups tab, and then click the Add button to create a user-defined group.The Designer assigns a default name for each group but they can be renamed
  • Click the Transformation tab and configure transformation properties. ( change Tracing Level as per your need)
  • Click OK.
  • Connect group output ports of Union Transformation to other transformation or target

Example of Union Transformation:

Incoming search Terms :

Router Transformation in Informatica with Example

Router Transformation in Informatica , is a connected and active transformation which let you to transfer data to multiple target depending upon the different condition. A Filter transformation rejects the row which don't satisfy its condition whereas Router Transformation allows you to pass the failed data to some default target as well.
Router Transformation informatica
Router Transformation informatica

Business scenarios of Router Transformation

Unlike Filter Transformation , Router Transformation provide you the flexibility of populating multiple target depending upon the different type of conditions. It also allow you to add multiple condition for each target .Failed records can also be extracted from the default group.

Is Router Transformation Active or Passive ?

Router Transformation in Informatica is an active transformation a its Routes data into multiple groups based on group conditions

Is Router Transformation Connected or Unconnected ?

Router Transformation is a Connected Transformation.

How to use Router transformation in Informatica

Use the following procedure to create an Router transformation in Informatica mapping.

Steps to create an Router transformation:

  • In the Mapping Designer, open a Mapping.
  • Click Transformation > Create. Select Router transformation.
  • You can also select Transformation by clicking  function  button on Informatica Designer
  • Enter a name and click Done.
  • You can create ports in Router transformation  by selecting and dragging it from input transformation to router transformation.You can manually create input ports on the Ports tab by double clicking on it.
  • Double-click the title bar of the Router to open the transformation
  • Click the Groups tab, and then click the Add button to create a user-defined group.
  • To add Group
    • Click the Groups tab.
    • Click the Add button.
    • Enter a name for the new group in the Group Name section.
    • Click the Group Filter Condition field and open the Expression Editor.
    • Enter the group filter condition.
    • Click Validate to check the syntax of the condition.
    • Click OK.
  • Router Transformation step 4
    Router Transformation step 4
  • The Designer creates the default group when you create the first user-defined group
  • Click the Transformation tab and configure transformation properties. ( change Tracing Level as per your need)
  • Click OK.
  • Connect group output ports of router to other transformations or targets

Note: After you make the transformation reusable, you cannot copy ports from the source qualifier or other transformations. You can create ports manually within the transformation.

Example  of Router Transformation

Incoming Search Terms :

Saturday, January 9, 2016

Joiner transformation in Informatica

Joiner Transformation in Informatica , is a connected and active transformation  which let you join data from two heterogeneous source (same source system or different source system). The Joiner transformation joins sources  with at least one matching column.
Joiner Transformation in Informatica
Joiner Transformation in Informatica

Informatica Scenarios of Joiner Transformation

As the name predict itself , the Joiner transformation is use to join data from two heterogeneous sources or data from the same source. The Joiner transformation uses a condition that matches one or more pairs of columns between the two sources. Out of two input , one is consider as master pipeline ( it is loaded first in the data cache) , then the other one is Detail pipeline which is joined with the Master data.

Is Joiner Transformation Active or Passive ?

Joiner Transformation is an active transformation as no of output rows changes  based on join condition and join type

Is Joiner Transformation Connected or Unconnected

Joiner Transformation is a Connected Transformation.

Properties of Joiner Transformation in Informatica

Components of Joiner Transformation in Informatica

  • Joiner data cache :  Joiner always caches the MASTER table. We cannot disable caching. It builds Index cache and Data Cache based on MASTER table.
  • Join Type in informatica :  With the help of Join Type , we can control the output of the join condition. We will discuss it in more detail.
  • Master/Detail source port :  While adding source ports into joiner , we need to defined master and detail source by clicking on the  Master check box. To make one source as master , we can check any port of the source on the "M" check box, it will automatically mark the check for remaining port as well
  • Sorted input in joiner transformation :  Select this option to improve session performance. To use sorted input, you must pass data to the Joiner transformation sorted by joining port, in ascending or descending order.
You can configure the Joiner transformation components and options on the Properties and Ports tab.

Join Type of Joiner Transformation

Normal Join in joiner transformation
A normal join will allow only those records which satisfy the joiner condition for both sources. So remaining records, who don't match the condition get discarded
Master Outer Join  in joiner transformation
A master outer join will keeps all rows of data from the detail source and the matching rows from the master source. If any of master records don't satisfy the condition , those rows get discarded.
Detail Outer Join  in joiner transformation
Just opposite to Master Outer join , it keep all rows of data from Master Source and the matching rows from Details Source. If  any of detail records don't satisfy the condition , those rows get discarded.
Full Outer Join  in joiner transformation
A full outer join keeps all rows of data from both the master and detail sources.
Must Read : Learn more about Expression Transformation
Use the following procedure to create an Joiner transformation in Informatica mapping.

Steps to create an Joiner transformation:

  1. In the Mapping Designer, open a Informatica Mapping.
  2. Click Transformation > Create. Select Joiner transformation.
     
    You can also select Transformation by clicking  function  button on Informatica Designer
     
  3. Enter a name and click Done.
     
  4. Drag all the input/output ports from the first source into the Joiner transformation. The Designer creates input/output ports for the source fields in the Joiner transformation as detail fields by default. You can edit this property later .
  5. Select and drag all the input/output ports from the second source into the Joiner
    transformation.The Designer configures the second set of source fields and master fields by default.
  6. Double-click the title bar of the Joiner transformation to open the transformation
  7. Click any box in the M column to switch the master/detail relationship for the sources.
  8. Tip: To improve performance for an unsorted Joiner transformation, use the source with fewer rows as the master source. To improve performance for a sorted Joiner transformation, use the source with fewer duplicate key values as the master.
     
  9. Click the Add button to add a condition. You can add multiple conditions. The master and detail ports must have matching datatypes.
    Joiner transformation only supports equivalent (=) joins.
  10. Click the Properties tab and configure properties for the transformation (as Mentioned above)
     
  11. Connect the output ports to a downstream transformation or target.

Example  of Joiner Transformation: