Problem Description:
Nowadays ETL developers facing the issue with data redundancy while dealing with large data sets. As part of the storage concern, we need to reduce the duplicate data from daily incoming source data and load the latest data to the target table.
Challenges to Developer/user
Basically, the source data come along with timestamp filed by using that timestamp field we need to extract the data which is newly coming newly and load it to the target.
Make use of parameters or variables in the Informatica power center
Understanding the value precedence of parameters and variables.
Make use of :setmaxvariable() function in expression transformation.