Design approach to Update Huge Tables Using Oracle MERG
One of the issues we come across during the ETL design is "Update Large Tables". This is a very common ETL scenarion especially when you treat with large volume of data like loading an SCD Type 2...
View ArticleInformatica PowerCenter Constraint Based Loading
Constraint based loading technique is available in Informatica PowerCenter since last couple of versions. This PowerCenter feature will let you load multiple tables in a single session, which is having...
View ArticleInformatica PowerCenter Repository Contents Upgrade
After an existing Informatica PowerCenter server binaries are upgraded to a higher version, we will have to upgrade the existing repository contents before we can enable the repository service and...
View ArticleSCD Type 1 Implementation using Informatica PowerCenter
Unlike SCD Type 2, Slowly Changing Dimension Type 1 do not preserve any history versions of data. This methodology overwrites old data with new data, and therefore stores only the most current...
View ArticleWorking with Aggregator and Sorter Transformation
This tutorial shows the process of creating an Informatica PowerCenter mapping and workflow which pulls data from multiple data sources and use Aggregator and Sorter Transformation. Using a sorter...
View ArticleWorking with Router Transformation and Aggregator Transformation
This tutorial shows the process of creating an Informatica PowerCenter mapping and workflow which pulls data from multiple data sources and use Aggregator and Router Transformation. Router...
View ArticleSource, Target Command Makes File Processing Easier than Before
Most of the time when we process flat files in Informatica PowerCenter, we do some kind of file pre or post processing, such as unzip the source file, create a custom header or footer for the target...
View ArticleRestartability Design for Different Type ETL Loads
Restartable ETL jobs are very crucial to job failure recovery, supportability and data quality of any ETL System. So you need to build your ETL system around the ability to recover from abnormal...
View ArticleSequence Generator Transformation for Unique Key Generation
The Sequence Generator transformation generates numeric values in a sequential order. Use the Sequence Generator to create unique primary key values, replace missing primary keys, or cycle through a...
View ArticleInitial History Building Algorithm for Slowly Changing Dimensions
Building initial history for a Data Warehouse is a complex and time consuming task. It involve taking into account of all the date intervals from different source tables during which the source...
View ArticleChange Data Capture (CDC) Implementation for Multi Sourced ETL Processes
We have discussed couple of different options for Change Data Capture including a Change Data Capture Framework in our prior discussions. Implementing change capture for ETL process which involves...
View ArticleStored Procedure Transformation to Leverage the Power of Database Scripts
A Stored Procedure is an important tool for populating and maintaining databases. Since stored procedures allow greater flexibility than SQL statements, database developers and programmers use stored...
View ArticleData Manipulation Using Update Strategy in Informatica PowerCenter
It is obvious that we need data manipulation such as Insert, Update and Delete in an ETL job, Informatica PowerCenter provides Update Strategy transformation to handle any such data manipulation...
View ArticleRe-Keying Surrogate Key For Dimension & Fact Tables. Need, Impact and Fix
A surrogate key is an artificial key that is used as a substitute for a natural key. Every surrogate key points to a dimension record, which represent the state of the dimension record at a point in...
View ArticleTasks and Task Developer in Informatica PowerCenter Workflow Manager
The Informatica PowerCenter Workflow Manager contains many types of tasks to help you build workflows and worklets. You can create reusable tasks in the Task Developer. Or, create and add tasks in the...
View ArticleSCD Type 6, a Combination of SCD Type 1, 2 and 3
In couple of our previous articles, we discussed how to design and implement SCD Type1, Type 2 and Type 3. We always can not fulfill all the business requirements just by these basic SCD Types. So here...
View ArticleUse Informatica Persistent Cache and Reduce Fact Table Load Time
In a matured data warehouse environment, it is very common to see fact tables with dozens of dimension tables linked to it. If we are using informatica to build this ETL process, we would expect to see...
View ArticleSCD Type 6 Implementation using Informatica PowerCenter
In one of our prior articles we described the SCD Type 6 dimensional modeling technique. This technique is the combination of SCD Type1, Type 2 and Type 3, which gives much more flexibility in terms of...
View ArticleSCD Type 4, a Solution for Rapidly Changing Dimension
SCD Type 2, is design to generate new records for every change of a dimension attribute, so that complete historical changes can be tracked correctly. When we have dimension attributes which changes...
View ArticleBuild Reusable Code in Informatica PowerCenter Using Mapplets
Reusability is a great feature in Informatica PowerCenter which can be used by developers. Its general purpose is to reduce unnecessary coding which ultimately reduces development time and increases...
View Article