While working on a recent project I had a brief discussion on the implementation of logical deletes. This prompted me to define for once and for all how ETL should handle these occurences. This is, of course, assuming that some CDC mechanism provides the required details or you have the capacity to compare full sets of data to derive the logical deletes yourself. For this purpose I drafted a Design Pattern which should explain this...
3NF architecture BIML Business data vault CBIP data modeling Data Vault Data Vault 2.0 Data Warehouse Driving Key DV2.0 EAI Enterprise architecture Error Bitmap Error handling ESB ETL ETL Automation ETL Framework ETL Generation Hub Informatica inmon Kimball Link Link Satellite Logical Delete Metadata OBW OWB Powercenter PSA Ravos reference table Referential Integrity Satellite SCD2 SQL Server SSIS Staging Area Staging Layer Time variance Virtual EDW Virtualisation XML
Visits since October 2015
Search this site
About this site
Hi! I'm Roelant Vos, working at Allianz Worldwide Partners in Australia. I try to make life easy working with all things data and use this site to share personal ideas and concepts. Feel free to contact me any time!