While working on a recent project I had a brief discussion on the implementation of logical deletes. This prompted me to define for once and for all how ETL should handle these occurences. This is, of course, assuming that some CDC mechanism provides the required details or you have the capacity to compare full sets of data to derive the logical deletes yourself. For this purpose I drafted a Design Pattern which should explain this...
Site visitors since October 2015
3NF architecture BIML Business data vault data modeling Data Vault Data Vault 2.0 Data Warehouse Driving Key DV2.0 EAI Enterprise architecture Error Bitmap Error handling ETL ETL Automation ETL Framework ETL Generation hash key Hub inmon Kimball Link Link Satellite Logical Delete Metadata OWB PIT Powercenter PSA Ravos Referential Integrity Satellite SCD2 SQL Server SSIS Staging Area Staging Layer TEAM Time variance Training VEDW Virtual EDW Virtualisation XML