Roelant Vos

Data solution design patterns, implementation, and automation

Tagged: Data Vault

0

General

The new version of the data automation metadata schema is ready!

The latest version of the schema for data solution automation has been published on Github. This comprehensive collection includes examples, functions, and definitions crucial for metadata management in data solutions, particularly data warehouse systems. You can find the details, code, and documentation here: What has changed? One significant update focuses on the Business Key Definition. Initially, it featured a property called ‘Business Key Component Mappings,’ which listed data item mappings for various business key components...

A traditional Data Vault model, using Link-Satellites. 0

Data Vault

Remedies for Driving Keys

Driving keys continue to cause problems, even for experienced Data Vault practitioners. Are there better ways to manage relationship validity?

end-dating 0

Data Vault

End dating, or not, in Data Vault

End dating Satellites in Data Vault has much more than meets the eye. This post lays out various options and consideration that may help decide whether to implement end-dating, or not.

end-dating 0

General

A not-so-gentle follow-up on bitemporal data challenges

When delivering data from the integration layer (e.g. a Data Vault model) to the presentation layer (anything, but usually a dimensional model or wide table), a key requirement is re-organising data to the selected ‘business’ timeline for delivery.

During this process, we leave the safety of the assertion (technical) timeline behind and start using the real-world state timeline for delivery. This may create some unexpected results!

0

General

A gentle introduction to bitemporal data challenges

The data is wrong! No, it’s not wrong, we’re just looking at it from different points in time. This post shows how a data warehouse helps to manage this common topic on data interpretation.

0

Data Vault / ETL / General

Deterministic dimension keys in a virtual Data Vault

When preparing Data Vault content for consumption in a dimensional model, dimension keys can be created to join the resulting fact- and dimension tables in a performant way. But what about for a truly virtual data mart? This post covers approaches to issue dimension keys that are fully deterministic.

0

Automation / Data Vault

Trying out Data Vault code generation just got even easier!

To facilitate ongoing research in tweaking Data Vault patterns for various use-cases, I recently updated the open source data warehouse automation environments TEAM (source-to-target mapping management) and Virtual Data Warehouse (code generation). These updated versions make playing around with patterns even easier. If you’re interested in having a look at how different patterns work, or what it would mean to deploy a fully virtual data warehouse – have a look at the provided examples. With...