Joining tables in the Persistent Staging Area
Joining tables in the Persistent Staging Area (PSA) could be a practical solution that avoids downstream complexities. This post explains the pattern to do so.
Roelant Vos Data solution design patterns, implementation, and automation
Visualising the merger of time-variant and bitemporal data
By plotting, and then combining, bitemporal and historised data sets on a cartesian plane it’s really easy to understand bitemporal behaviour.
A not-so-gentle follow-up on bitemporal data challenges
When delivering data from the integration layer (e.g. a Data Vault model) to the presentation layer (anything, but usually a dimensional model or wide table), a key requirement is re-organising data to the selected ‘business’ timeline for delivery.
During this process, we leave the safety of the assertion (technical) timeline behind and start using the real-world state timeline for delivery. This may create some unexpected results!
A gentle introduction to bitemporal data challenges
The data is wrong! No, it’s not wrong, we’re just looking at it from different points in time. This post shows how a data warehouse helps to manage this common topic on data interpretation.
Deterministic dimension keys in a virtual Data Vault
When preparing Data Vault content for consumption in a dimensional model, dimension keys can be created to join the resulting fact- and dimension tables in a performant way. But what about for a truly virtual data mart? This post covers approaches to issue dimension keys that are fully deterministic.
Trying out Data Vault code generation just got even easier!
To facilitate ongoing research in tweaking Data Vault patterns for various use-cases, I recently updated the open source data warehouse automation environments TEAM (source-to-target mapping management) and Virtual Data Warehouse (code generation). These updated versions make playing around with patterns even easier. If you’re interested in having a look at how different patterns work, or what it would mean to deploy a fully virtual data warehouse – have a look at the provided examples. With...
How different modelling approaches impact your Data Vault
Having a certain model structure does not necessarily mean that a given methodology is implemented correctly, and the chosen modelling perspective has significant impact on your resulting Data Vault.
Global Data Summit presentation – using BimlFlex with a Business Model
Here is a recording of my presentation on using BimlFlex for code generation based off a business model, for the Global Data Summit 2021. With a brief intro by Hans Hultgren.
Key metrics for monitoring data logistics
A data logistics control framework tracks everything that happens in a data solution. A small number of key metrics can be used to keep informed of important exceptions.
Generating Data Warehouse Automation schema code in Azure DevOps
This post shows how to configure an Azure DevOps pipeline to generate code using the schema for Data Warehouse Automation.