Roelant Vos An expert view on Agile Data Warehousing

0

Next Virtual Data Warehouse classroom training will be in Utrecht, The Netherlands!

 

 The upcoming Virtual Data Warehouse implementation & automation classroom training will be located in The Netherlands. Check out the details & register at www.virtualdwh.com. The training is delivered in conjunction with Doerffler & Partner and DCYSIVE and will once again focus on the design and implementation of a data platform that is truly flexible, scaleable and resilient. This is a very practical training that will provide the end-to-end overview of how to deliver a hybrid...

0

Simple ETL generation series – an overview

 

 I am starting a new series of articles to showcase how you can setup your own simple ETL generation / automation approach. The idea is to use the TEAM metadata for this, but it is perfectly possible to use any other source of metadata as well of course. These (working) examples should not be seen to replace commercial tools and frameworks. The posts aim to explain how ETL generation works, how it can be implemented...

0

Applying business rules in Data Vault

 

 As part of preparing for the Data Modelling Zone APAC 2019 I have published a new paper that covers the concepts around implementing business logic in a modern generated and/or virtualised Data Warehouse architecture. The paper can be downloaded directly here (or else in the publications section) of this website. This article covers the various architecture considerations that allow designers to bring back the concept of business logic to its core. It also makes the...

0

New release of TEAM software (v1.5.4.1)

 

 (Note: this was updated on the 22nd of February to change from 1.5.4.0 to 1.5.4.1 since this bug-fix update was released). Not too long after the previous version, we released a new update for the ‘Taxonomy of ETL Automation Metadata’ (TEAM). TEAM and VEDW are developed for the purposes of sharing knowledge and testing out new ideas. They are updated from time to time to try out new concepts and generally make it easier for...

0

New release of TEAM software (v1.5.3.0)

 

 We just released a new version of the free open source front-end software to manage the essential metadata for Data Vault automation: the Taxonomy of ETL Automation Metadata (TEAM). TEAM and VEDW are developed for the purposes of sharing knowledge and testing out new ideas, but they are fully tested and complete in their functionality. You can generate your Data Vault with patterns that incorporate concepts outlined in this blog. This has been in development...

2

Receiving and integrating data from multiple time zones

 

  How to capture the date / time information that is received from different international locations, across different time zones, is a challenge that comes up from time to time. Recently I was involved in some conversations about this again, which prompted me to capture this once and for all and share this here. As outlined in the pattern for Data Mart delivery you should be able to deliver information according to the timeline that...

1

A pattern for Data Mart delivery

 

 I’ve just completed a new article that outlines a solid approach to to deliver (generate) a Data Mart on top off a Data Vault. At least that’s what I think! I’m always open for discussions, so please contact me for questions and / or feedback. The document is the result of many discussions and tests, and really makes a case for the ‘insert-only’ Data Vault. It also covers how Data Vault can elegantly manage different...