Roelant Vos An expert view on Agile Data Warehousing

EAI, ESB and ETL and the ETL generation tool 0

EAI, ESB and ETL and the ETL generation tool

 

 It has been very quiet on the weblog / idea repository since November. This was partly due to the summer holiday period (in Australia) and the fact that I’ve finally picked up the work to develop the ETL generation tool based on the described EDW architecture. Work wise I’ve recently done a lot of strategy work with very little practical exposure to the technologies, and this is likely to continue for some time to come....

Data Vault in Australia 0

Data Vault in Australia

 

 Anyone interested in Data Vault in Australia, please sign up for the official Data Vault User Groups (and specifically the Australian group). Just started, and Data Vault does not have many reference projects in Australia, but that can only mean there is much opportunity to set up a good foundation. The site can be found on www.dvusergroup.com. EDIT: the user groups have been dismantled in favour of the linkedIN discussion groups!!!

0

Why a separate surrogate key table?

 

 A question I often (and recently) get is why you should create a separate table to manage the surrogate keys. This is compared to star- or snowflaked models where the surrogate key (and distribution) is part of the table. For Data Vault the Hub entity is the place where the keys are managed. There is rationale for splitting this process into separate tables: A surrogate key table makes it easy to identify the records in...

Powercenter transaction control with XML/text file targets 0

Powercenter transaction control with XML/text file targets

 

Using the port evaluation of Informatica Powercenter to implement transaction control for text or XML file targets.

Enterprise Architecture seminar thoughts 0

Enterprise Architecture seminar thoughts

 

 This posting is about the most complex object that humankind can come up with; an Enterprise. At least that is what John Zachman states at his one day seminar about Enterprise Architecture (physics 101 – Monday 23rd of August 2010 – Sydney). The first rule for the way of working is defined right at the start: when doing anything with an enterprise or start designing anything for an enterprise; make sure you understand the enterprise...

Completed CBIP certification 3

Completed CBIP certification

 

 As of July 2010, Roelant Vos is a certified business intelligence professional (CBIP), specialized in data management! The CBIP exam involves a minimum of three examinations ranging from generic IT to datawarehousing and data modelling. I’m very happy that my employer Analytics8 made this possible.

Why you need an Enterprise BI framework 0

Why you need an Enterprise BI framework

 

 Over the last few months I have done a number of pre-sales presentations regarding a framework for designing and developing data integration programs. While the framework in question is a smaller scale (mainly ETL) I did encounter numerous discussion why such a framework is necessary in the first place. What would be achieved by using it? Because this blog serves as my own personal framework and collection of best practices I thought it would be...

Current mapping generation improvement points 0

Current mapping generation improvement points

 

 I’ve demo-ed the posted processes for mapping generation and Data Vault a couple of times for varying audiences and (lucky me) no one has noticed the existing flaws 🙂 So it’s time to make a list of them to keep me from not forgetting to fix them. And it’s a heads up for the few people I know who are using the scripts. There is currently no way to keep the ‘transactional’ attributes out of...