Roelant Vos

Data solution design patterns, implementation, and automation

Tagged: schema

0

General

The new version of the data automation metadata schema is ready!

The latest version of the schema for data solution automation has been published on Github. This comprehensive collection includes examples, functions, and definitions crucial for metadata management in data solutions, particularly data warehouse systems. You can find the details, code, and documentation here: What has changed? One significant update focuses on the Business Key Definition. Initially, it featured a property called ‘Business Key Component Mappings,’ which listed data item mappings for various business key components...

0

General

Fun with code generation patterns – transformations

In this last post covering some of the new features of the generic schema for Data Warehouse Automation I would like to share some examples of how to define transformations and logic that is more complex than the typical column-to-column mapping. In the schema definition, a ‘source’ is defined as either (OneOf) a code snippet (DataQuery) or an object (DataObject or DataItem). This means that, at both Data Object as well as Data Item level,...