Learn the essential background and principles needed to apply Agile in your data warehouse and business intelligence projects. This one-day workshop will introduce you to a modern method for Agile data modeling, Data Vault 2.0, and examine a real-world case study. in detail. The workshop covers how the cloud has changed expectations and how you can enable your Agile data warehouse by using a modern data warehouse as a service (DWaaS) built in the cloud, for the cloud.
1. Agile Methods and Data Warehousing: How to Deliver Faster
Most people agree that data warehousing and business intelligence projects take too long to deliver. By the time a solution is in place, the business needs have changed. How can Agile development methods like SCRUM and Extreme Programming be used to deliver data warehouse and business intelligence projects faster?
This session looks at the Agile Manifesto’s 12 principles and how they apply in the context of a data warehouse project. The goal is to determine an approach for rapid (2-4 weeks) delivery of portions of an enterprise data warehouse architecture. Real world examples with metrics will be discussed.
2. Agile Data Engineering: Introduction to Data Vault 2.0
Agile Data Warehousing needs a data modeling method that is agile too. Data modeling with Data Vault is an agile technique that designs highly flexible, scalable, and adaptable data structures for enterprise data warehouse repositories. It is a hybrid approach using the best of 3NF and dimensional modeling.
While It is not a replacement for star schema data marts (and should not be used as such), the Data Vault approach has been used in projects around the world
(Europe, Australia, USA) for over 15 years but is still not widely known or understood.
The session introduces the components of the Data Vault Data Model, their purpose and how to build them.
3. Case Study: Hybrid Data Vault – Data Warehousing in the Real World
At a health-care client, we were not able to implement a pure Data Vault 2.0 architecture. Instead, we evolved a hybrid solution that uses Type 2 persistent stage tables tied using standard Hub and Link structures along with a Key Map table. While we were able to utilize DV 2.0 concepts such as MD5 hash keys, we had to come up with a way to resolve the Business Keys further into the process in order to avoid joins in loading the stage tables.
We also built a BI reporting layer using virtual dimensions that were hybrid type 1 and 2 combined. This session demonstrates our solution with examples of working code.
4. Demystifying Data Warehousing as a Service
Data warehouses and associated best practices are changing dramatically. As organizations build new data warehouses and modernize established ones, they are turning to Data Warehousing as a Service (DWaaS) in the cloud. The drivers are performance, concurrency, simplicity, and lower cost of a SaaS solution or simply to reduce their data center footprint (and the maintenance that goes with that). But:
- What is a DWaaS really?
- How is it different from traditional on-premises data warehousing?
- How can a cloud-native data warehouse help enable your agile data warehouse practice?
The Data Warrior
Kent Graziano is the Chief Technical Evangelist for US-based firm Snowflake Computing. Snowflake now offer cloud deployment in the Asia Pacific via the Sydney region on Microsoft Azure and Amazon Web Services.
Kent has developed and led many successful software and data warehouse implementation teams, including multiple agile DW/BI teams. He is a recognised industry expert and award-winning author, speaker, and trainer, in data modelling, data architecture, and data warehousing.
He is an Oracle ACE Director – Alumni, member of the OakTable Network, a certified Data Vault Master and Data Vault 2.0 Practitioner (CDVP2), expert data modeler and solution architect with more than 30 years of experience, including two decades in data warehousing and business intelligence (across multiple industries). He was a co-author on the first book on Data Vault, and the technical editor for Super Charge Your Data Warehouse. Follow him at @KentGraziano.