The Agile Information Factory fully supports the Data Vault 2.0 standard and has a strategic partnership with Scalefree, the company of Dan Lindsted and Michael Olmshimke. Our consultants receive trainings in Data Vault 2.0 and get certified by Scalefree. For more information on Data Vault we refer to danlindsted.com :
Why Bother With Data Vault 2.0? Business Value?
The world is shifting, and including big data is a necessary step in forward movement. Not just that, but subtle changes to the data modeling architecture are necessary for seamless integration of big data and NoSQL environments. Beyond that, for far too long the methodology has been “discounted” or forgotten or left in the dust. Well, I’m here to say that this will no longer be the case.
Customers are demanding IT do more with less (as they always have), and they are asking us to be agile about our implementation strategies. Long gone are the days of 6 month deployments, or even 3 month deployments. We now must step to the plate and begin to acknowledge things like: (These things are parts of the Business Value)
- Managed Self Service BI
- Automation and Back end self-healing systems
- Dynamic Structure Adaptation of the Data Warehouse
- Rapid Time to Deliver (2 or 3 week delivery cycles)
- Lower Cost of Maintenance and Management (TCO)
Businesses are clamoring for the data warehousing industry to “catch up”. Well, with Data Vault 2.0 they can, and you can help them get there rapidly. This year as I release the standards, I will be releasing specifications for the following areas:
- Data Vault Modeling 2.0 Specification (specific to the Data Modeling and architecture components)
- Data Vault Implementation 2.0 Specification (specific to ETL and loading components including Big Data and NoSQL)
- Data Vault Methodology 2.0 Specification (specific to delivery, project management, agile production, etc..)
- Data Vault Architecture 2.0 Specification (what’s required, best practices, and standards for systems architecture designs)
What is Data Vault 2.0?
Data Vault 2.0 is the evolution of the standards for Data Vault. Before I go any further I think it is wise to state that Wikipedia needs an update, as it does not cover all of the components nor the full definition of Data Vault. To that end: here is the proper definition of “Data Vault” itself: Data Vault is a system of data warehousing and business intelligence that is comprised of three major components: the Data Vault Model, the Data Vault Methodology, and the Data Vault Systems Architecture.
Changes to the standard, Data Vault 2.0 brings to the table improvements in the following areas:
- Data Vault Modeling – changes have been made to adapt better performance levels for both loading and querying. These changes are also specific to ensuring the success of Data Vault Modeling with the use of NoSQL environments in a seamlessly integrated fashion.
- Data Vault Methodology – while I’ve introduced bits and pieces of the methodology (such as implementation rules and procedures) during older certification classes, I’ve not really published in full, the complete components around the methodology. Data Vault 2.0 brings the full methodology to bear on the projects to ensure CMMI Level 5 compliance (which relies also on people’s ability to execute), TQM (overall for BI), Six Sigma (for project based build outs), and Agile for rapid 2 to 3 week delivery cycles. Data Vault 2.0 certification will require knowledge of the methodology as well as knowledge of the Modeling components.
- Data Vault Architecture – In my book: Super Charge Your Data Warehouse I outline some of the systems architecture components necessary to make the “Data Vault System” a success. In Data Vault 2.0 not much has changed here, with the exception being: the inclusion of NoSQL environments for multiple purposes. Data Vault 2.0 certification will require knowledge of the NoSQL environments from both an architectural perspective, as well as an implementation perspective.
What Does Certification say to customers?
Certification in Data Vault 2.0 tells the customers that you are well briefed in the standards, the methods, the architecture and design of end-to-end data warehouses for a corporate level. That you have the capacity to deliver in an agile fashion, that you can build, automate, and deploy Data Vault systems from end to end with only weeks of design, and implementation. That you can discuss the business benefits and uplift (or value) with the business users. That you can manage a full Data Vault 2.0 project, that you can include Big Data and NoSQL systems seamlessly and easily in your Data Vault 2.0 implementation plan.