буду признателен, если есть возможность держать в курсе гвоздей, на которые успели наступить с одним и вторым:)

Да, думаю на хабре статью запилим, как поставим на ноги ))

Ну и ссылку потом не забудьте)

Здравствуйте)

#odtug

Data Warehousing in the Real World

At a former health-care client, we were not able to implement a pure Data Vault 2.0 architecture. Instead, we had to evolve a hybrid solution that uses Type 2 persistent stage tables we tie together using standard Hub and Link structures along with a Key Map table. While we have been able to utilize DV 2.0 concepts such as MD5 hash keys, in order to avoid joins in loading the stage tables we had to come up with a way to resolve the business keys further into the process. We will show you our solution and discuss the pros and cons of our approach.

Спасибо за ссылку)

Вопрос - у кого на проектах есть Data Vault ?

#odtug
 Agile Data Warehousing: Using Oracle Data Modeler (SDDM) to Build a Virtualized ODS

At a past client, in order to meet timelines to fulfill urgent, unmet reporting needs, I found it necessary to build a virtualized Operational Data Store as the first phase of a new Data Vault 2.0 project. This allowed me to deliver new objects quickly and incrementally to the report developer so we could quickly show the business users their data. In order to limit the need for refactoring in later stages of the data warehouse development, I chose to build this virtualization layer on top of a Type 2 persistent staging layer. All of this was done using Oracle SQL Developer Data Modeler (SDDM) against (gasp!) an MS SQL Server Database. In this talk, I will show you the architecture for this approach, the rationale, and then the tricks I used in SDDM to build all the stage tables and views very quickly. In the end, you will see actual SQL code for a virtual ODS that can easily be translated to an Oracle Database.

   Learn a data warehouse architecture that can be implemented incrementally and in layers.
   Learn what is a Virtual ODS and how it can help you be Agile.
   How to quickly build pattern-based stage tables in SDDM.
   How to build complex, pattern-based views in SDDM.
   Tips on how to use analytic functions to create virtual columns.
   See examples of how to embed change data capture into a view-based loading architecture.

Всем привет
 - скажите какая сейчас самая 🔥 архитектура хранилища на основе OpenSource ?

Архитектура чего? Модель данных же не зависит от того opensource это или нет :)

Плюс разные цели могут быть у хранилища

Кто-то вон на Ms sql делает edwh и ничего 😁

Окей - что самое вкусное для ETL/ELT

для data lake /Staging