Luiti 来构建数据仓库

Transcript

1. 使⽤用 来构建数据仓库 David Chen mvj3.com http://github.com/luiti
2. Luiti is built on top of Luigi was built at mainly
3. https://en.wikipedia.org/wiki/Star_schema Star Schema http://emhughes.com/arbitrary/observation-starfish-cool/ 1. Simpler queries 3. Query performance gains 4. Fast aggregations Benefits Disadvantages A Highly Normalized Database Ideal mode?!
4. Hierarchical Data Warehouse Table Dump Table Clean Table Summary Table Middle Data Flow Fact tables Dimension tables
5. Context Abstract Machine luiti.TaskBase luigi.Task @property @cached_property function object class package CPU IO http://luiti.github.io/chinese/Luiti-as-a-data-warehouse-building-framework.html
6. Luiti Demo!
7. http://luiti.github.io
8. Questions?