DAIS 2023 Summarization from Scott Hsieh's Point of View

This deck is for a 3-hour session. New features regarding data democracy, development of generative AI, and unified data governance are reviewed.
In the open source world, Spark Connect and Delta Lake 3.0 can be expected and there are 3 major features in Delta Lake 3.0 coming soon, i.e., Delta Lake UniForm, Delta Kernel, and Liquid Clustering.
Furthermore, DuckDB and LangChain will be briefed following the previous slides. And summarization of other breakout sessions will welcome you from data clean room, Spark with GPU, to data sharing.
In the end, there will be a report regarding the status quo of the 104 Lakehouse system and mostly you as a general person won’t be able to access

Transcript