integrating data using data fabric technology

The value of data to organisations is only increasing, yet many architectures still make use of data lakes and/or data warehouses which come with severe limitations. In this talk we compare these old technologies to the newer data fabric technologies. How does it solve common problems and what cool things can we do in the backend. We also practically explore the architecture; microservices, Kubernetes and Apache Spark engine.

Transcript

1. Chris Tite integrating distributed enterprise data using data fabric technology atlantic 2 @tite_chris youtube channel : inStruct hosted by chris tite
2. talk overview
3. talk resources source code : https://gitlab.com/chris_tite/devconf2022.git slide deck : https://speakerdeck.com/chris_tite/integrating-data-using-data- fabric-technology
4. beer!
5. the challenge
6. disclaimer
7. warehouses and lakes
8. lakes and swamps
9. fabrics
10. fraxses
11. fraxses - legoz
12. fraxses demo
13. apache spark – compute engine
14. build your own
15. common data model (cdm)
16. dirty data
17. /* THANK YOU*/ Chris Tite Kaleidocode Chris.tite@kaleidocode.co.za +27 83 256 2069 http://www.devconf.co.za/
18. architecture