Data in Google I/O - IO Extended GDG Seoul

At the Google I/O 2022 event held from May 11-12 this year, many new technologies and information were shared with developers around the world.
This slide shares news related to Data among them.

Transcript

1. Data in Google I/O Data Systems Trends in 2022 Data MLOps Cloud
2. Overview. Google I/O ‘22
3. Mountain View 2022 Google May 11-12 135 Programs 240 speakers Android AI/ML Cloud Others
4. Google I/O (135 programs) Data Topic (9 programs / 7%) Data in Google I/O 1. Model training with Vertex AI. 2. Build an event-driven orchestration with Eventarc and Workflows. 3. Asynchronous operations in your UI using workflows and Firestore. 4. An introduction to MLOps with TFX. 5. Introducing AlloyDB, a PostgreSQL compatible cloud database service. 6. Fraudfinder: A comprehensive solution for real data science problems. 7. Auto alerts for Firebase users with Functions, Logging, and BigQuery. 8. Easier data preprocessing with Keras. 9. Build for everyone: The importance of representative data.
5. List / Category. Google I/O Programs
6. Keyword from Data-releated programs. TFX Data preprocessing Vertex AI BigQuery Firestore Firebase Eventarc Workflows Cloud Functions Cloud Logging Taskmate AlloyDB
7. Keyword from Data-releated programs. TFX Data preprocessing Vertex AI BigQuery Firestore Firebase Eventarc Workflows Cloud Functions Cloud Logging Taskmate AI/ML Data Engineering Data Ingestion AlloyDB
8. Highlight 1 – Vertex AI https://cloud.google.com/blog/topics/developers-practitioners/kickstart-your-organizations-ml-application- development-flywheel-vertex-feature-store
9. Highlight 2 – AlloyDB https://cloud.google.com/blog/products/databases/alloydb-for-postgresql-intelligent-scalable-storage
10. Highlight 3 – Taskmate https://taskmate.google.com
11. Highlight news & updates. Data trend in Google’s eco-system ‘22
12. New Data system ‘22 Analytics Hub Datastream Dataplex BigLake
13. BigLake https://cloud.google.com/biglake
14. Datastream https://cloud.google.com/datastream
15. Dataplex https://cloud.google.com/dataplex
16. Analytics Hub https://cloud.google.com/analytics-hub
17. “ The increasingly popular lake house merges these two worlds into a unified environment for all types of data ” Google Cloud Future Data Whitepaper https://cloud.google.com/blog/topics/startups/google-cloud-future-of-data-whitepaper
18. Explore current data trends in the top-level view. World-wide Data system
19. Data Ingestion Data Storage Data Processing Data Governance Data System Types in High-level
20. Data Ingestion Data Storage Data Processing Data Governance Drill-down a bit more... Change Data Capture (CDC) Log Ingestion Labeling Crawling Feature Selection DataLake Data warehouse Schema Registry Data Mart Feature Store Batch Processing Stream Processing Feature Engineering Data Workflow Data Analysis Privacy Security Catalog IAM Data Lineage
21. A new concept 1 ELT Extract-Load-Transform
22. Previous ETL concept Extract Transform Load Structed, Semi-structed
23. New ELT concept Extract Load Transform Raw, Unstructured
24. A new concept 2 Lake House DataLake as Data warehouse
25. DataLake concept DataLake Data processing Raw data
26. LakeHouse concept DataLake Data processing Raw data Query Engine Data Mart
27. A new concept 3 Feature Store A storage for a features
28. Feature Store concept https://feast.dev/
29. Vertex AI https://cloud.google.com/blog/topics/developers-practitioners/kickstart-your-organizations-ml-application- development-flywheel-vertex-feature-store
30. A new concept 4 DataOps Data + Operation
31. DataOps concept https://dataopsunleashed.com/what-is-dataops/
32. Explorer previous/following events Data Cloud Summit April 6, 2022 Security Summit May 17, 2022 Google Cloud Next Oct 11, 2022
33. Thank you! Data engineer / Riiid https://www.facebook.com/han.sungmin kenneth@pigno.se @sungmin.han @smilehsm Resources Sungmin Han