Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Data in Google I/O - IO Extended GDG Seoul

Data in Google I/O - IO Extended GDG Seoul

At the Google I/O 2022 event held from May 11-12 this year, many new technologies and information were shared with developers around the world.
This slide shares news related to Data among them.

3bd69093dbe39b14603242b96cfbd7c6?s=128

Sungmin Han

June 21, 2022
Tweet

Other Decks in Technology

Transcript

  1. Data in Google I/O Data Systems Trends in 2022 Data

    MLOps Cloud
  2. Overview. Google I/O ‘22

  3. Mountain View 2022 Google May 11-12 135 Programs 240 speakers

    Android AI/ML Cloud Others
  4. Google I/O (135 programs) Data Topic (9 programs / 7%)

    Data in Google I/O 1. Model training with Vertex AI. 2. Build an event-driven orchestration with Eventarc and Workflows. 3. Asynchronous operations in your UI using workflows and Firestore. 4. An introduction to MLOps with TFX. 5. Introducing AlloyDB, a PostgreSQL compatible cloud database service. 6. Fraudfinder: A comprehensive solution for real data science problems. 7. Auto alerts for Firebase users with Functions, Logging, and BigQuery. 8. Easier data preprocessing with Keras. 9. Build for everyone: The importance of representative data.
  5. List / Category. Google I/O Programs

  6. Keyword from Data-releated programs. TFX Data preprocessing Vertex AI BigQuery

    Firestore Firebase Eventarc Workflows Cloud Functions Cloud Logging Taskmate AlloyDB
  7. Keyword from Data-releated programs. TFX Data preprocessing Vertex AI BigQuery

    Firestore Firebase Eventarc Workflows Cloud Functions Cloud Logging Taskmate AI/ML Data Engineering Data Ingestion AlloyDB
  8. Highlight 1 – Vertex AI https://cloud.google.com/blog/topics/developers-practitioners/kickstart-your-organizations-ml-application- development-flywheel-vertex-feature-store

  9. Highlight 2 – AlloyDB https://cloud.google.com/blog/products/databases/alloydb-for-postgresql-intelligent-scalable-storage

  10. Highlight 3 – Taskmate https://taskmate.google.com

  11. Highlight news & updates. Data trend in Google’s eco-system ‘22

  12. New Data system ‘22 Analytics Hub Datastream Dataplex BigLake

  13. BigLake https://cloud.google.com/biglake

  14. Datastream https://cloud.google.com/datastream

  15. Dataplex https://cloud.google.com/dataplex

  16. Analytics Hub https://cloud.google.com/analytics-hub

  17. “ The increasingly popular lake house merges these two worlds

    into a unified environment for all types of data ” Google Cloud Future Data Whitepaper https://cloud.google.com/blog/topics/startups/google-cloud-future-of-data-whitepaper
  18. Explore current data trends in the top-level view. World-wide Data

    system
  19. Data Ingestion Data Storage Data Processing Data Governance Data System

    Types in High-level
  20. Data Ingestion Data Storage Data Processing Data Governance Drill-down a

    bit more... Change Data Capture (CDC) Log Ingestion Labeling Crawling Feature Selection DataLake Data warehouse Schema Registry Data Mart Feature Store Batch Processing Stream Processing Feature Engineering Data Workflow Data Analysis Privacy Security Catalog IAM Data Lineage
  21. A new concept 1 ELT Extract-Load-Transform

  22. Previous ETL concept Extract Transform Load Structed, Semi-structed

  23. New ELT concept Extract Load Transform Raw, Unstructured

  24. A new concept 2 Lake House DataLake as Data warehouse

  25. DataLake concept DataLake Data processing Raw data

  26. LakeHouse concept DataLake Data processing Raw data Query Engine Data

    Mart
  27. A new concept 3 Feature Store A storage for a

    features
  28. Feature Store concept https://feast.dev/

  29. Vertex AI https://cloud.google.com/blog/topics/developers-practitioners/kickstart-your-organizations-ml-application- development-flywheel-vertex-feature-store

  30. A new concept 4 DataOps Data + Operation

  31. DataOps concept https://dataopsunleashed.com/what-is-dataops/

  32. Explorer previous/following events Data Cloud Summit April 6, 2022 Security

    Summit May 17, 2022 Google Cloud Next Oct 11, 2022
  33. Thank you! Data engineer / Riiid https://www.facebook.com/han.sungmin kenneth@pigno.se @sungmin.han @smilehsm

    Resources Sungmin Han