Google_Cloud_Next_19_AI_ML_Summary_public.pdf

GCPNext'19 で発表された、AI/ML関連のまとめ資料 @社内勉強会

Transcript

1. Google Cloud Next’19 Summary
   - AI/ML -
   Ryosuke Mashiko
   AI System Dept. Machine Learning Engineering Team
   DeNA Co,. Ltd
   

   View Slide

2. 
   ■ Next
   ■ NDA
   
   

   View Slide

3. Google Cloud Next’19
   ■ : San Francisco
   ■ : 4/9 ~ 4/11
   ■ GCP
   
   ■ : 34000
   500
   

   View Slide

4. 
   ■ !, $
   ✓ *)
   ✓ $&
   "#
   ■ Uber/Lyft(
   ■ +%'
   FordBike
   Amazon Go
   

   View Slide

5. View Slide

6. View Slide

7. Cloud Next AI/ML Summary
   

   View Slide

8. tl;dr
   ■ AI&1+03 (0
   $% .
   ■ Keyword: Digital Transformation( ‘18 Democratizing AI )
   ✓ %'*4)/2: !%"%%etc
   ✓ $# 5-
   ■ Anthos
   ✓ GKE both on GCP, ON-PREM, AWS
   ■ Microsoft,6
   ✓ Managed Active Directory
   ✓ Cloud SQL with Microsoft SQL server
   

   View Slide

9. tl;dr
   ■ AI/MLAI
   
   ✓ AI Platform
   ✓ AI Hub
   ✓ AutoML
   ○ AutoML Table
   ○ AutoML Video API
   ✓ BigQueryML
   

   View Slide

10. : https://www.youtube.com/watch?v=OHIEZ-Scek8
    

    View Slide

11. 
    ■ BigQuery ML
    ■ AutoML
    ■ AI Platform
    

    View Slide

12. BigQuery ML
    

    View Slide

13. BigQuery ML
    ■ SQL /
    ■ Update
    
    ■ BQ
    

    View Slide

14. BigQuery ML: ~
    ~
    CREATE OR REPLACE MODEL `test_dataset.boston_predict_model`
    OPTIONS
    (model_type='linear_reg', input_label_cols=['price']) AS
    SELECT
    *
    FROM `test_dataset.boston_train`
    : http://soymsk.hatenablog.com/entry/2018/09/08/144846
    

    View Slide

15. BigQuery ML: ~
    ~
    SELECT
    *
    FROM
    ML.TRAINING_INFO(MODEL `test_dataset.boston_predict_model`)
    

    View Slide

16. BigQuery ML:
    ~
    ~
    SELECT
    *
    FROM
    ML.EVALUATE(MODEL `test_dataset.boston_predict_model`, (
    SELECT
    *
    FROM
    `test_dataset.boston_test`))
    

    View Slide

17. BigQuery ML:
    ~ ~
    SELECT
    price,
    predicted_price
    FROM
    ML.PREDICT(MODEL `soymsk-gcp.test_dataset.boston_predict_model`,
    (
    SELECT
    *
    FROM
    `test_dataset.boston_test`))
    

    View Slide

18. NEW
    : https://www.youtube.com/watch?v=OHIEZ-Scek8
    

    View Slide

19. BigQuery
    DWH Preprocessing
    Model Train
    Predict
    BigQuery
    Data
    Model Train
    Predict
    Scheduled Query
    
    BQML
    Scheduled Query
    
    BQML
    ■ BQ
    
    

    View Slide

20. AutoML
    

    View Slide

21. AutoML
    ■ 20189Cloud Next FK +$
    ■ -6))+7 S
    ■ ,4+#(#0 >P%"*I5B;
    ✓ '++8GC"+C:
    
    ✓ %"*GCP0 B;+! &QJ
    ✓ '++■ APIE
    ✓ Vision … D13RA.?2
    ✓ NL … I@LN
    ✓ Translation … HM
    

    View Slide

22. NEW: AutoML Vision Edge
    ■ AutoML
    #"API$
    ■ AutoML Vision Edge
    ✓ Vision !
    
    ○ Tensorflow Lite format
    ○ Edge TPU compiled TensorFlow Lite format
    ○ TensorFlow
    ■ Edge TPU
    
    : https://cloud.google.com/edge-tpu/
    

    View Slide

23. NEW: AutoML Video API
    ■ Vision APIVideo API
    ■
    ✓
    ✓
    
    ✓
    : https://cloud.google.com/vision/automl/docs/?hl=ja
    

    View Slide

24. NEW: AutoML Table
    ■ Structured Data(
    ) API
    ✓ BG/GCS
    ■ AdaNet
    ✓ https://github.com/tensorflow/adanet
    : https://cloud.google.com/automl-tables/?hl=ja
    

    View Slide

25. AutoML Table
    DEMO
    

    View Slide

26. AutoML Table:
    
    
    
    

    View Slide

27. AutoML Table:
    
    
    

    View Slide

28. AutoML Table:
    
    ■ 1000
    ■ > 1 hour
    ■
    →
    

    View Slide

29. AutoML Table:
    
    ■
    ✓ IN: BQ/GIS
    ✓ OUT: BQ/GIS
    ■
    ✓ API
    

    View Slide

30. AI Platform
    

    View Slide

31. AI Platform
    ■ AI Platform (Cloud ML Engine $" + α)
    ■ &0-#
    ✓ : Jupyter Notebook ( ≒ SageMaker @ AWS)
    ✓ AI Hub: %,+ !(
    ✓ Kubeflow: *)%,
    ✓ Training/Prediction:
    %,/'1&/
    ■ CMLE*.
    

    View Slide

32. AI Platform: Notebook
    ■ Managed Jupyter (JaaS)
    ■ DL Tensorflow/Pytorch&!
    ✓ "$
    
    
    ■ $#&%
    ✓ GPU
    
    

    View Slide

33. AI Platform: AI Hub
    ■ " !$) "
    
    ■ Google+*#'
    "
    (
    &%: https://aihub.cloud.google.com
    

    View Slide

34. AI Platform: Kubeflow (Pipeline)
    ■ *($/#
    3.%1 OSS
    ✓ TFX (Tensorflow Extended) +-
    ✓ Kubernetes()
    ✓ JupyterHub, Katib, Pipeline
    ■ Kubeflow Pipeline
    ✓ ML#
    !,)&
    ✓ AI Hub2'
    ○ AI Hub "0
    https://github.com/kubeflow/kubeflow
    

    View Slide

35. AI Platform: Training/Prediction
    ■ $)/&+ %*!(
    ✓ $)/&+#'Docker GPU/TPU"
    #'
    %*
    ✓ Multi-GPU
    ✓ TPU
    

    View Slide

36. TPU
    ■ GoogleTensor Processing Unit
    ■ GPU
    
    ■ https://storage.googleapis.com/nexttpu/index.html
    ■ Update:
    ✓ TPU v3 (2018) GA
    

    View Slide

37. ()" #
    TPU
    Multi GPU
    
    AI Platform%
    DWH
    BigQuery
    Cloud
    Storage
    Cloud Machine
    Learning
    
    #
    &
    !
    Kubeflow Pipeline
    EDA
    Model $
    " #
    Single GPU
    
    $
    AI Notebook
    ( 4 0. 1 ) 4
    22 0. ,
    
    
    AI Hub
    

    View Slide

38. 
    ■ NEW: Recommendation API
    ✓ Personalized Recommendation API
    ○
    ■ NEW: Cloud Inference API
    ✓
    β
    ✓
    ○
    

    View Slide

39. 
    ■ AI)80%/%AGPRQ
    ✓ @
    IE$ !
    ■ Tensorflow')+,/7?!
    ✓ TF2.0 Eager Execution ModeKJNFMLD
    ✓ 5<-(1AC
    4;>7=>(#SH!T
    ■ 6:.(9&2
    ✓ AIGCP*>3,AWS(9&2OB"
    

    View Slide

40. 
    : Cloud Dataflow
    ■ Dataflow
    ✓ %*0 Apache Beam !2
    ✓ Python/Java&MapReduce*!1 ,
    ✓ %*4/(#()) !2
    ■ Update
    ✓ Preemptible VM(Spot instance@AWS)
    +3.
    ○ 5" -$
    ✓ ' 70%OFF
    

    View Slide