Slide 1

Slide 1 text

ML/DS Serverless (Framework)⚡ Ikeda Yutaro @ikedaosushi Kaizen Platform

Slide 2

Slide 2 text

Ikeda Yutaro @ikedaosushi # # Kaizen Platform / # #vue #nuxt #serverless #aws #python #pyconjp #tsukuba.py #bq # rebase

Slide 3

Slide 3 text

https://blog.ikedaosushi.com

Slide 4

Slide 4 text

ML/DS Serverless Architecture ? ⚡

Slide 5

Slide 5 text

ML/DS Serverless Architecture ⚡

Slide 6

Slide 6 text

ML/DS

Slide 7

Slide 7 text

ML/DS Serverless (kube ow ) ML/DS " Serverless AWS Public Cloud

Slide 8

Slide 8 text

ML/DS 2

Slide 9

Slide 9 text

ML/DS 2

Slide 10

Slide 10 text

ML/DS / : 1 1 50GB

Slide 11

Slide 11 text

: MVP

Slide 12

Slide 12 text

/ SRE

Slide 13

Slide 13 text

Serverless⚡

Slide 14

Slide 14 text

Serverless AWS Lambda - Hub https://employment.en-japan.com/engineerhub/entry/2018/07/03/110000 ( )

Slide 15

Slide 15 text

Serverless cncf/wg-serverless https://github.com/cncf/wg-serverless/tree/master/whitepapers/serverless-overview

Slide 16

Slide 16 text

Serverless Asynchronous, concurrent, easy to parallelize into independent units of work Infrequent or has sporadic demand, with large, unpredictable variance in scaling requirements Stateless, ephemeral, without a major need for instantaneous cold start time Highly dynamic in terms of changing business requirements that drive a need for accelerated developer velocity cncf/wg-serverless https://github.com/cncf/wg-serverless/tree/master/whitepapers/serverless-overview

Slide 17

Slide 17 text

Serverless Asynchronous, concurrent, easy to parallelize into independent units of work Infrequent or has sporadic demand, with large, unpredictable variance in scaling requirements Stateless, ephemeral, without a major need for instantaneous cold start time Highly dynamic in terms of changing business requirements that drive a need for accelerated developer velocity cncf/wg-serverless https://github.com/cncf/wg-serverless/tree/master/whitepapers/serverless-overview

Slide 18

Slide 18 text

ML/DS Serverless Architecture ⚡

Slide 19

Slide 19 text

Serverless

Slide 20

Slide 20 text

Serverless API

Slide 21

Slide 21 text

Serverless API

Slide 22

Slide 22 text

3 Serverless Architectures https://martinfowler.com/articles/serverless.html#InherentDrawbacks

Slide 23

Slide 23 text

ML/DS BaaS DevOps

Slide 24

Slide 24 text

BaaS Fargate SagaMaker Batch Personalize Forecast Rekognition DynamoDB Aurora S3 (ARN)

Slide 25

Slide 25 text

Jupyter Notebook DevOps DevOps

Slide 26

Slide 26 text

⚡ Serverless Framework

Slide 27

Slide 27 text

Serverless Framework Serverless AWS GCP Azure Public Cloud (AWS ) CloudFormation

Slide 28

Slide 28 text

Serverless Framework CloudFormation Lambda DevOps

Slide 29

Slide 29 text

'BSHBUF 4 4BHB.BLFS ϩʔσʔλ લॲཧͯ͠Ξοϓϩʔυ Ճ޻ࡁσʔλ ֶशˍσϓϩΠ 'BSHBUFݺͼग़͠ $MPVE8BUDI ఆظ࣮ߦ ਪ࿦ : Sagemaker -BNCEB

Slide 30

Slide 30 text

Serverless Framework CloudFormation Lambda DevOps

Slide 31

Slide 31 text

custom

Slide 32

Slide 32 text

resources(Cfn)

Slide 33

Slide 33 text

Lambda

Slide 34

Slide 34 text

'BSHBUF 4 4BHB.BLFS ϩʔσʔλ લॲཧͯ͠Ξοϓϩʔυ Ճ޻ࡁσʔλ ֶशˍσϓϩΠ 'BSHBUFݺͼग़͠ $MPVE8BUDI ఆظ࣮ߦ ਪ࿦ Lambda -BNCEB custom Readabilityほ

Slide 35

Slide 35 text

SageMaker Serverless scikit-learn API - https://blog.ikedaosushi.com/entry/2019/05/03/024510

Slide 36

Slide 36 text

Serverless Framework CloudFormation Lambda DevOps

Slide 37

Slide 37 text

stage

Slide 38

Slide 38 text

Serverless Framework - Qiita https://qiita.com/horike37/items/b295a91908fcfd4033a2

Slide 39

Slide 39 text

Serverless Framework BaaS DevOps

Slide 40

Slide 40 text

ML/DS

Slide 41

Slide 41 text

ML/DS / Serverless Architecture ML/DS ML/DS on Serverless Architecture Serverless Framework horike

Slide 42

Slide 42 text

ML/DS Serverless (Framework)⚡