Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Voxxed Days Belgrade 2017: Deploying Image Recognition with TensorFlow and Kubernetes

1ed0b822068d34032bca7d2beeb2f846?s=47 Casey West
October 19, 2017
Technology
0
83

Voxxed Days Belgrade 2017: Deploying Image Recognition with TensorFlow and Kubernetes

1ed0b822068d34032bca7d2beeb2f846?s=128

Casey West

October 19, 2017
Tweet

More Decks by Casey West

See All by Casey West
TechSummit Amsterdam 2017: Enhance! Deploying Image Recognition with TensorFlow and Kubernetes
1ed0b822068d34032bca7d2beeb2f846?s=48 caseywest
0
130
Said no CEO ever: Things that don't matter in the cloud
1ed0b822068d34032bca7d2beeb2f846?s=48 caseywest
12
2.8k
OperabilityIO 2016 – Achieving Cloud-Native Operability
1ed0b822068d34032bca7d2beeb2f846?s=48 caseywest
0
350
ContainerCon North America – Cloud Anti-Patterns
1ed0b822068d34032bca7d2beeb2f846?s=48 caseywest
3
2.8k
Abstractions – Pittsburgh – The Twelve-Factor Container + BONUS
1ed0b822068d34032bca7d2beeb2f846?s=48 caseywest
0
240
Velocity — Minimum Viable Platform
1ed0b822068d34032bca7d2beeb2f846?s=48 caseywest
0
250
Minimum Viable Platform - Devops MSP
1ed0b822068d34032bca7d2beeb2f846?s=48 caseywest
0
200
How Platforms Work
1ed0b822068d34032bca7d2beeb2f846?s=48 caseywest
0
530
Linux Conf Australia 2016 - The Twelve-Factor Container
1ed0b822068d34032bca7d2beeb2f846?s=48 caseywest
3
540

Other Decks in Technology

See All in Technology
Custom GitHub Actions by Java
E68f2e8b47dc1769380a1fa8181df3dd?s=48 kazamori
0
290
データをモデリングしていたら、組織をモデリングし始めた話 / engineers-in-carta-vol3-data-engineer
F3358acf3b3f8423f2db7718b51b5022?s=48 pei0804
4
3.3k
データエンジニアと作るデータ文化
465cba0ac1de7e490c6ea484da327572?s=48 yuki_saito
4
1.6k
miisan's career talk
253f81535853f9fddcadaec9b37dc1e0?s=48 mii3king
0
220
アーキテクチャを明文化して開発に臨んだ話
903c7dbf16067d22e7b03ead7d8acdc5?s=48 akkie76
0
290
Build 2022で発表されたWindowsアプリ開発のあれこれ振り返ろう
49bf5c26799bbfb3d445c757c1fe8374?s=48 hatsunea
1
380
DOM Invader - prototype pollution対応の衝撃 - / DOM Invader - prototype pollution
2c4ef0f20c4f05ca30e6c9917f0c17b6?s=48 okuken
0
150
OPENLOGI Company Profile
5c588fdfe782f92fa6b081903edd82bb?s=48 hr01
0
490
Custom AppをIP制限ありのままで審査に通す方法
Df8bc8c531e2c5c89c1a007db1cf79a3?s=48 yusuga
0
680
音のような言葉 〜ちゃちゃっとチャットで楽しむちょっとしたコツ〜 / words like sounds
8db3c91c8b3d3e5686f62fbf43c303dd?s=48 satoryu
1
1.4k
JJUG2022_spring_Keycloak (Red Hat Single Sign-on)
6aab1831cbfef013b122d4cdb3c6680f?s=48 tinoue
0
200
要約 "Add Live Text interaction to your app"
9e64d2069945742c818421e884603b44?s=48 ushisantoasobu
0
150

Featured

See All Featured
Teambox: Starting and Learning
Aebc2d07a50011e2a30d38435fde564a?s=48 jrom
123
7.7k
Unsuck your backbone
B83d5b590577969ee79a5ad845411a7d?s=48 ammeep
659
55k
Building Your Own Lightsaber
Fe6b81005d1553accd6b2a28f6a2bef1?s=48 phodgson
94
4.6k
Designing Experiences People Love
1b75d89772b7eea1f6c89fbf362607d9?s=48 moore
130
22k
Build your cross-platform service in a week with App Engine
5f83ef806155b403c3393160ce51f955?s=48 jlugia
219
17k
The Invisible Customer
4262b9cfacfb6b2c77f23e1d0310cd3e?s=48 myddelton
110
11k
Happy Clients
C51b39fa3c79ccb99dcb8a076bc98287?s=48 brianwarren
89
5.6k
Fight the Zombie Pattern Library - RWD Summit 2016
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
226
15k
Done Done
282d599b414022eba5096510f675b6e2?s=48 chrislema
174
14k
XXLCSS - How to scale CSS and keep your sanity
1b8ad785acdd1ce1c99914b1c2a4e10e?s=48 sugarenia
236
1M
Docker and Python
Ecdea9b9714877b86cee08458f085481?s=48 trallard
27
1.6k
Six Lessons from altMBA
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
14
1.4k

Transcript

  1. Enhance! Deploying Image Recognition with TensorFlow and Kubernetes Casey West

    ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 1

  2. I am… —Dad, software architect, technical lead, change agent, programmer,

    beverage enthusiast, rock climber, cyclist, acro yoga person… —An Architecture Advocate at Google. I am not… —A data scientist. —An expert in machine learning. ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 2

  3. however… ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes

    3

  4. I know enough to be dangerous. ! @caseywest @googlecloud @VoxxedBelgrade

    #" #VBD17 #machinelearning #tensorflow #kubernetes 4

  5. In 40 minutes you will also know enough to be

    dangerous. ! ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 5

  6. Let's get dangerous. ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning

    #tensorflow #kubernetes 6

  7. Project Plan —Phase 0: Understand ML Basics —Phase 1: Create

    TensorFlow Serving model —Phase 2: Create TensorFlow Serving client app —Phase 3: Deploy on Kubernetes —Phase 4: Play! ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 7

  8. Understand ML Basics ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning

    #tensorflow #kubernetes 8

  9. Understand ML Basics ¯\_(ϑ)_/¯ ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17

    #machinelearning #tensorflow #kubernetes 9

  10. Training a Model 1. Data 2. Time 3. Procedure !

    @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 10

  11. Training a Model 1. Data Historical or available data. !

    @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 11

  12. Training a Model 2. Time Iterations you have time to

    make. ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 12

  13. Training a Model 3. Procedure Discover data preparation procedures, an

    algorithm to use, and how to configure it. ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 13

  14. Training a Model: Steps 1. Get a data set. 2.

    Split it into training and testing data. 3. Train the algorithm. 4. Test the algorithm. 5. Ship it! ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 14

  15. Training a Model: Know More in Five Minutes https://www.youtube.com/watch?v=2FmcHiLCwTU —

    Siraj Raval ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 15

  16. Image Recognition: Inception v3 https://github.com/tensorflow/models/tree/master/research/inception ! @caseywest @googlecloud @VoxxedBelgrade #"

    #VBD17 #machinelearning #tensorflow #kubernetes 16

  17. Serving the model with TensorFlow Serving —Continuous training pipeline —gRPC

    interface —Production ready https://www.tensorflow.org/serving/ ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 17

  18. Pre-trained models exist! ! Let's containerize them before they get

    away! ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 18

  19. Create a Docker Image: TensorFlow Serving Inception v3 Docker Machine

    docker-machine create \ --driver google \ --google-project goog-caseywest \ --google-zone us-central1-a \ --google-machine-type n1-standard-4 \ docker-machine eval $(docker-machine env docker-machine) ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 19

  20. Create a Docker Image: TensorFlow Serving Inception v3 Run developer

    container git clone git@github.com:tensorflow/serving.git cd serving docker build --pull \ -t $USER/tensorflow-serving-devel \ -f tensorflow_serving/tools/docker/Dockerfile.devel . docker run --name=inception_container -it \ $USER/tensorflow-serving-devel ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 20

  21. Create a Docker Image: TensorFlow Serving Inception v3 Build in

    the devel the container git clone --recurse-submodules \ https://github.com/tensorflow/serving cd serving/tensorflow ./configure # interactive :-( cd .. bazel build -c opt tensorflow_serving/... ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 21

  22. Create a Docker Image: TensorFlow Serving Inception v3 Export inception

    in the devel the container curl -LO http://cwe.st/tf-inception-v3 tar xzf inception-v3-2016-03-01.tar.gz bazel-bin/tensorflow_serving/example/inception_saved_model \ --checkpoint_dir=inception-v3 \ --output_dir=inception-export ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 22

  23. Create a Docker Image: TensorFlow Serving Inception v3 Commit and

    deploy container docker commit inception_container \ $USER/inception_serving docker tag $USER/inception_serving \ gcr.io/goog-caseywest/inception gcloud docker -- push \ gcr.io/goog-caseywest/inception ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 23

  24. The Machines Have Already Learned Using ML isn't doing ML.

    ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 24

  25. Deploy Inception Service on Kubernetes Create a cluster gcloud container

    clusters create \ image-recognition-cluster \ --num-nodes 5 ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 25

  26. Let's do it live… ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17

    #machinelearning #tensorflow #kubernetes 26

  27. We did it! ! ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17

    #machinelearning #tensorflow #kubernetes 27

  28. Takeaways —Training models is hard. —Serving models is kind of

    easy. —gRPC and protobuf have steep learning curves. —therefore, client libraries are challenging. ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 28

  29. Want the code? —DM me @caseywest —Email me caseywest@google.com —Try

    a similar tutorial —https://tensorflow.github.io/serving/ serving_inception ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 29

  30. Want to try more ML? —TensorFlow —https://www.tensorflow.org/ —MXNet —http://mxnet.io/ —Google

    Cloud Playground —https://cloud.google.com/vision/ ! @caseywest @googlecloud @VoxxedBelgrade #" #VBD17 #machinelearning #tensorflow #kubernetes 30

  31. Let's be friends @caseywest ! ! @caseywest @googlecloud @VoxxedBelgrade #"

    #VBD17 #machinelearning #tensorflow #kubernetes 31