Upgrade to Pro — share decks privately, control downloads, hide ads and more …

How we use GPUs in Cookpad

Avatar for Yuichiro Someya Yuichiro Someya
November 06, 2017
Programming
190
0

How we use GPUs in Cookpad

@Tokyo Machine Learning Kitchen
https://tokyo-ml.github.io/

Avatar for Yuichiro Someya

Yuichiro Someya

November 06, 2017

More Decks by Yuichiro Someya

See All by Yuichiro Someya
にんげんがさき 基盤はあと / Developers over ML platform
Avatar for Yuichiro Someya ayemos
0
15k
機械学習をスモールスタートさせる方法 / small machine learning
Avatar for Yuichiro Someya ayemos
3
2.1k
アットホームな分析基盤の作り方 / Homemade Machine Learning Toolkits
Avatar for Yuichiro Someya ayemos
1
1k
サービス開発、機械学習、クラウド / the trinity of machine learning
Avatar for Yuichiro Someya ayemos
0
3.6k
成長を止めない機械学習のやり方 / Don't stop 'til you get enough (data).
Avatar for Yuichiro Someya ayemos
15
5.3k
AWS で加速する機械学習 / Accelerate Machine Learning with AWS
Avatar for Yuichiro Someya ayemos
1
360
クックパッドの機械学習基盤 2018 / Machine Learning Platform at Cookpad ~ 2018 ~
Avatar for Yuichiro Someya ayemos
15
21k
PyTorchとCaffe2とONNXと深層学習モデルのデプロイについて
Avatar for Yuichiro Someya ayemos
1
3.1k
クックパッドにおけるAWS GPUインスタンスの利用事例 / Powering by AWS GPU Instances in Cookpad Inc
Avatar for Yuichiro Someya ayemos
0
450

Other Decks in Programming

See All in Programming
AI駆動開発勉強会 広島支部 第一回勉強会 AI駆動開発概要とワークショップ
Avatar for smz hyt hayatoshimiu
0
340
要はバランスからの卒業 #yumemi_grow
Avatar for Takuma Kajikawa kajitack
0
190
Are We Really Coding 10× Faster with AI?
Avatar for Koichi Yoshida kohzas
0
210
Transactional Change Stream Processing With Debezium and Apache Flink
Avatar for Gunnar Morling gunnarmorling
1
120
自動レビューエンジンの実装と運用 ~レビューのない世界へ~
Avatar for Kanato kurukuru1999
1
190
誰も頼んでない機能を出荷した話
Avatar for Hidetaka Toriyama zekutax
0
110
タクシーアプリ『GO』の バックエンド開発のおける AI利活用と若者のすべて
Avatar for Kazuhiko Yamashita pyama86
1
670
AI時代になぜ書くのか
Avatar for Mutz mutsumix
0
450
These Five Tricks Can Make Your Apps Greener, Cheaper, & Nicer
Avatar for Holly Cummins hollycummins
0
120
Sans tests, vos agents ne sont pas fiables
Avatar for Nathan Abondance nabondance
0
150
ローカルLLMでどこまでコードが書けるか / How much code can be written on a local LLM
Avatar for Naoki Kishida kishida
2
400
inferと仲良くなる10分間
Avatar for ryokatsuse ryokatsuse
1
190

Featured

See All Featured
Building a A Zero-Code AI SEO Workflow
Avatar for Ian Lurie portentint
PRO
0
530
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
210
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
Avatar for r-kagaya rkaga
61
44k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
10
1.2k
Pawsitive SEO: Lessons from My Dog (and Many Mistakes) on Thriving as a Consultant in the Age of AI
Avatar for David Carrasco davidcarrasco
0
140
Reality Check: Gamification 10 Years Later
Avatar for Sebastian Deterding codingconduct
0
2.2k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
174
15k
Six Lessons from altMBA
Avatar for Skipper Chong Warson skipperchong
29
4.2k
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.7k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
55k
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
2.9k

Transcript

  1. )PXXFVTF(16TJO$PPLQBE :VJDIJSP4PNFZB!$PPLQBE*OD3%

  2. ‣ Yuichiro Someya (ayemos) ‣ github.com/ayemos ‣ Machine Learning Enginner

    @ Cookpad Inc. # 2016(new grads) ~ Current
  3. None

  4. ‣ 0VS(16FOWJSPONFOU  )PXXFVUJMJ[F"84T(16JOTUBODFT  )PXXFLFFQPVSTDBMBCJMJUZPGUFBNTJO3% 

  5. 

  6.  /7*%*"7

  7.  All-in on AWS since 2011

  8.  All-in on AWS since 2011 Amazon RDS (Relational Data)

    Amazon Redshift (Data Warehouse)

  9.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse)

  10.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) 7JSUVBM1SJWBUF$MPVE

  11. 7JSUVBM1SJWBUF$MPVE  All-in on AWS since 2011 Amazon S3 (Object

    Storage) Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) Amazon EC2 (Computation)

  12.  ‣ $6%" ‣ DV%//

  13.  ‣ $6%" ‣ DV%// (Snapshot)

  14.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

  15.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  16.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  17. 5FNQMBUF  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 5FNQMBUF KTPO

    QBDLFSCVJME

  18.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  19.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    IUUQTBXTBNB[PODPNBNB[POBJBNJT CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  20.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  21.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  22.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)

  23.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)

  24. ‣ 0OEFNBOE(16XPSLCFODIFT  6UJMJ[F".*UPNVMUJQMFXPSLCFODIFOWJSPONFOUT  1BDLFSNBLFTJUFBTJFSUPVQEBUFBOENPSFTUBCMF  0QFSBUFWJB$IBUCPU  8SBQVQ