Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

How we use GPUs in Cookpad

Avatar for Yuichiro Someya Yuichiro Someya
November 06, 2017
Programming
210
0

How we use GPUs in Cookpad

@Tokyo Machine Learning Kitchen
https://tokyo-ml.github.io/

Avatar for Yuichiro Someya

Yuichiro Someya

November 06, 2017

More Decks by Yuichiro Someya

See All by Yuichiro Someya
にんげんがさき 基盤はあと / Developers over ML platform
Avatar for Yuichiro Someya ayemos
0
15k
機械学習をスモールスタートさせる方法 / small machine learning
Avatar for Yuichiro Someya ayemos
3
2.1k
アットホームな分析基盤の作り方 / Homemade Machine Learning Toolkits
Avatar for Yuichiro Someya ayemos
1
1k
サービス開発、機械学習、クラウド / the trinity of machine learning
Avatar for Yuichiro Someya ayemos
0
3.7k
成長を止めない機械学習のやり方 / Don't stop 'til you get enough (data).
Avatar for Yuichiro Someya ayemos
15
5.3k
AWS で加速する機械学習 / Accelerate Machine Learning with AWS
Avatar for Yuichiro Someya ayemos
1
370
クックパッドの機械学習基盤 2018 / Machine Learning Platform at Cookpad ~ 2018 ~
Avatar for Yuichiro Someya ayemos
15
21k
PyTorchとCaffe2とONNXと深層学習モデルのデプロイについて
Avatar for Yuichiro Someya ayemos
1
3.1k
クックパッドにおけるAWS GPUインスタンスの利用事例 / Powering by AWS GPU Instances in Cookpad Inc
Avatar for Yuichiro Someya ayemos
0
460

Other Decks in Programming

See All in Programming
JPUG勉強会 OSSデータベースの内部構造を理解しよう(第２回)
Avatar for Atsushi Ogawa oga5
0
260
Family mrubyの進捗
Avatar for Katsuhiko Kageyama kishima
1
130
SREの越境 / SRE Collaboration
Avatar for y-ohgi y0hgi
2
240
AgentCore CLI で進化した AWS での AI エージェントの作り方 : 必要な機能を必要な時に
Avatar for Takahiro Kubo icoxfog417
PRO
3
350
XP祭りでしか伝わらないフリップネタ #xpjug
Avatar for bayashi murabayashi
0
150
Heart of Swift Concurrency
Avatar for Yuta Koshizawa koher
0
900
選挙速報を多くのユーザーへ 届ける Live Activities 設計
Avatar for kengo saito hamayokokuririn
0
150
UPDATE をやめる — EF Core でマスタをバージョン管理する
Avatar for HideyukiKitao panda728
PRO
0
160
SONY CISC-NEWS NWS-1750 + NWB-225 フレームバッファの NetBSD/news68k ドライバ実装 / OSC2026Hiroshima
Avatar for Izumi Tsutsui tsutsui
0
120
AGENTS.md Is Not Enough: Build Skills, Don't Download Them
Avatar for Alex T lx_t
0
120
XHTMLが残したもの
Avatar for Yosuke Furukawa yosuke_furukawa
PRO
2
810
WebRTC映像をAirPlayに対応させる挑戦.pdf
Avatar for monolithic-adam monolithic_adam
0
290

Featured

See All Featured
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
55
10k
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
Avatar for UX Y'all uxyall
1
410
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
460
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
530
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
510
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
66
8.6k
How To Speak Unicorn (iThemes Webinar)
Avatar for Michelle Schulp Hunt marktimemedia
1
580
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
77
5.5k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
142
7.7k
DevOps and Value Stream Thinking: Enabling flow, efficiency and business value
Avatar for Helen Beal helenjbeal
1
390

Transcript

  1. )PXXFVTF(16TJO$PPLQBE :VJDIJSP4PNFZB!$PPLQBE*OD3%

  2. ‣ Yuichiro Someya (ayemos) ‣ github.com/ayemos ‣ Machine Learning Enginner

    @ Cookpad Inc. # 2016(new grads) ~ Current
  3. None

  4. ‣ 0VS(16FOWJSPONFOU  )PXXFVUJMJ[F"84T(16JOTUBODFT  )PXXFLFFQPVSTDBMBCJMJUZPGUFBNTJO3% 

  5. 

  6.  /7*%*"7

  7.  All-in on AWS since 2011

  8.  All-in on AWS since 2011 Amazon RDS (Relational Data)

    Amazon Redshift (Data Warehouse)

  9.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse)

  10.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) 7JSUVBM1SJWBUF$MPVE

  11. 7JSUVBM1SJWBUF$MPVE  All-in on AWS since 2011 Amazon S3 (Object

    Storage) Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) Amazon EC2 (Computation)

  12.  ‣ $6%" ‣ DV%//

  13.  ‣ $6%" ‣ DV%// (Snapshot)

  14.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

  15.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  16.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  17. 5FNQMBUF  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 5FNQMBUF KTPO

    QBDLFSCVJME

  18.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  19.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    IUUQTBXTBNB[PODPNBNB[POBJBNJT CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  20.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  21.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  22.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)

  23.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)

  24. ‣ 0OEFNBOE(16XPSLCFODIFT  6UJMJ[F".*UPNVMUJQMFXPSLCFODIFOWJSPONFOUT  1BDLFSNBLFTJUFBTJFSUPVQEBUFBOENPSFTUBCMF  0QFSBUFWJB$IBUCPU  8SBQVQ