How we use GPUs in Cookpad

@Tokyo Machine Learning Kitchen
https://tokyo-ml.github.io/

Transcript

1. )PX
   XF
   VTF
   (16T
   JO
   $PPLQBE :VJDIJSP
   4PNFZB
   !
   $PPLQBE
   *OD
   3%
2. ‣ Yuichiro Someya (ayemos) ‣ github.com/ayemos ‣ Machine Learning Enginner @ Cookpad Inc. # 2016(new grads) ~ Current
4. ‣ 0VS
   (16
   FOWJSPONFOU
    )PX
   XF
   VUJMJ[F
   "84T
   (16
   JOTUBODFT
    )PX
   XF
   LFFQ
   PVS
   TDBMBCJMJUZ
   PG
   UFBNT
   JO
   3% 
5. 
6.  /7*%*"
   7
7.  All-in on AWS since 2011
8.  All-in on AWS since 2011 Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse)
9.  All-in on AWS since 2011 Amazon S3 (Object Storage) Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse)
10.  All-in on AWS since 2011 Amazon S3 (Object Storage) Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) 7JSUVBM
    1SJWBUF
    $MPVE
11. 7JSUVBM
    1SJWBUF
    $MPVE  All-in on AWS since 2011 Amazon S3 (Object Storage) Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) Amazon EC2 (Computation)
12.  ‣ $6%"
    ‣ DV%//
13.  ‣ $6%"
    ‣ DV%// (Snapshot)
14.  ‣ $6%"
    ‣ DV%// (Snapshot) ‣ $6%"
    ‣ DV%//
15.  ‣ $6%"
    ‣ DV%// (Snapshot) ‣ $6%"
    ‣ DV%// CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6
16.  ‣ $6%"
    ‣ DV%// (Snapshot) ‣ $6%"
    ‣ DV%// CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6
17. 5FNQMBUF  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 5FNQMBUF KTPO 
    QBDLFS
    CVJME
18.  ‣ $6%"
    ‣ DV%// (Snapshot) ‣ $6%"
    ‣ DV%// CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6
19.  ‣ $6%"
    ‣ DV%// (Snapshot) ‣ $6%"
    ‣ DV%// IUUQTBXTBNB[PODPNBNB[POBJBNJT CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6
20.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...
21.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...
22.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ... AWS Lambda (Function) Stop! Idle? (Hourly)
23.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ... AWS Lambda (Function) Stop! Idle? (Hourly)
24. ‣ 0OEFNBOE
    (16
    XPSLCFODIFT
     6UJMJ[F
    ".*
    UP
    NVMUJQMF
    XPSLCFODI
    FOWJSPONFOUT
     1BDLFS
    NBLFT
    JU
    FBTJFS
    UP
    VQEBUF
    BOE
    NPSF
    TUBCMF
     0QFSBUF
    WJB
    $IBU
    CPU  8SBQ
    VQ