Upgrade to Pro — share decks privately, control downloads, hide ads and more …

How we use GPUs in Cookpad

How we use GPUs in Cookpad

@Tokyo Machine Learning Kitchen
https://tokyo-ml.github.io/

7dc8611c26c3ca62c551109c65d04270?s=128

Yuichiro Someya

November 06, 2017
Tweet

Transcript

  1. )PXXFVTF(16TJO$PPLQBE :VJDIJSP4PNFZB!$PPLQBE*OD3%

  2. ‣ Yuichiro Someya (ayemos) ‣ github.com/ayemos ‣ Machine Learning Enginner

    @ Cookpad Inc. # 2016(new grads) ~ Current
  3. None
  4. ‣ 0VS(16FOWJSPONFOU  )PXXFVUJMJ[F"84T(16JOTUBODFT  )PXXFLFFQPVSTDBMBCJMJUZPGUFBNTJO3% 

  5. 

  6.  /7*%*"7

  7.  All-in on AWS since 2011

  8.  All-in on AWS since 2011 Amazon RDS (Relational Data)

    Amazon Redshift (Data Warehouse)
  9.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse)
  10.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) 7JSUVBM1SJWBUF$MPVE
  11. 7JSUVBM1SJWBUF$MPVE  All-in on AWS since 2011 Amazon S3 (Object

    Storage) Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) Amazon EC2 (Computation)
  12.  ‣ $6%" ‣ DV%//

  13.  ‣ $6%" ‣ DV%// (Snapshot)

  14.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

  15.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6
  16.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6
  17. 5FNQMBUF  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 5FNQMBUF KTPO

    QBDLFSCVJME
  18.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6
  19.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    IUUQTBXTBNB[PODPNBNB[POBJBNJT CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6
  20.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  21.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  22.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)
  23.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)
  24. ‣ 0OEFNBOE(16XPSLCFODIFT  6UJMJ[F".*UPNVMUJQMFXPSLCFODIFOWJSPONFOUT  1BDLFSNBLFTJUFBTJFSUPVQEBUFBOENPSFTUBCMF  0QFSBUFWJB$IBUCPU  8SBQVQ