Upgrade to Pro — share decks privately, control downloads, hide ads and more …

How we use GPUs in Cookpad

How we use GPUs in Cookpad

@Tokyo Machine Learning Kitchen
https://tokyo-ml.github.io/

Yuichiro Someya

November 06, 2017
Tweet

More Decks by Yuichiro Someya

Other Decks in Programming

Transcript

  1. )PXXFVTF(16TJO$PPLQBE
    :VJDIJSP4PNFZB!$PPLQBE*OD3%

    View Slide

  2. ‣ Yuichiro Someya (ayemos)
    ‣ github.com/ayemos
    ‣ Machine Learning Enginner @ Cookpad Inc.
    # 2016(new grads) ~ Current

    View Slide

  3. View Slide

  4. ‣ 0VS(16FOWJSPONFOU
    )PXXFVUJMJ[F"84T(16JOTUBODFT
    )PXXFLFFQPVSTDBMBCJMJUZPGUFBNTJO3%


    View Slide


  5. View Slide


  6. /7*%*"7

    View Slide


  7. All-in on AWS since 2011

    View Slide


  8. All-in on AWS since 2011
    Amazon RDS
    (Relational Data)
    Amazon Redshift
    (Data Warehouse)

    View Slide


  9. All-in on AWS since 2011
    Amazon S3
    (Object Storage)
    Amazon RDS
    (Relational Data)
    Amazon Redshift
    (Data Warehouse)

    View Slide


  10. All-in on AWS since 2011
    Amazon S3
    (Object Storage)
    Amazon RDS
    (Relational Data)
    Amazon Redshift
    (Data Warehouse)
    7JSUVBM1SJWBUF$MPVE

    View Slide

  11. 7JSUVBM1SJWBUF$MPVE


    All-in on AWS since 2011
    Amazon S3
    (Object Storage)
    Amazon RDS
    (Relational Data)
    Amazon Redshift
    (Data Warehouse)
    Amazon EC2
    (Computation)

    View Slide


  12. ‣ $6%"
    ‣ DV%//

    View Slide


  13. ‣ $6%"
    ‣ DV%//
    (Snapshot)

    View Slide


  14. ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//

    View Slide


  15. ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6

    View Slide


  16. ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6

    View Slide

  17. 5FNQMBUF

    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    5FNQMBUF
    KTPO
    QBDLFSCVJME

    View Slide


  18. ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6

    View Slide


  19. ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//
    IUUQTBXTBNB[PODPNBNB[POBJBNJT
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6

    View Slide


  20. CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    ...
    `ssh`
    ...

    View Slide


  21. CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    ...
    `ssh`
    ...

    View Slide


  22. CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    ...
    `ssh`
    ...
    AWS Lambda
    (Function)
    Stop!
    Idle?
    (Hourly)

    View Slide


  23. CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    ...
    `ssh`
    ...
    AWS Lambda
    (Function)
    Stop!
    Idle?
    (Hourly)

    View Slide

  24. ‣ 0OEFNBOE(16XPSLCFODIFT
    6UJMJ[F".*UPNVMUJQMFXPSLCFODIFOWJSPONFOUT
    1BDLFSNBLFTJUFBTJFSUPVQEBUFBOENPSFTUBCMF
    0QFSBUFWJB$IBUCPU

    8SBQVQ

    View Slide