How we use GPUs in Cookpad

@Tokyo Machine Learning Kitchen
https://tokyo-ml.github.io/

Transcript

1. )PXXFVTF(16TJO$PPLQBE
   :VJDIJSP4PNFZB!$PPLQBE*OD3%
   

   View Slide

2. ‣ Yuichiro Someya (ayemos)
   ‣ github.com/ayemos
   ‣ Machine Learning Enginner @ Cookpad Inc.
   # 2016(new grads) ~ Current
   

   View Slide

3. View Slide

4. ‣ 0VS(16FOWJSPONFOU
   )PXXFVUJMJ[F"84T(16JOTUBODFT
   )PXXFLFFQPVSTDBMBCJMJUZPGUFBNTJO3%
   
   
   

   View Slide

5. 
   

   View Slide

6. 
   /7*%*"7
   

   View Slide

7. 
   All-in on AWS since 2011
   

   View Slide

8. 
   All-in on AWS since 2011
   Amazon RDS
   (Relational Data)
   Amazon Redshift
   (Data Warehouse)
   

   View Slide

9. 
   All-in on AWS since 2011
   Amazon S3
   (Object Storage)
   Amazon RDS
   (Relational Data)
   Amazon Redshift
   (Data Warehouse)
   

   View Slide

10. 
    All-in on AWS since 2011
    Amazon S3
    (Object Storage)
    Amazon RDS
    (Relational Data)
    Amazon Redshift
    (Data Warehouse)
    7JSUVBM1SJWBUF$MPVE
    
    

    View Slide

11. 7JSUVBM1SJWBUF$MPVE
    
    
    All-in on AWS since 2011
    Amazon S3
    (Object Storage)
    Amazon RDS
    (Relational Data)
    Amazon Redshift
    (Data Warehouse)
    Amazon EC2
    (Computation)
    

    View Slide

12. 
    ‣ $6%"
    ‣ DV%//
    

    View Slide

13. 
    ‣ $6%"
    ‣ DV%//
    (Snapshot)
    

    View Slide

14. 
    ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//
    

    View Slide

15. 
    ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    

    View Slide

16. 
    ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    

    View Slide

17. 5FNQMBUF
    
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    5FNQMBUF
    KTPO
    QBDLFSCVJME
    

    View Slide

18. 
    ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    

    View Slide

19. 
    ‣ $6%"
    ‣ DV%//
    (Snapshot)
    ‣ $6%"
    ‣ DV%//
    IUUQTBXTBNB[PODPNBNB[POBJBNJT
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    

    View Slide

20. 
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    ...
    `ssh`
    ...
    

    View Slide

21. 
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    ...
    `ssh`
    ...
    
    

    View Slide

22. 
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    ...
    `ssh`
    ...
    AWS Lambda
    (Function)
    Stop!
    Idle?
    (Hourly)
    

    View Slide

23. 
    CUDA9
    cuDNN7
    CUDA8
    cuDNN7
    CUDA8
    cuDNN6
    ...
    `ssh`
    ...
    AWS Lambda
    (Function)
    Stop!
    Idle?
    (Hourly)
    

    View Slide

24. ‣ 0OEFNBOE(16XPSLCFODIFT
    6UJMJ[F".*UPNVMUJQMFXPSLCFODIFOWJSPONFOUT
    1BDLFSNBLFTJUFBTJFSUPVQEBUFBOENPSFTUBCMF
    0QFSBUFWJB$IBUCPU
    
    8SBQVQ
    

    View Slide