クックパッドにおけるAWS GPUインスタンスの利用事例 / Powering by AWS GPU Instances in Cookpad Inc

クックパッドにおけるAWS GPUインスタンスの利用事例 / Powering by AWS GPU Instances in Cookpad Inc

7dc8611c26c3ca62c551109c65d04270?s=128

Yuichiro Someya

November 17, 2017
Tweet

Transcript

  1. ΫοΫύουʹ͓͚Δ "84(16Πϯελϯεͷ ར༻ࣄྫ ΫοΫύουגࣜձࣾݚڀ։ൃ෦ છ୩༔Ұ࿠ !"NB[PO&$(16ΠϯελϯεࡇΓ 

  2. ࣗݾ ঺հ HJUIVCDPNBZFNPT UXJUUFSDPNBZFNPT@Z XXXBZFNPTNF  ‣ છ୩༔Ұ࿠<:VJDIJSP4PNFZB> ‣ ౦޻େܭࢉ޻ֶम࢜

    ‣ ΫοΫύουגࣜձࣾ
 ݚڀ։ൃ෦ΤϯδχΞ  ೥৽ଔೖࣾ
  3. ‣ ΫοΫύουͷ࣮ݧ؀ڥʹ͓͚Δ(16ར༻ঢ়گ ‣ 1ΠϯελϯεͷධՁ  "HFOEB

  4. 

  5.  Ϩγϐ਺ ສ඼Ҏ্ ݄࣍ར༻ऀ਺ ໿ ສਓ ೥݄຤࣌఺

  6.  Χࠃʹల։ ݴޠʹରԠ ೥݄຤࣌఺

  7. 7JSUVBM1SJWBUF$MPVE  All-in on AWS since 2011 Amazon S3 Amazon

    RDS Amazon Redshift
  8. 7JSUVBM1SJWBUF$MPVE  All-in on AWS since 2011 Amazon S3 Amazon

    RDS Amazon Redshift Amazon EC2
  9. ྉཧ͖Ζ͘  ৞ΈࠐΈχϡʔϥϧωοτϫʔΫ ʹΑΔྉཧը૾ͷࣗಈೝࣝ εϚʔτϑΥϯͷࣸਅͷ಺ɺ ྉཧࣸਅΛࣗಈతʹऩूه࿥

  10. ྉཧ͖Ζ͘  ৞ΈࠐΈχϡʔϥϧωοτϫʔΫ ʹΑΔྉཧը૾ͷࣗಈೝࣝ εϚʔτϑΥϯͷࣸਅͷ಺ɺ ྉཧࣸਅΛࣗಈతʹऩूه࿥ IUUQTTQFBLFSEFDLDPNBZFNPTNBDIJOFMFBSOJOHPQTBUDPPLQBE

  11. 7JSUVBM1SJWBUF$MPVE  All-in on AWS since 2011 Amazon S3 Amazon

    RDS Amazon Redshift Amazon EC2
  12.  ‣ $6%" ‣ DV%// CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8

    cuDNN6
  13.  ‣ $6%" ‣ DV%// IUUQTBXTBNB[PODPNBNB[POBJBNJT CUDA9 cuDNN7 CUDA8 cuDNN7

    CUDA8 cuDNN6
  14. CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... 

  15. CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... ssh "Create" 

  16. CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ... 

  17. CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ... API

    Gateway Outgoing Webhook {text: "Create instance"} Incoming Webhook "Created! => ssh ayemos-workbench-001" (Lambda Proxy) {text: "Create instance"} 1. Route command 2. Perform operations (on EC2) 3. Send the responce back via webhook 
  18. CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ... API

    Gateway Outgoing Webhook {text: "Create instance"} Incoming Webhook "Created! => ssh ayemos-workbench-001" (Lambda Proxy) {text: "Create instance"} 1. Route command 2. Perform operations (on EC2) 3. Send the responce back via webhook 
  19. ‣ ΫοΫύουͷ࣮ݧ؀ڥʹ͓͚Δ(16ར༻ঢ়گ ‣ 1ΠϯελϯεͷධՁ  "HFOEB

  20. ‣ ΫοΫύουͷ࣮ݧ؀ڥʹ͓͚Δ(16ར༻ঢ়گ ‣ 1ΠϯελϯεͷධՁ  "HFOEB 4QPJMFS ʮ1͸࠷ߴʯ

  21. ‣ ࠷ߴ 

  22. ‣ ΧςΰϦ߹ܭສຕͷը૾Λ࢖ͬͨ$MBTTJpFSͷֶश  (PPH-F/FUΛ࢓༷  ීஈΫοΫύουͰߦΘΕ͍ͯΔΑ͏ͳ࣮ݧʹ͍ۙ΋ͷ  ‣ FQPDIͷֶशʹֻ͔Δ࣌ؒΛ11Ͱൺֱ 

    ϕϯνϚʔΫ
  23.  1 7  $6%"DV%// 1 ,  $6%"DV%// #BUDI4J[F

    NT N  NT NT  NT NT  NT 00.
  24. ‣ ࣮ݧͷ࣮ߦ࣌ؒ͸ߴʑ਺࣌ؒͰ͋Δ͜ͱ͕ଟ͍
 .VMUJ(16ͷར༻ɺ෼ࢄʹର͢Δχʔζ͸ ݱঢ় ͋·Γߴ͘ͳ͍ ‣ ֶशεΫϦϓτͷ.VMUJ(16ରԠ͸ͦΕࣗମ࣮૷ίετ͕͋Δ ‣ ͳͷͰɺϘʔυ୯ମ͕ૣ͘ͳΔͷ͸ͱͯ΋خ͍͠ 

    ߟ࡯
  25. ‣ 1ͷ͍͍ͱ͜Ζ  &$Ͱ͋Δ  ຕຕ͕଎͍  ·ͱΊ

  26. 

  27.