Upgrade to Pro — share decks privately, control downloads, hide ads and more …

クックパッドの機械学習を支える基盤のつくりかた ~番外編~ / Machine Learning ops at Cookpad

クックパッドの機械学習を支える基盤のつくりかた ~番外編~ / Machine Learning ops at Cookpad

第12回 Machine Learning 15minutes! にて https://machine-learning15minutes.connpass.com/event/52835/

7dc8611c26c3ca62c551109c65d04270?s=128

Yuichiro Someya

May 30, 2017
Tweet

Transcript

  1. ΫοΫύουͷػցֶशΛ
 ࢧ͑Δج൫ͷͭ͘Γ͔ͨ d൪֎ฤd છ୩༔Ұ࿠!ΫοΫύουגࣜձࣾ

  2.  ࣗݾ঺հ ‣ www.ayemos.me ‣ github.com/ayemos ‣ twitter.com/ayemos_y ‣ છ୩༔Ұ࿠<:VJDIJSP4PNFZB>

     ೥݄౦ژ޻ۀେֶେֶӃܭࢉ޻ֶઐ߈म࢜  ೥݄ʙݱࡏΫοΫύουגࣜձࣾݚڀ։ൃ෦
  3.  

  4. ΫοΫύου ݚڀ։ൃ෦ͷྺ࢙

  5.  ೥݄ݚڀ։ൃνʔϜ ඇެࣜ ൃ଍ ೥݄ݚڀ։ൃνʔϜ ެࣜ ൃ଍ ೥݄ݚڀ։ൃࣨൃ଍ ೥݄ݚڀ։ൃ෦ൃ଍ 

  6. ೥݄ ྉཧ͖Ζ͘ެ։

  7.  ྉཧ͖Ζ͘ ‣ εϚʔτϑΥϯͷࣸਅͷ಺ɺྉཧΛࣗಈతʹ ऩूه࿥  $//ʹΑΔྉཧը૾ೝࣝ 

  8.  ೥݄ݚڀ։ൃνʔϜ ඇެࣜ ൃ଍ ೥݄ݚڀ։ൃνʔϜ ެࣜ ൃ଍ ೥݄ݚڀ։ൃࣨൃ଍ ೥݄ݚڀ։ൃ෦ൃ଍ ೥݄ྉཧ͖Ζ͘ެ։

    
  9.  ೥݄ݚڀ։ൃνʔϜ ඇެࣜ ൃ଍ ೥݄ݚڀ։ൃνʔϜ ެࣜ ൃ଍ ೥݄ݚڀ։ൃࣨൃ଍ ೥݄ݚڀ։ൃ෦ൃ଍ ೥݄ྉཧ͖Ζ͘ެ։

    ೥݄ਓ޻஌ೳֶձ    IUUQTLBJHJPSHKTBJXFCQSPHSBNQBQFSIUNM
  10. ݚڀ։ൃج൫

  11. ݚڀ։ൃͷ؀ڥ΍ӡ༻ʹؔΘΔ ͋ΒΏΔٕज़త՝୊ Λղܾ

  12. ՝୊Ћܭࢉػ؀ڥߏஙίετ

  13.  ‣ ݚڀ։ൃ෦ʹઐ೚ͷΠϯϑϥ୲౰͕͍ͳ͍  ೥݄౰࣌ͷঢ়گ  ‣ (16؀ڥͷߏங͸೉͍͠  OWJEJBESJWFS

    DVEB DVEOO %//ϑϨʔϜϫʔΫ ʜ ‣ (16؀ڥ͕ඞཁʹͳ͔ͬͯΒ࢖͍࢝ΊΔ·Ͱिؒ 
  14.   IUUQTXXXQBDLFSJP

  15.  { "builders": [{ "type": "amazon-ebs", "region": "ap-northeast-1", "ami_regions": ["us-east-1",

    "ap-northeast-1"], "source_ami": "ami-d85e7fbf", "instance_type": "g2.2xlarge", "ssh_username": "ubuntu", "ssh_timeout": "10m", }], "provisioners": [ { "type": "chef-solo", "cookbook_paths": ["cookbooks", "site-cookbooks"], "run_list": [ "recipe[apt]", "nvidia-driver", "docker-install", "cuda-apt-source", "cuda", "cudnn", "awscli" ] } ] }  package 'nvidia-361' do end execute "install nvidia driver" do command "curl -sLo /tmp/nvidia-driver #{node["nvidia_driver"]["source"]} "test #{node["nvidia_driver"]["sha256sum"]} '=' \"$(sha256sum /tmp/nvid "chmod +x /tmp/nvidia-driver && " \ "/tmp/nvidia-driver -asZN && " \ "rm /tmp/nvidia-driver" not_if "test -d /proc/driver/nvidia" end
  16.  

  17.  

  18. (16؀ڥߏஙͷ಺੡ԽʗࣗಈԽ

  19. (16؀ڥߏஙͷ಺੡ԽʗࣗಈԽ ৽͍͠(16؀ڥΛ෼Ͱߏங

  20. ՝୊Ќܭࢉػίετ

  21.  

  22.  

  23.  

  24.  

  25.   IUUQUIFRVPUFTJOXQDPOUFOUVQMPBETLBSMNBSYRVPUFTKQH

  26.   IUUQUIFRVPUFTJOXQDPOUFOUVQMPBETLBSMNBSYRVPUFTKQH

  27. ՝୊Ѝܭࢉػ؅ཧίετ

  28.  ‣ མͪͨΠϯελϯεΛຖேཱͯΔͷ͕໘౗ ‣ 8FCίϯιʔϧ໘౗ɺ$-*͸೉͍͠ 

  29.  ‣ ![PPFZ ‣ $IBU#PU  HJUIVCDPNMJUBJPMJUB੡

  30.   ‣ ![PPFZ ‣ $IBU#PU  HJUIVCDPNMJUBJPMJUB੡

  31.  ‣ མͪͨΠϯελϯεΛຖேཱͯΔͷ͕໘౗ ‣ 8FCίϯιʔϧ໘౗ɺ$-*͸೉͍͠ 

  32. σʔλج൫

  33.  ‣ %8) "NB[PO3FETIJGU 

  34.  "QQ@:  "QQ@9 %8)

  35.   IUUQTXXXTMJEFTIBSFOFUNJOFSPBPLJDPPLQBEUFDIDPOGEXI

  36. ՝୊σʔλ࠶ݱੑ

  37.   ‣ %8)ʹग़དྷͳ͍͜ͱ  ը૾ͳͲɺҰ෦σʔλιʔεͱͯ͠ѻ͑ͳ͍΋ͷ͕͋Δ

  38.  

  39.  ‣ %8)ʹग़དྷͳ͍͜ͱ  ը૾ͳͲɺҰ෦σʔλιʔεͱͯ͠ѻ͑ͳ͍΋ͷ͕͋Δ ‣ ࣮ݧʹ͓͚Δσʔλͷ࠶ݱੑ͕௿͘ͳΓ͕ͪ  ࠶ݱ͕໘౗PS࠶ݱ͕೉͍͠ 

    1ZUIPO͔Β֤छσʔλιʔεΛ৮Δํ๏͕ෳࡶ 
  40.   IUUQHJUIVCDPNBZFNPTBLBHJ

  41.  ‣ σʔληοτΛந৅Խͯ͠ɺ  ྫ͑͹ɺ
 ʮσʔληοτͱ͸GPSจͰճͨ͠ΓϩʔΧϧ'4ʹ
 อଘͨ͠Γग़དྷΔଘࡏʯ ‣ ֤छσʔλιʔε΁ͷΞΫηεΛ؆୯ʹ͢Δ 

    .Z42- 4 3FE4IJGU 4QSFBE4IFFU -PDBM'4 ʜ 
  42.  

  43.  ‣ %POF  ՝୊Ћܭࢉػ؀ڥߏஙίετ  ՝୊Ќܭࢉػίετ  ՝୊Ѝܭࢉػ؅ཧίετ ‣

    %PJOH  ՝୊σʔλ࠶ݱੑ