クックパッドの機械学習を支える基盤のつくりかた ~番外編~ / Machine Learning ops at Cookpad

ΫοΫύουͷػցֶशΛ  ࢧ͑Δج൫ͷͭ͘Γ͔ͨ d൪֎ฤd છ୩༔Ұ࿠!ΫοΫύουגࣜձࣾ

ࣗݾ঺հ ‣ www.ayemos.me ‣ github.com/ayemos ‣ twitter.com/ayemos_y ‣ છ୩༔Ұ࿠<:VJDIJSP4PNFZB>
೥݄౦ژ޻ۀେֶେֶӃܭࢉ޻ֶઐ߈म࢜ ೥݄ʙݱࡏΫοΫύουגࣜձࣾݚڀ։ൃ෦

ΫοΫύου ݚڀ։ൃ෦ͷྺ࢙

೥݄ݚڀ։ൃνʔϜ ඇެࣜ ൃ଍ ೥݄ݚڀ։ൃνʔϜ ެࣜ ൃ଍ ೥݄ݚڀ։ൃࣨൃ଍ ೥݄ݚڀ։ൃ෦ൃ଍

೥݄ ྉཧ͖Ζ͘ެ։

ྉཧ͖Ζ͘ ‣ εϚʔτϑΥϯͷࣸਅͷ಺ɺྉཧΛࣗಈతʹ ऩूه࿥ $//ʹΑΔྉཧը૾ೝࣝ

೥݄ݚڀ։ൃνʔϜ ඇެࣜ ൃ଍ ೥݄ݚڀ։ൃνʔϜ ެࣜ ൃ଍ ೥݄ݚڀ։ൃࣨൃ଍ ೥݄ݚڀ։ൃ෦ൃ଍ ೥݄ྉཧ͖Ζ͘ެ։

೥݄ݚڀ։ൃνʔϜ ඇެࣜ ൃ଍ ೥݄ݚڀ։ൃνʔϜ ެࣜ ൃ଍ ೥݄ݚڀ։ൃࣨൃ଍ ೥݄ݚڀ։ൃ෦ൃ଍ ೥݄ྉཧ͖Ζ͘ެ։
೥݄ਓ޻஌ೳֶձ IUUQTLBJHJPSHKTBJXFCQSPHSBNQBQFSIUNM

ݚڀ։ൃج൫

ݚڀ։ൃͷ؀ڥ΍ӡ༻ʹؔΘΔ ͋ΒΏΔٕज़త՝୊ Λղܾ

՝୊Ћܭࢉػ؀ڥߏஙίετ

‣ ݚڀ։ൃ෦ʹઐ೚ͷΠϯϑϥ୲౰͕͍ͳ͍ ೥݄౰࣌ͷঢ়گ ‣ (16؀ڥͷߏங͸೉͍͠ OWJEJBESJWFS
DVEB DVEOO %//ϑϨʔϜϫʔΫ ʜ ‣ (16؀ڥ͕ඞཁʹͳ͔ͬͯΒ࢖͍࢝ΊΔ·Ͱिؒ

IUUQTXXXQBDLFSJP

{ "builders": [{ "type": "amazon-ebs", "region": "ap-northeast-1", "ami_regions": ["us-east-1",
"ap-northeast-1"], "source_ami": "ami-d85e7fbf", "instance_type": "g2.2xlarge", "ssh_username": "ubuntu", "ssh_timeout": "10m", }], "provisioners": [ { "type": "chef-solo", "cookbook_paths": ["cookbooks", "site-cookbooks"], "run_list": [ "recipe[apt]", "nvidia-driver", "docker-install", "cuda-apt-source", "cuda", "cudnn", "awscli" ] } ] } package 'nvidia-361' do end execute "install nvidia driver" do command "curl -sLo /tmp/nvidia-driver #{node["nvidia_driver"]["source"]} "test #{node["nvidia_driver"]["sha256sum"]} '=' \"$(sha256sum /tmp/nvid "chmod +x /tmp/nvidia-driver && " \ "/tmp/nvidia-driver -asZN && " \ "rm /tmp/nvidia-driver" not_if "test -d /proc/driver/nvidia" end

(16؀ڥߏஙͷ಺੡ԽʗࣗಈԽ

(16؀ڥߏஙͷ಺੡ԽʗࣗಈԽ ৽͍͠(16؀ڥΛ෼Ͱߏங

՝୊Ќܭࢉػίετ

IUUQUIFRVPUFTJOXQDPOUFOUVQMPBETLBSMNBSYRVPUFTKQH

՝୊Ѝܭࢉػ؅ཧίετ

‣ མͪͨΠϯελϯεΛຖேཱͯΔͷ͕໘౗ ‣ 8FCίϯιʔϧ໘౗ɺ$-*͸೉͍͠

‣ ![PPFZ ‣ $IBU#PU HJUIVCDPNMJUBJPMJUB੡

‣ མͪͨΠϯελϯεΛຖேཱͯΔͷ͕໘౗ ‣ 8FCίϯιʔϧ໘౗ɺ$-*͸೉͍͠

σʔλج൫

‣ %8) "NB[PO3FETIJGU

"QQ@: "QQ@9 %8)

IUUQTXXXTMJEFTIBSFOFUNJOFSPBPLJDPPLQBEUFDIDPOGEXI

՝୊σʔλ࠶ݱੑ

‣ %8)ʹग़དྷͳ͍͜ͱ ը૾ͳͲɺҰ෦σʔλιʔεͱͯ͠ѻ͑ͳ͍΋ͷ͕͋Δ

‣ %8)ʹग़དྷͳ͍͜ͱ ը૾ͳͲɺҰ෦σʔλιʔεͱͯ͠ѻ͑ͳ͍΋ͷ͕͋Δ ‣ ࣮ݧʹ͓͚Δσʔλͷ࠶ݱੑ͕௿͘ͳΓ͕ͪ ࠶ݱ͕໘౗PS࠶ݱ͕೉͍͠
1ZUIPO͔Β֤छσʔλιʔεΛ৮Δํ๏͕ෳࡶ

IUUQHJUIVCDPNBZFNPTBLBHJ

‣ σʔληοτΛந৅Խͯ͠ɺ ྫ͑͹ɺ  ʮσʔληοτͱ͸GPSจͰճͨ͠ΓϩʔΧϧ'4ʹ  อଘͨ͠Γग़དྷΔଘࡏʯ ‣ ֤छσʔλιʔε΁ͷΞΫηεΛ؆୯ʹ͢Δ
.Z42- 4 3FE4IJGU 4QSFBE4IFFU -PDBM'4 ʜ

‣ %POF ՝୊Ћܭࢉػ؀ڥߏஙίετ ՝୊Ќܭࢉػίετ ՝୊Ѝܭࢉػ؅ཧίετ ‣
%PJOH ՝୊σʔλ࠶ݱੑ

クックパッドの機械学習を支える基盤のつくりかた ~番外編~ / Machine Learning ops at Cookpad

クックパッドの機械学習を支える基盤のつくりかた ~番外編~ / Machine Learning ops at Cookpad

More Decks by Yuichiro Someya

Other Decks in Programming

Featured

Transcript