HashiCorp Products on DeNA AI & Analytics Infrastructure

Transcript

1. © DeNA Co., Ltd. Sep 11, 2018 HashiCorp Meetup at

   DeNA Hidenori MATSUKI AI System Division
 DeNA Co., Ltd. "*෼ੳج൫Ͱ׆༂ʂ
   )BTIJ$PSQ
   1SPEVDUT © DeNA Co., Ltd.

2. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd. ࣗݾ঺հ দ໦ लݑ DeNA γεςϜຊ෦ AIγεςϜ෦

   AI&෼ੳج൫Λ୲౰ [ུྺ] ΤϯλʔϓϥΠζ։ൃΛܦݧޙɺΑΓར༻ऀʹۙ ͍αʔϏεʹܞΘΔͨΊɺεϚʔτϑΥϯήʔϜ ͷόοΫΤϯυ։ൃʹैࣄɻ ͦͷޙେن໛෼ࢄج൫ͷߏஙӡ༻ܦݧͱελʔτ ΞοϓͰͷ։ൃϚωδϝϯτܦݧΛܦͯDeNAʹ ೖࣾɻ AI&෼ੳج൫ͷߏஙͱϚωδϝϯτΛߦ͏ɻ 2

3. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd. Agenda ࣗݾ঺հ DeNAͱAIγεςϜ෦ͷ͝঺հ ⁃ AIγεςϜ෦ͷ໾ׂʢAIฤʣ ⁃

   AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ AIΠϯϑϥͷ՝୊ ⁃ TerraformʹΑΔղܾ ⁃ PackerʹΑΔղܾʢҊʣ ෼ੳΠϯϑϥͷ՝୊ ⁃ VagrantʹΑΔղܾ 3

4. © DeNA Co., Ltd. DeNAͱAIγεςϜ෦ͷ͝঺հ 4

5. Game Automotive EC Sports New! Entertainment Social Live Health care

   © DeNA Co., Ltd. ࣄۀϙʔτϑΥϦΦ 5 • ଟछଟ༷ͳࣄۀྖҬͰϏδωεɾαʔϏεల։ • ύʔτφʔاۀͱڞʹࣾձӨڹͷେ͖ͳαʔϏεΛ૑ग़ • େن໛ΠϯλʔωοταʔϏεϓϥοτϑΥʔϜͷߏஙɾӡ༻ྗ

6. © DeNA Co., Ltd. DeNAͰͷσʔλ׆༻ 6 AI Service Data ࠷৽ݚڀΛϕʔεʹݚڀ։ൃ

   AIΛ׆༻ͨ͠৽ͨͳՁ஋͋Δ αʔϏεઃܭɾ࣮૷ αʔϏεɾσʔλͷαΠΫϧ͔Β ੜ·ΕΔڧݻͳϏδωεߏ଄

7. © DeNA Co., Ltd. AIγεςϜ෦ͷ໾ׂʢAIฤʣ 7 DeNA Customers Game Analyst

   AIγεςϜ෦ AI&෼ੳج൫ ITPF CERT AIݚڀ։ൃΤϯδχΞ͕༰қʹࣗ༝ʹ։ൃͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ Sports Analyst (other) Analyst AIݚڀ։ൃ (other)

8. © DeNA Co., Ltd. AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ 8 DeNA Customers Game Analyst

   AIγεςϜ෦ AI&෼ੳج൫ ITPF CERT ΞφϦετ͕༰қʹࣗ༝ʹ෼ੳͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ Sports Analyst (other) Analyst AIݚڀ։ൃ (other)

9. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd. Agenda ࣗݾ঺հ DeNAͱAIγεςϜ෦ͷ͝঺հ ⁃ AIγεςϜ෦ͷ໾ׂʢAIฤʣ ⁃

   AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ AIΠϯϑϥͷ՝୊ ⁃ TerraformʹΑΔղܾ ⁃ PackerʹΑΔղܾʢҊʣ ෼ੳΠϯϑϥͷ՝୊ ⁃ VagrantʹΑΔղܾ 9

10. © DeNA Co., Ltd. AIΠϯϑϥͷ՝୊ 10

11. © DeNA Co., Ltd. ՝୊ͱTerraformʹΑΔղܾ 11 AWS/GCP্ʹ GPUΛ׆༻ͨ͠ ػցֶशΠϯϑϥΛ Infra

    as CodeͰૉૣ͘ߏஙʂ

12. © DeNA Co., Ltd. PackerʹΑΔղܾʢҊʣ 12 Google Container Registry Amazon

    ElasAc Container Registry AWS͸ECRͰɺGCP͸GCRͰ ಉ౳ͷDockerΠϝʔδΛ࢖͍͍ͨ h"ps://github.com/mazgi/docker-ml/blob/326189d5be224b52c58ff2000da0f7a14b48e43f/packer.json#L30-L58

13. © DeNA Co., Ltd. ෼ੳΠϯϑϥͷ՝୊ 13

14. © DeNA Co., Ltd. ෼ੳΠϯϑϥͷಛ௃ 14 ෼ੳج൫ Log Gateway Hadoop

    Argus Dashboard Medjed +Embulk HP VerAca Hue Jenkins & WorkstaAon Services Analyst Log DB Snapshot Web UI Web UI & SSH Query Query Google BigQuery ”ॏྔڃ”ϛυϧ΢ΣΞΛ׆༻ͯ͠ ҆ఆͨ͠෼ੳ؀ڥΛఏڙ

15. ෼ੳج൫ʢDevʣ ෼ੳج൫ʢDevʣ © DeNA Co., Ltd. VagrantʹΑΔղܾͱ࢒՝୊ 15 ෼ੳج൫ʢຊ൪ʣ Hadoop

    Jenkins & WorkstaAon ෼ੳج൫ͷݕূ͸େมɺͦ͜ͰVagrantʂɾɾɾͰ΋΍ͬͺΓେม

16. © DeNA Co., Ltd. ͍͞͝ʹ 16 ࠓ೔͸͝དྷ৔͋Γ͕ͱ͏͍͟͝·͢ʂ Ұॹʹָ͠Έ·͠ΐ͏̇