Upgrade to Pro — share decks privately, control downloads, hide ads and more …

HashiCorp Products on DeNA AI & Analytics Infrastructure

HashiCorp Products on DeNA AI & Analytics Infrastructure

Hidenori Matsuki

September 11, 2018
Tweet

More Decks by Hidenori Matsuki

Other Decks in Technology

Transcript

  1. © DeNA Co., Ltd. Sep 11, 2018 HashiCorp Meetup at

    DeNA Hidenori MATSUKI AI System Division
 DeNA Co., Ltd. "*෼ੳج൫Ͱ׆༂ʂ )BTIJ$PSQ 1SPEVDUT © DeNA Co., Ltd.
  2. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd. ࣗݾ঺հ দ໦ लݑ DeNA γεςϜຊ෦ AIγεςϜ෦

    AI&෼ੳج൫Λ୲౰ [ུྺ] ΤϯλʔϓϥΠζ։ൃΛܦݧޙɺΑΓར༻ऀʹۙ ͍αʔϏεʹܞΘΔͨΊɺεϚʔτϑΥϯήʔϜ ͷόοΫΤϯυ։ൃʹैࣄɻ ͦͷޙେن໛෼ࢄج൫ͷߏஙӡ༻ܦݧͱελʔτ ΞοϓͰͷ։ൃϚωδϝϯτܦݧΛܦͯDeNAʹ ೖࣾɻ AI&෼ੳج൫ͷߏஙͱϚωδϝϯτΛߦ͏ɻ 2
  3. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd. Agenda ࣗݾ঺հ DeNAͱAIγεςϜ෦ͷ͝঺հ ⁃ AIγεςϜ෦ͷ໾ׂʢAIฤʣ ⁃

    AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ AIΠϯϑϥͷ՝୊ ⁃ TerraformʹΑΔղܾ ⁃ PackerʹΑΔղܾʢҊʣ ෼ੳΠϯϑϥͷ՝୊ ⁃ VagrantʹΑΔղܾ 3
  4. Game Automotive EC Sports New! Entertainment Social Live Health care

    © DeNA Co., Ltd. ࣄۀϙʔτϑΥϦΦ 5 • ଟछଟ༷ͳࣄۀྖҬͰϏδωεɾαʔϏεల։ • ύʔτφʔاۀͱڞʹࣾձӨڹͷେ͖ͳαʔϏεΛ૑ग़ • େن໛ΠϯλʔωοταʔϏεϓϥοτϑΥʔϜͷߏஙɾӡ༻ྗ
  5. © DeNA Co., Ltd. DeNAͰͷσʔλ׆༻ 6 AI Service Data ࠷৽ݚڀΛϕʔεʹݚڀ։ൃ

    AIΛ׆༻ͨ͠৽ͨͳՁ஋͋Δ αʔϏεઃܭɾ࣮૷ αʔϏεɾσʔλͷαΠΫϧ͔Β ੜ·ΕΔڧݻͳϏδωεߏ଄
  6. © DeNA Co., Ltd. AIγεςϜ෦ͷ໾ׂʢAIฤʣ 7 DeNA Customers Game Analyst

    AIγεςϜ෦ AI&෼ੳج൫ ITPF CERT AIݚڀ։ൃΤϯδχΞ͕༰қʹࣗ༝ʹ։ൃͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ Sports Analyst (other) Analyst AIݚڀ։ൃ (other)
  7. © DeNA Co., Ltd. AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ 8 DeNA Customers Game Analyst

    AIγεςϜ෦ AI&෼ੳج൫ ITPF CERT ΞφϦετ͕༰қʹࣗ༝ʹ෼ੳͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ Sports Analyst (other) Analyst AIݚڀ։ൃ (other)
  8. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd. Agenda ࣗݾ঺հ DeNAͱAIγεςϜ෦ͷ͝঺հ ⁃ AIγεςϜ෦ͷ໾ׂʢAIฤʣ ⁃

    AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ AIΠϯϑϥͷ՝୊ ⁃ TerraformʹΑΔղܾ ⁃ PackerʹΑΔղܾʢҊʣ ෼ੳΠϯϑϥͷ՝୊ ⁃ VagrantʹΑΔղܾ 9
  9. © DeNA Co., Ltd. PackerʹΑΔղܾʢҊʣ 12 Google Container Registry Amazon

    ElasAc Container Registry AWS͸ECRͰɺGCP͸GCRͰ ಉ౳ͷDockerΠϝʔδΛ࢖͍͍ͨ h"ps://github.com/mazgi/docker-ml/blob/326189d5be224b52c58ff2000da0f7a14b48e43f/packer.json#L30-L58
  10. © DeNA Co., Ltd. ෼ੳΠϯϑϥͷಛ௃ 14 ෼ੳج൫ Log Gateway Hadoop

    Argus Dashboard Medjed +Embulk HP VerAca Hue Jenkins & WorkstaAon Services Analyst Log DB Snapshot Web UI Web UI & SSH Query Query Google BigQuery ”ॏྔڃ”ϛυϧ΢ΣΞΛ׆༻ͯ͠ ҆ఆͨ͠෼ੳ؀ڥΛఏڙ
  11. ෼ੳج൫ʢDevʣ ෼ੳج൫ʢDevʣ © DeNA Co., Ltd. VagrantʹΑΔղܾͱ࢒՝୊ 15 ෼ੳج൫ʢຊ൪ʣ Hadoop

    Jenkins & WorkstaAon ෼ੳج൫ͷݕূ͸େมɺͦ͜ͰVagrantʂɾɾɾͰ΋΍ͬͺΓେม