HashiCorp Products on DeNA AI & Analytics Infrastructure

https://hashicorp.connpass.com/event/98386/

Transcript

1. © DeNA Co., Ltd.
   Sep 11, 2018
   HashiCorp Meetup at DeNA
   Hidenori MATSUKI
   AI System Division

   DeNA Co., Ltd.
   "*෼ੳج൫Ͱ׆༂ʂ
   )BTIJ$PSQ
   1SPEVDUT
   © DeNA Co., Ltd.
   

   View Slide

2. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
   ࣗݾ঺հ
   দ໦ लݑ
   DeNA γεςϜຊ෦ AIγεςϜ෦
   AI&෼ੳج൫Λ୲౰
   [ུྺ]
   ΤϯλʔϓϥΠζ։ൃΛܦݧޙɺΑΓར༻ऀʹۙ
   ͍αʔϏεʹܞΘΔͨΊɺεϚʔτϑΥϯήʔϜ
   ͷόοΫΤϯυ։ൃʹैࣄɻ
   ͦͷޙେن໛෼ࢄج൫ͷߏஙӡ༻ܦݧͱελʔτ
   ΞοϓͰͷ։ൃϚωδϝϯτܦݧΛܦͯDeNAʹ
   ೖࣾɻ
   AI&෼ੳج൫ͷߏஙͱϚωδϝϯτΛߦ͏ɻ
   2
   

   View Slide

3. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
   Agenda
   ࣗݾ঺հ
   DeNAͱAIγεςϜ෦ͷ͝঺հ
   ⁃ AIγεςϜ෦ͷ໾ׂʢAIฤʣ
   ⁃ AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ
   AIΠϯϑϥͷ՝୊
   ⁃ TerraformʹΑΔղܾ
   ⁃ PackerʹΑΔղܾʢҊʣ
   ෼ੳΠϯϑϥͷ՝୊
   ⁃ VagrantʹΑΔղܾ
   3
   

   View Slide

4. © DeNA Co., Ltd.
   DeNAͱAIγεςϜ෦ͷ͝঺հ
   4
   

   View Slide

5. Game
   Automotive
   EC
   Sports
   New! Entertainment
   Social Live
   Health care
   © DeNA Co., Ltd.
   ࣄۀϙʔτϑΥϦΦ
   5
   • ଟछଟ༷ͳࣄۀྖҬͰϏδωεɾαʔϏεల։
   • ύʔτφʔاۀͱڞʹࣾձӨڹͷେ͖ͳαʔϏεΛ૑ग़
   • େن໛ΠϯλʔωοταʔϏεϓϥοτϑΥʔϜͷߏஙɾӡ༻ྗ
   

   View Slide

6. © DeNA Co., Ltd.
   DeNAͰͷσʔλ׆༻
   6
   AI
   Service
   Data
   ࠷৽ݚڀΛϕʔεʹݚڀ։ൃ
   AIΛ׆༻ͨ͠৽ͨͳՁ஋͋Δ
   αʔϏεઃܭɾ࣮૷
   αʔϏεɾσʔλͷαΠΫϧ͔Β
   ੜ·ΕΔڧݻͳϏδωεߏ଄
   

   View Slide

7. © DeNA Co., Ltd.
   AIγεςϜ෦ͷ໾ׂʢAIฤʣ
   7
   DeNA Customers
   Game
   Analyst
   AIγεςϜ෦
   AI&෼ੳج൫
   ITPF CERT
   AIݚڀ։ൃΤϯδχΞ͕༰қʹࣗ༝ʹ։ൃͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ
   Sports
   Analyst
   (other)
   Analyst
   AIݚڀ։ൃ (other)
   

   View Slide

8. © DeNA Co., Ltd.
   AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ
   8
   DeNA Customers
   Game
   Analyst
   AIγεςϜ෦
   AI&෼ੳج൫
   ITPF CERT
   ΞφϦετ͕༰қʹࣗ༝ʹ෼ੳͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ
   Sports
   Analyst
   (other)
   Analyst
   AIݚڀ։ൃ (other)
   

   View Slide

9. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
   Agenda
   ࣗݾ঺հ
   DeNAͱAIγεςϜ෦ͷ͝঺հ
   ⁃ AIγεςϜ෦ͷ໾ׂʢAIฤʣ
   ⁃ AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ
   AIΠϯϑϥͷ՝୊
   ⁃ TerraformʹΑΔղܾ
   ⁃ PackerʹΑΔղܾʢҊʣ
   ෼ੳΠϯϑϥͷ՝୊
   ⁃ VagrantʹΑΔղܾ
   9
   

   View Slide

10. © DeNA Co., Ltd.
    AIΠϯϑϥͷ՝୊
    10
    

    View Slide

11. © DeNA Co., Ltd.
    ՝୊ͱTerraformʹΑΔղܾ
    11
    AWS/GCP্ʹ
    GPUΛ׆༻ͨ͠
    ػցֶशΠϯϑϥΛ
    Infra as CodeͰૉૣ͘ߏஙʂ
    

    View Slide

12. © DeNA Co., Ltd.
    PackerʹΑΔղܾʢҊʣ
    12
    Google
    Container Registry
    Amazon ElasAc
    Container Registry
    AWS͸ECRͰɺGCP͸GCRͰ
    ಉ౳ͷDockerΠϝʔδΛ࢖͍͍ͨ
    h"ps://github.com/mazgi/docker-ml/blob/326189d5be224b52c58ff2000da0f7a14b48e43f/packer.json#L30-L58
    

    View Slide

13. © DeNA Co., Ltd.
    ෼ੳΠϯϑϥͷ՝୊
    13
    

    View Slide

14. © DeNA Co., Ltd.
    ෼ੳΠϯϑϥͷಛ௃
    14
    ෼ੳج൫
    Log
    Gateway
    Hadoop
    Argus
    Dashboard
    Medjed
    +Embulk
    HP VerAca
    Hue
    Jenkins &
    WorkstaAon
    Services
    Analyst
    Log
    DB Snapshot
    Web UI
    Web UI
    & SSH
    Query
    Query
    Google
    BigQuery
    ”ॏྔڃ”ϛυϧ΢ΣΞΛ׆༻ͯ͠
    ҆ఆͨ͠෼ੳ؀ڥΛఏڙ
    

    View Slide

15. ෼ੳج൫ʢDevʣ ෼ੳج൫ʢDevʣ
    © DeNA Co., Ltd.
    VagrantʹΑΔղܾͱ࢒՝୊
    15
    ෼ੳج൫ʢຊ൪ʣ
    Hadoop
    Jenkins &
    WorkstaAon
    ෼ੳج൫ͷݕূ͸େมɺͦ͜ͰVagrantʂɾɾɾͰ΋΍ͬͺΓେม
    

    View Slide

16. © DeNA Co., Ltd.
    ͍͞͝ʹ
    16
    ࠓ೔͸͝དྷ৔͋Γ͕ͱ͏͍͟͝·͢ʂ
    Ұॹʹָ͠Έ·͠ΐ͏̇
    

    View Slide