$30 off During Our Annual Pro Sale. View Details »

HashiCorp Products on DeNA AI & Analytics Infrastructure

HashiCorp Products on DeNA AI & Analytics Infrastructure

Hidenori Matsuki

September 11, 2018
Tweet

More Decks by Hidenori Matsuki

Other Decks in Technology

Transcript

  1. © DeNA Co., Ltd.
    Sep 11, 2018
    HashiCorp Meetup at DeNA
    Hidenori MATSUKI
    AI System Division

    DeNA Co., Ltd.
    "*෼ੳج൫Ͱ׆༂ʂ
    )BTIJ$PSQ
    1SPEVDUT
    © DeNA Co., Ltd.

    View Slide

  2. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ࣗݾ঺հ
    দ໦ लݑ
    DeNA γεςϜຊ෦ AIγεςϜ෦
    AI&෼ੳج൫Λ୲౰
    [ུྺ]
    ΤϯλʔϓϥΠζ։ൃΛܦݧޙɺΑΓར༻ऀʹۙ
    ͍αʔϏεʹܞΘΔͨΊɺεϚʔτϑΥϯήʔϜ
    ͷόοΫΤϯυ։ൃʹैࣄɻ
    ͦͷޙେن໛෼ࢄج൫ͷߏஙӡ༻ܦݧͱελʔτ
    ΞοϓͰͷ։ൃϚωδϝϯτܦݧΛܦͯDeNAʹ
    ೖࣾɻ
    AI&෼ੳج൫ͷߏஙͱϚωδϝϯτΛߦ͏ɻ
    2

    View Slide

  3. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    Agenda
    ࣗݾ঺հ
    DeNAͱAIγεςϜ෦ͷ͝঺հ
    ⁃ AIγεςϜ෦ͷ໾ׂʢAIฤʣ
    ⁃ AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ
    AIΠϯϑϥͷ՝୊
    ⁃ TerraformʹΑΔղܾ
    ⁃ PackerʹΑΔղܾʢҊʣ
    ෼ੳΠϯϑϥͷ՝୊
    ⁃ VagrantʹΑΔղܾ
    3

    View Slide

  4. © DeNA Co., Ltd.
    DeNAͱAIγεςϜ෦ͷ͝঺հ
    4

    View Slide

  5. Game
    Automotive
    EC
    Sports
    New! Entertainment
    Social Live
    Health care
    © DeNA Co., Ltd.
    ࣄۀϙʔτϑΥϦΦ
    5
    • ଟछଟ༷ͳࣄۀྖҬͰϏδωεɾαʔϏεల։
    • ύʔτφʔاۀͱڞʹࣾձӨڹͷେ͖ͳαʔϏεΛ૑ग़
    • େن໛ΠϯλʔωοταʔϏεϓϥοτϑΥʔϜͷߏஙɾӡ༻ྗ

    View Slide

  6. © DeNA Co., Ltd.
    DeNAͰͷσʔλ׆༻
    6
    AI
    Service
    Data
    ࠷৽ݚڀΛϕʔεʹݚڀ։ൃ
    AIΛ׆༻ͨ͠৽ͨͳՁ஋͋Δ
    αʔϏεઃܭɾ࣮૷
    αʔϏεɾσʔλͷαΠΫϧ͔Β
    ੜ·ΕΔڧݻͳϏδωεߏ଄

    View Slide

  7. © DeNA Co., Ltd.
    AIγεςϜ෦ͷ໾ׂʢAIฤʣ
    7
    DeNA Customers
    Game
    Analyst
    AIγεςϜ෦
    AI&෼ੳج൫
    ITPF CERT
    AIݚڀ։ൃΤϯδχΞ͕༰қʹࣗ༝ʹ։ൃͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ
    Sports
    Analyst
    (other)
    Analyst
    AIݚڀ։ൃ (other)

    View Slide

  8. © DeNA Co., Ltd.
    AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ
    8
    DeNA Customers
    Game
    Analyst
    AIγεςϜ෦
    AI&෼ੳج൫
    ITPF CERT
    ΞφϦετ͕༰қʹࣗ༝ʹ෼ੳͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ
    Sports
    Analyst
    (other)
    Analyst
    AIݚڀ։ൃ (other)

    View Slide

  9. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    Agenda
    ࣗݾ঺հ
    DeNAͱAIγεςϜ෦ͷ͝঺հ
    ⁃ AIγεςϜ෦ͷ໾ׂʢAIฤʣ
    ⁃ AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ
    AIΠϯϑϥͷ՝୊
    ⁃ TerraformʹΑΔղܾ
    ⁃ PackerʹΑΔղܾʢҊʣ
    ෼ੳΠϯϑϥͷ՝୊
    ⁃ VagrantʹΑΔղܾ
    9

    View Slide

  10. © DeNA Co., Ltd.
    AIΠϯϑϥͷ՝୊
    10

    View Slide

  11. © DeNA Co., Ltd.
    ՝୊ͱTerraformʹΑΔղܾ
    11
    AWS/GCP্ʹ
    GPUΛ׆༻ͨ͠
    ػցֶशΠϯϑϥΛ
    Infra as CodeͰૉૣ͘ߏஙʂ

    View Slide

  12. © DeNA Co., Ltd.
    PackerʹΑΔղܾʢҊʣ
    12
    Google
    Container Registry
    Amazon ElasAc
    Container Registry
    AWS͸ECRͰɺGCP͸GCRͰ
    ಉ౳ͷDockerΠϝʔδΛ࢖͍͍ͨ
    h"ps://github.com/mazgi/docker-ml/blob/326189d5be224b52c58ff2000da0f7a14b48e43f/packer.json#L30-L58

    View Slide

  13. © DeNA Co., Ltd.
    ෼ੳΠϯϑϥͷ՝୊
    13

    View Slide

  14. © DeNA Co., Ltd.
    ෼ੳΠϯϑϥͷಛ௃
    14
    ෼ੳج൫
    Log
    Gateway
    Hadoop
    Argus
    Dashboard
    Medjed
    +Embulk
    HP VerAca
    Hue
    Jenkins &
    WorkstaAon
    Services
    Analyst
    Log
    DB Snapshot
    Web UI
    Web UI
    & SSH
    Query
    Query
    Google
    BigQuery
    ”ॏྔڃ”ϛυϧ΢ΣΞΛ׆༻ͯ͠
    ҆ఆͨ͠෼ੳ؀ڥΛఏڙ

    View Slide

  15. ෼ੳج൫ʢDevʣ ෼ੳج൫ʢDevʣ
    © DeNA Co., Ltd.
    VagrantʹΑΔղܾͱ࢒՝୊
    15
    ෼ੳج൫ʢຊ൪ʣ
    Hadoop
    Jenkins &
    WorkstaAon
    ෼ੳج൫ͷݕূ͸େมɺͦ͜ͰVagrantʂɾɾɾͰ΋΍ͬͺΓେม

    View Slide

  16. © DeNA Co., Ltd.
    ͍͞͝ʹ
    16
    ࠓ೔͸͝དྷ৔͋Γ͕ͱ͏͍͟͝·͢ʂ
    Ұॹʹָ͠Έ·͠ΐ͏̇

    View Slide