$30 off During Our Annual Pro Sale. View Details »

TD Tech Talk 2018: DeNA AI&Analytics Infrastructure

TD Tech Talk 2018: DeNA AI&Analytics Infrastructure

Hidenori Matsuki

May 22, 2018
Tweet

More Decks by Hidenori Matsuki

Other Decks in Technology

Transcript

  1. © DeNA Co., Ltd.
    May 22, 2018
    TD Tech Talk 2018
    Hidenori MATSUKI
    AI System Division

    DeNA Co., Ltd.
    ೥୅ʹ޲͚ͨ
    %F/"ͷ෼ੳج൫
    © DeNA Co., Ltd.

    View Slide

  2. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ࣗݾ঺հ
    দ໦ लݑ
    DeNA γεςϜຊ෦ AIγεςϜ෦
    AI&෼ੳج൫Λ୲౰
    [ུྺ]
    ΤϯλʔϓϥΠζ։ൃΛܦݧޙɺΑΓར༻ऀʹۙ
    ͍αʔϏεʹܞΘΔͨΊɺεϚʔτϑΥϯήʔϜ
    ͷόοΫΤϯυ։ൃʹैࣄɻ
    ͦͷޙେن໛෼ࢄج൫ͷߏஙӡ༻ܦݧͱελʔτ
    ΞοϓͰͷ։ൃϚωδϝϯτܦݧΛܦͯDeNAʹ
    ೖࣾɻ
    AI&෼ੳج൫ͷߏஙͱϚωδϝϯτΛߦ͏ɻ
    2

    View Slide

  3. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    Agenda
    ࣗݾ঺հ
    DeNAͱAIγεςϜ෦ͷ͝঺հ
    DeNA෼ੳج൫ͷ"ࠓ"
    ⁃ DeNA෼ੳج൫ͷಛ௃
    ⁃ ෼ੳج൫ͷγεςϜߏ੒
    ⁃ ෼ੳج൫ͷӡ༻
    ⁃ AIج൫ͷ"ࠓ"
    2020೥ʹ޲͚ͯ ~ AI&෼ੳج൫ͱͯ͠ ~
    3
    ( 1 min. )
    ( 4 min. )
    ( 25 min. )
    ( 10 min. )
    ( 5 min. )
    ( 5 min. )
    ( 5 min. )
    ( 10 min. )

    View Slide

  4. © DeNA Co., Ltd.
    DeNAͱAIγεςϜ෦ͷ͝঺հ
    4

    View Slide

  5. Game
    Automotive
    EC
    Sports
    New! Entertainment
    Other
    Health care
    © DeNA Co., Ltd.
    ࣄۀϙʔτϑΥϦΦ
    5
    • ଟछଟ༷ͳࣄۀྖҬͰϏδωεɾαʔϏεల։
    • ύʔτφʔاۀͱڞʹࣾձӨڹͷେ͖ͳαʔϏεΛ૑ग़
    • େن໛ΠϯλʔωοταʔϏεϓϥοτϑΥʔϜͷߏஙɾӡ༻ྗ

    View Slide

  6. © DeNA Co., Ltd.
    DeNAͰͷσʔλ׆༻
    6
    AI
    Service
    Data
    ࠷৽ݚڀΛϕʔεʹݚڀ։ൃ
    AIΛ׆༻ͨ͠৽ͨͳՁ஋͋Δ
    αʔϏεઃܭɾ࣮૷
    αʔϏεɾσʔλͷαΠΫϧ͔Β
    ੜ·ΕΔڧݻͳϏδωεߏ଄

    View Slide

  7. © DeNA Co., Ltd.
    AIγεςϜ෦ͷ໾ׂʢ෼ੳฤʣ
    7
    DeNA Customers
    Game
    Analyst
    AIγεςϜ෦
    AI&෼ੳج൫
    ITPF CERT
    ΞφϦετ͕༰қʹࣗ༝ʹ෼ੳͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ
    Sports
    Analyst
    (other)
    Analyst
    AIݚڀ։ൃ (other)

    View Slide

  8. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    Agenda
    ࣗݾ঺հ
    DeNAͱAIγεςϜ෦ͷ͝঺հ
    DeNA෼ੳج൫ͷ"ࠓ"
    ⁃ DeNA෼ੳج൫ͷಛ௃
    ⁃ ෼ੳج൫ͷγεςϜߏ੒
    ⁃ ෼ੳج൫ͷӡ༻
    ⁃ AIج൫ͷ"ࠓ"
    2020೥ʹ޲͚ͯ ~ AI&෼ੳج൫ͱͯ͠ ~
    8
    ( 1 min. )
    ( 4 min. )
    ( 25 min. )
    ( 10 min. )
    ( 5 min. )
    ( 5 min. )
    ( 5 min. )
    ( 10 min. )

    View Slide

  9. © DeNA Co., Ltd.
    DeNA෼ੳج൫ͷ"ࠓ"
    9

    View Slide

  10. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    DeNA෼ੳج൫ͷಛ௃
    • 2010೥ʹHadoopʹΑΔେن໛σʔλ෼ੳج൫Λߏஙɺӡ༻։࢝
    • ͋ΒΏΔαʔϏεͰϩάΛ஝ੵ͠෼ੳ͢Δ͜ͱ͕౰ͨΓલ
    • αʔϏε։ൃͱฒߦͯ͠ϩάઃܭΛߦ͏
    • ͍ΘΏΔETL෦෼͕ఆܕԽ͞Ε͓ͯΓҰఆͷ඼࣭Ͱ෼ੳ͕ߦ͑Δ
    • ࣾ಺޲͚ϩάϑΥʔϚοτ͕ఆٛ͞Ε͍ͯΔ
    • PBΫϥεͷσʔλྔͱ60Ҏ্ͷར༻෦໳/αʔϏε
    • ήʔϜʹݶΒͣBtoC/BtoBଟ࠼ͳࣄۀͷ෼ੳσʔλΛѻ͏
    • σʔλΞφϦετΛத৺ʹར༻ऀ͕ࣾ಺ʹวࡏ
    • Ϗδωε৬΍͍ΘΏΔόοΫΦϑΟεͷํ΋ΫΤϦΛ౤͛Δ
    10

    View Slide

  11. © DeNA Co., Ltd.
    ෼ੳج൫ͷγεςϜߏ੒
    11

    View Slide

  12. ෼ੳج൫
    ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    DeNA෼ੳج൫ͷશମ૾
    12
    Log
    Gateway
    Hadoop
    Argus
    Dashboard
    Medjed
    +Embulk
    HP VerIca
    Hue
    Jenkins &
    WorkstaIon
    Services
    Analyst
    Log
    DB Snapshot
    Web UI
    Web UI
    & SSH
    Query
    Query
    Google
    BigQuery

    View Slide

  13. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫
    DeNA෼ੳج൫ͷશମ૾
    13
    Log
    Gateway
    Hadoop
    Argus
    Dashboard
    Medjed
    +Embulk
    HP VerIca
    Hue
    Jenkins &
    WorkstaIon
    Services
    Analyst
    Log
    DB Snapshot
    Web UI
    Web UI
    & SSH
    Query
    Query
    Google
    BigQuery

    View Slide

  14. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫: App -> LogGateway
    • ΞϓϦέʔγϣϯϩά
    • ΞϓϦέʔγϣϯαʔόʔͰൃੜͨ͠ϩάΛFluentdͰऩू
    • https://github.com/civitaspo/fluent-plugin-cat-sweep
    • ϩάதܧαʔόʔΛհͯ͠શࣾڞ௨ͷLogGatewayʹHTTPS POST
    • ೝূͨ͠αʔϏε͔ΒͷΈϩάΛड͚औΔ
    • DBεφοϓγϣοτ
    • εφοϓγϣοτऩूαʔόʔ͔ΒLogGatewayʹHTTPS POST
    • DB͕ΦϯϓϨϛεͷ৔߹SqoopʹΑΔεφοϓγϣοτऩू
    14

    View Slide

  15. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    Fluentdͷ͕͜͜ੌ͍
    • མͪͳ͍
    • མͪͯ΋࠶ىಈ͢Ε͹ϩάΛ࠶ૹͯ͘͠ΕΔ
    • ಋೖ࣌Ҏ֎ͷ͖᪴΄΅ͳ͠
    • PluginʹΑΓॊೈʹΧελϚΠζͰ͖Δ
    • HTTP POST͢Δ৔߹ͳͲ
    • ετϦʔϜσʔλͷHubͱͯ͠ػೳ͢Δ
    • ࠷ऴతʹFluentdʹͨͲΓண͘༏ΕͨΞʔΩςΫνϟ
    15

    View Slide

  16. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫
    DeNA෼ੳج൫ͷશମ૾
    16
    Log
    Gateway
    Hadoop
    Argus
    Dashboard
    Medjed
    +Embulk
    HP VerIca
    Hue
    Jenkins &
    WorkstaIon
    Services
    Analyst
    Log
    DB Snapshot
    Web UI
    Web UI
    & SSH
    Query
    Query
    Google
    BigQuery

    View Slide

  17. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫: LogGateway -> HDFS
    • 2018೥ݱࡏ͸HadoopΛओʹData Lakeͱͯ͠࢖༻͍ͯ͠Δ
    • ͨͩ͠HiveQLΛ࢖༻͍ͯ͠Δ෦໳/αʔϏε΋·ͩଘࡏ͢Δ
    • ͦͷͨΊHueΛఏڙ
    • LogGatewayʹू·ͬͨϩάΛҎԼΛߦ͍ͳ͕ΒHDFSʹॻ͖ࠐΉ
    • αʔϏε͝ͱͷ෼ྨ
    • ॏෳഉআ
    17

    View Slide

  18. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫
    DeNA෼ੳج൫ͷશମ૾
    18
    Log
    Gateway
    Hadoop
    Argus
    Dashboard
    Medjed
    +Embulk
    HP Ver=ca
    Hue
    Jenkins &
    WorkstaIon
    Services
    Analyst
    Log
    DB Snapshot
    Web UI
    Web UI
    & SSH
    Query
    Query
    Google
    BigQuery

    View Slide

  19. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫: HDFS -> BigQuery/Vertica
    • 2018೥ݱࡏͷDeNA಺ਪ঑ΫΤϦΤϯδϯ͸Google BigQuery
    • 2013೥ࠒHP VerticaಋೖɺݱࡏBigQuery΁ॱ࣍Ҡߦத
    • 2013೥Ҏલ͸HiveQL
    • ಺੡Bulk Loadπʔϧ"Medjed"ͰHDFS͔ΒΫΤϦΤϯδϯʹσʔλసૹ
    • Medjed = Web UI + Embulk manager
    • ΞφϦετ͕yamlΛॻ͔ͳͯ͘ࡁΉ
    • ΞφϦετ͕Google Spread SheetΛฤू͢Ε͹yaml͕ੜ੒͞ΕΔ
    • ΞφϦετ͕Schema؅ཧΛߦ͑Δ
    • Embulkࣗମ͸ෳ਺ͷWorkerϊʔυͰ࣮ߦ͞ΕΔͨΊεέʔϧՄೳ
    19

    View Slide

  20. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ಺੡Bulk Loadπʔϧ"Medjed"
    20
    Web UIͰλεΫఆٛ΍खಈ࣮ߦ͕ߦ͑Δ

    View Slide

  21. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ಺੡Bulk Loadπʔϧ"Medjed"
    21
    input / output ͷఆٛΛGoogle Spread SheetͰߦ͑Δ

    View Slide

  22. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    Embulkͷ͕͜͜ศར
    • FluentdͷΑ͏ͳpluginΞʔΩςΫνϟ
    • pluginΛ࢖༻/࣮૷͢Δ͜ͱͰ͋ΒΏΔsource/destinationʹରԠՄೳ
    • https://github.com/medjed
    • https://github.com/sonots/embulk-output-vertica
    • https://github.com/sonots/embulk-input-vertica
    • ઃఆΛyamlͰॻ͚Δ
    • ϓϩάϥϛϯάݴޠͱਓؒ(ΤϯδχΞ)ʹ༏͍͠
    • (ΞφϦετ޲͚ʹ͸MedjedΛఏڙ)
    22

    View Slide

  23. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫
    DeNA෼ੳج൫ͷશମ૾
    23
    Log
    Gateway
    Hadoop
    Argus
    Dashboard
    Medjed
    +Embulk
    HP Ver=ca
    Hue
    Jenkins &
    WorkstaIon
    Services
    Analyst
    Log
    DB Snapshot
    Web UI
    Web UI
    & SSH
    Query
    Query
    Google
    BigQuery

    View Slide

  24. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫: μογϡϘʔυ for BigQuery/Vertica
    • DeNAͰ͸2014೥ࠒ͔ΒμογϡϘʔυπʔϧ"Argus"Λ಺੡
    • ݱࡏͷରԠΫΤϦΤϯδϯ: BigQuery, Vertica
    • ࠷ۙͷଟ͘ͷμογϡϘʔυಉ༷ΫΤϦΛॻ͍ͯάϥϑΛදࣔͰ͖Δ
    • ಺੡ͷϝϦοτ
    • ಺੡ͳͷͰࡉ͔ͳཁ๬ʹૉૣ͘Ԡ͑ΒΕΔ
    • 2018೥ݱࡏͰ΋਺ճ/िͷϦϦʔε
    • ࣾ಺ʹ߹Θͤͨࡉ΍͔ͳݖݶ؅ཧ͕ߦ͑Δ
    • ADάϧʔϓͱ࿈ܞͯ͠؅ཧ/ฤू/ӾཡݖݶΛ෇༩Ͱ͖Δ
    24

    View Slide

  25. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ಺੡μογϡϘʔυ"Argus"
    25
    Web UI্ͰΫΤϦΛॻ͍࣮ͯߦ

    View Slide

  26. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ಺੡μογϡϘʔυ"Argus"
    26
    ΫΤϦ࣮ߦ݁ՌΛάϥϑ΍දͰදࣔՄೳ

    View Slide

  27. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫
    DeNA෼ੳج൫ͷશମ૾
    27
    Log
    Gateway
    Hadoop
    Argus
    Dashboard
    Medjed
    +Embulk
    HP VerIca
    Hue
    Jenkins &
    WorkstaIon
    Services
    Analyst
    Log
    DB Snapshot
    Web UI
    Web UI
    & SSH
    Query
    Query
    Google
    BigQuery

    View Slide

  28. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ෼ੳج൫: Job Scheduler/Workstation
    • Job Schedulerͱͯ͠JenkinsΛ࢖༻
    • Web UI͕ΞφϦετʹͱͬͯ࢖͍΍͍͢
    • େ఍ͷ͜ͱ͕Ͱ͖ͯ͠·͏
    • ݖݶ؅ཧ΋ॊೈʹߦ͑Δ
    • ਖ਼௚ӡ༻͸େม
    • Web UIͰ׬݁͠ͳ͍ۀ຿ͷͨΊʹLinux WorkstationΛఏڙ
    • ΞφϦετ͕ϩάΠϯͰ͖ΔLinuxαʔόʔΛఏڙ͍ͯ͠Δ
    • Hadoop CLIͷ࣮ߦ΍PythonεΫϦϓτͷ։ൃʹ࢖༻͞Ε͍ͯΔ
    28

    View Slide

  29. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    Digdagͱ͍͏༗ྗީิ
    • ಋೖ͍ͨ͠ϙΠϯτ
    • Embulkͱಉ͘͡yamlͰઃఆͰ͖Δ
    • WorkflowΛίʔυͰ؅ཧͰ͖Δ
    • Shell/Ruby/PythonεΫϦϓτΛॻ͚Δ
    • Workflow, Taskͷࡉ͔͍ఆ͕ٛͰ͖Δ: ৚݅෼ذ, ґଘ, ܁Γฦ͠, etc.
    • HAͱฒྻॲཧ͕༰қ
    • ಋೖͰ͖ͣʹ͍Δཧ༝
    • ݖݶ؅ཧ͕ߦ͍ͮΒ͍
    29

    View Slide

  30. © DeNA Co., Ltd.
    ෼ੳج൫ͷӡ༻
    30

    View Slide

  31. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ओͳӡ༻ۀ຿
    • ArgusʢμογϡϘʔυʣ/ MedjedʢBulk Loadπʔϧʣͷઃఆ
    • BigQuery౳ͷ伴ొ࿥
    • ݖݶͷॳظઃఆ
    • Jenkinsͷઃఆ
    • ݖݶઃఆ
    • αʔόʔӡ༻
    • ͍ΘΏΔී௨ͷΠϯϑϥӡ༻
    • ֤λεΫ͸GitHub IssueͰ؅ཧ
    • Issue͸ݪଇશैۀһ͔ΒӾཡՄೳ
    31

    View Slide

  32. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ओͳαϙʔτۀ຿
    • ࣾ಺ͷ෼ੳج൫ར༻ऀ޲͚ٕज़αϙʔτ
    • ϙϦγʔ͸ʮ෼ੳج൫ΑΖͣ૯ड͚ʯ
    • ෼ੳج൫ʹ͍ͭͯͷ૬ஊͰ͋Ε͹ʮ·ͣ͸ड͚Δʯ
    • αϙʔτର৅͸ओʹΞφϦετ
    • ͔͠͠ΞφϦετ৬Ͱ͸ͳ͍ਓ͔Βͷ໰߹ͤ΋͋Δ
    • 2018೥ݱࡏ͸SlackͰͷαϙʔτ͕7ׂ΄Ͳ
    • ͍࣍Ͱର໘ϛʔςΟϯάɺϝʔϧ
    32

    View Slide

  33. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    SlackʹΑΔαϙʔτํ਑
    • ୭Ͱ΋ೖΕΔαϙʔτઐ༻Slack WorkspaceΛ༻ҙ͍ͯ͠Δ
    • DeNAͰ͸શैۀһ͕Slack Enterprise GridΞΧ΢ϯτΛ͍࣋ͬͯΔ
    • ࠔͬͨΒmentionͯ͠΋Β͏ @support ͱ͍͏άϧʔϓΛ༻ҙ͍ͯ͠Δ
    • @support ʹ͸AI&෼ੳج൫ϝϯόʔؚΊෳ਺໊͕ొ࿥͞Ε͍ͯΔ
    33

    View Slide

  34. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    SlackʹΑΔαϙʔτͷྫ
    34
    "ͱΓ͋͑ͣ"ฉ͍ͯ΋ΒͬͯରԠ→ղফͰ͖͍ͯΔ͔֬ೝ

    View Slide

  35. © DeNA Co., Ltd.
    AIج൫ͷ"ࠓ"
    35

    View Slide

  36. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    DeNAͷAIج൫
    • AWS/GCPʹΑΔػցֶशج൫Λߏங/ӡ༻
    • GPUΠϯελϯεΛ͍ͭͰ΋ඞཁͳ਺͚ͩ
    • Infra as CodeΛపఈ͍ͯ͠Δ
    • Terraform
    • Itamae ( Ruby੡ϓϩϏδϣχϯάπʔϧ )
    • ϓϩδΣΫτൃ଍͔Β୹ظؒͰΠϯϑϥఏڙͰ͖͍ͯΔ
    • ֤छਃ੥ؚΊͯ࠷୹1िؒ
    36

    View Slide

  37. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    DeNAͷAIج൫
    37
    hUps://speakerdeck.com/mazgi/dena-ai-cloud-infrastructure-2018-summary

    View Slide

  38. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    Agenda
    ࣗݾ঺հ
    DeNAͱAIγεςϜ෦ͷ͝঺հ
    DeNA෼ੳج൫ͷ"ࠓ"
    ⁃ DeNA෼ੳج൫ͷಛ௃
    ⁃ ෼ੳج൫ͷγεςϜߏ੒
    ⁃ ෼ੳج൫ͷӡ༻
    ⁃ AIج൫ͷ"ࠓ"
    2020೥୅ʹ޲͚ͯ ~ AI&෼ੳج൫ͱͯ͠ ~
    38
    ( 1 min. )
    ( 4 min. )
    ( 25 min. )
    ( 10 min. )
    ( 5 min. )
    ( 5 min. )
    ( 5 min. )
    ( 10 min. )

    View Slide

  39. © DeNA Co., Ltd.
    2020೥୅ʹ޲͚ͯ
    ~ AI&෼ੳج൫ͱͯ͠ ~
    39

    View Slide

  40. © DeNA Co., Ltd.
    ͜Ε͔ΒͷDeNA෼ੳج൫͕໨ࢦ࢟͢
    • Ϋϥ΢υωΠςΟϒ
    • αʔϏεͷΫϥ΢υԽʹ߹Θͤͯ෼ੳج൫΋Ϋϥ΢υԽ
    • ಉ࣌ʹΞφϦετʹ͸طଘͱಉ౳ͷUXΛఏڙ
    • ෼ੳج൫ʹཹ·Βͳ͍AI&෼ੳج൫
    • ෼ੳͷߴ౓ԽͱAIٕज़ͷಋೖͷͨΊศརͳUXΛఏڙ
    • σʔλ෼ੳ / AI / σʔλαΠΤϯε / Kaggle ౳ѻ͏σʔλͷଟ༷Խ
    • ΑΓ҆શͳݖݶ෼཭
    • AWSΞΧ΢ϯτ/GCPϓϩδΣΫτࣗମΛσʔλͷൿಗੑʹԠͯ͡෼཭
    40

    View Slide

  41. طଘ෼ੳج൫
    © DeNA Co., Ltd.
    Ϋϥ΢υωΠςΟϒͳ෼ੳج൫ͷྫ
    41
    Argus
    Dashboard
    Medjed
    +Embulk
    Jenkins &
    WorkstaIon
    Analyst
    Web UI
    Web UI
    & SSH
    Service
    Google
    BigQuery
    Log
    DB Snapshot
    αʔϏε͕Ϋϥ΢υ্ʹ͋Δ
    ৔߹ɺ͋͑ͯΦϯϓϨϛεʹ
    Data LakeΛ࣋ͭඞཁ͸ͳ͍ɻ
    ҰํɺΞφϦετ͸׳ΕͨUX
    Ͱ෼ੳΛߦ͍͍ͨɻ

    View Slide

  42. © DeNA Co., Ltd.
    AI&෼ੳج൫ͱͯ͠Amazon SageMakerΛ૊ΈࠐΜͩྫ
    42
    ෼ੳͱػցֶशΛJupyter Notebook(Amazon SageMaker)Ͱߦ͑Δɻ

    View Slide

  43. © DeNA Co., Ltd.
    Amazon SageMaker ( Jupyter Notebook )
    43
    Web UI্ͰPythonίʔυ౳͕࣮ߦͰ͖Δ

    View Slide

  44. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ϚϧνϝσΟΞσʔλΛѻ͏AIج൫ͷྫ
    • ࣮Ҋ݅΁ͷAIٕज़ಋೖͰ͸੩ࢭը૾΍ಈը૾Λѻ͏έʔε͕૿͖͑ͯͨ
    • S3΁ͷϚϧνϝσΟΞσʔλ౤ೖΛτϦΨʔʹॲཧΛ࣮ߦ͢Δ౳
    • ෼ੳج൫ͱ͸ѻ͏σʔλ΋ॲཧͷཻ౓΋ҟͳΔ
    44
    GPUΠϯελϯε
    (ը૾/ಈըॲཧ)

    View Slide

  45. ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd.
    ͜Ε͔ΒͷDeNA෼ੳج൫
    • Ϋϥ΢υωΠςΟϒ
    • αʔϏεʹ߹Θͤͯ෼ੳج൫΋Ϋϥ΢υωΠςΟϒʹͳ͍ͬͯ͘
    • ෼ੳج൫ʹཹ·Βͳ͍AI&෼ੳج൫
    • ෼ੳର৅ͷσʔλ͸࣭ɾྔͱ΋ʹ૿͍͑ͯ͘
    • ػցֶशΞϧΰϦζϜͷ࣮αʔϏεͰͷӡ༻Λࢧ͑ΔML Ops͕ඞཁ
    • 1ͭͷϓϩδΣΫτ಺ͰAIٕज़΋࢖͏͠෼ੳ΋ߦ͏
    • ʮAI͔෼ੳʯͰ͸ͳ͘ʮAI΋෼ੳ΋ʯߦ͑Δج൫͕ॏཁ
    • ΑΓ҆શͳݖݶ෼཭
    • ѻ͏σʔλ͸ଟ༷ʹͳ͖͍ͬͯͯΔ
    • ద੾ʹݖݶ෼཭ͨ͠ΑΓηΩϡΞͳ؀ڥߏங͕ॏཁ
    45

    View Slide