Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
HashiCorp Products on DeNA AI & Analytics Infrastructure
MATSUKI Hidenori
September 11, 2018
Technology
1
12k
HashiCorp Products on DeNA AI & Analytics Infrastructure
https://hashicorp.connpass.com/event/98386/
MATSUKI Hidenori
September 11, 2018
Tweet
Share
More Decks by MATSUKI Hidenori
See All by MATSUKI Hidenori
つらい時にアゲる机
mazgi
1
230
getting-started-audio-video-recording-and-editing-for-it-engineers
mazgi
0
330
MLアプリケーション短期開発 / Fast development for ML Web Service on GKE & GCP
mazgi
6
2.6k
Brief description of Docker and XaaS in the AI era
mazgi
0
1.4k
TD Tech Talk 2018: DeNA AI&Analytics Infrastructure
mazgi
1
2.1k
DeNA AI Cloud Infrastructure 2018 Summary
mazgi
1
420
Other Decks in Technology
See All in Technology
JFrog 最新情報 - JFrog DevOps プラットフォームの今までとこれから / jfrog-update-for-devopskaigi-2022
tsuyo
0
150
Meet passkeys
satotakeshi
1
110
雑な攻撃からELBを守る一工夫 +おまけ / Know-how to protect servers from miscellaneous attacks
hiroga
0
490
データエンジニアと作るデータ文化
yuki_saito
4
1.5k
OpsJAWS Meetup21 システム運用アンチパターンのすすめ
yoshiiryo1
0
1.4k
SI企業が「アジャイル推し」になったら 幸せになれますか?/Can SI company be happy if it becomes “Agile stan” ?
chinmo
1
1.1k
What's Data Lake ? Azure Data Lake best practice
ryomaru0825
2
740
RDRA + JavaによるレジャーSaaSプロダクトの要件定義と実装のシームレスな接続
jjebejj
PRO
3
530
Building smarter apps with machine learning, from magic to reality
picardparis
4
3.2k
SlackBotで あらゆる業務を自動化。問い合わせ〜DevOpsまで #CODT2022
kogatakanori
0
790
ソフトウェアライセンス 2022 / Software License 2022
cybozuinsideout
PRO
1
1.1k
スタートアップと技術選定と AWS
track3jyo
PRO
2
330
Featured
See All Featured
Rebuilding a faster, lazier Slack
samanthasiow
62
7.2k
Agile that works and the tools we love
rasmusluckow
319
19k
It's Worth the Effort
3n
172
25k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
181
15k
A Modern Web Designer's Workflow
chriscoyier
689
180k
Code Reviewing Like a Champion
maltzj
506
37k
10 Git Anti Patterns You Should be Aware of
lemiorhan
638
52k
Git: the NoSQL Database
bkeepers
PRO
415
59k
Support Driven Design
roundedbygravity
86
8.5k
The Invisible Customer
myddelton
110
11k
How to Ace a Technical Interview
jacobian
265
21k
What's new in Ruby 2.0
geeforr
336
30k
Transcript
© DeNA Co., Ltd. Sep 11, 2018 HashiCorp Meetup at
DeNA Hidenori MATSUKI AI System Division DeNA Co., Ltd. "*ੳج൫Ͱ׆༂ʂ )BTIJ$PSQ 1SPEVDUT © DeNA Co., Ltd.
ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd. ࣗݾհ দ लݑ DeNA γεςϜຊ෦ AIγεςϜ෦
AI&ੳج൫Λ୲ [ུྺ] ΤϯλʔϓϥΠζ։ൃΛܦݧޙɺΑΓར༻ऀʹۙ ͍αʔϏεʹܞΘΔͨΊɺεϚʔτϑΥϯήʔϜ ͷόοΫΤϯυ։ൃʹैࣄɻ ͦͷޙେنࢄج൫ͷߏஙӡ༻ܦݧͱελʔτ ΞοϓͰͷ։ൃϚωδϝϯτܦݧΛܦͯDeNAʹ ೖࣾɻ AI&ੳج൫ͷߏஙͱϚωδϝϯτΛߦ͏ɻ 2
ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd. Agenda ࣗݾհ DeNAͱAIγεςϜ෦ͷ͝հ ⁃ AIγεςϜ෦ͷׂʢAIฤʣ ⁃
AIγεςϜ෦ͷׂʢੳฤʣ AIΠϯϑϥͷ՝ ⁃ TerraformʹΑΔղܾ ⁃ PackerʹΑΔղܾʢҊʣ ੳΠϯϑϥͷ՝ ⁃ VagrantʹΑΔղܾ 3
© DeNA Co., Ltd. DeNAͱAIγεςϜ෦ͷ͝հ 4
Game Automotive EC Sports New! Entertainment Social Live Health care
© DeNA Co., Ltd. ࣄۀϙʔτϑΥϦΦ 5 • ଟछଟ༷ͳࣄۀྖҬͰϏδωεɾαʔϏεల։ • ύʔτφʔاۀͱڞʹࣾձӨڹͷେ͖ͳαʔϏεΛग़ • େنΠϯλʔωοταʔϏεϓϥοτϑΥʔϜͷߏஙɾӡ༻ྗ
© DeNA Co., Ltd. DeNAͰͷσʔλ׆༻ 6 AI Service Data ࠷৽ݚڀΛϕʔεʹݚڀ։ൃ
AIΛ׆༻ͨ͠৽ͨͳՁ͋Δ αʔϏεઃܭɾ࣮ αʔϏεɾσʔλͷαΠΫϧ͔Β ੜ·ΕΔڧݻͳϏδωεߏ
© DeNA Co., Ltd. AIγεςϜ෦ͷׂʢAIฤʣ 7 DeNA Customers Game Analyst
AIγεςϜ෦ AI&ੳج൫ ITPF CERT AIݚڀ։ൃΤϯδχΞ͕༰қʹࣗ༝ʹ։ൃͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ Sports Analyst (other) Analyst AIݚڀ։ൃ (other)
© DeNA Co., Ltd. AIγεςϜ෦ͷׂʢੳฤʣ 8 DeNA Customers Game Analyst
AIγεςϜ෦ AI&ੳج൫ ITPF CERT ΞφϦετ͕༰қʹࣗ༝ʹੳͰ͖ΔΠϯϑϥΛߏஙӡ༻͢Δ Sports Analyst (other) Analyst AIݚڀ։ൃ (other)
ɹɹɹɹɹɹɹɹɹɹɹɹɹ© DeNA Co., Ltd. Agenda ࣗݾհ DeNAͱAIγεςϜ෦ͷ͝հ ⁃ AIγεςϜ෦ͷׂʢAIฤʣ ⁃
AIγεςϜ෦ͷׂʢੳฤʣ AIΠϯϑϥͷ՝ ⁃ TerraformʹΑΔղܾ ⁃ PackerʹΑΔղܾʢҊʣ ੳΠϯϑϥͷ՝ ⁃ VagrantʹΑΔղܾ 9
© DeNA Co., Ltd. AIΠϯϑϥͷ՝ 10
© DeNA Co., Ltd. ՝ͱTerraformʹΑΔղܾ 11 AWS/GCP্ʹ GPUΛ׆༻ͨ͠ ػցֶशΠϯϑϥΛ Infra
as CodeͰૉૣ͘ߏஙʂ
© DeNA Co., Ltd. PackerʹΑΔղܾʢҊʣ 12 Google Container Registry Amazon
ElasAc Container Registry AWSECRͰɺGCPGCRͰ ಉͷDockerΠϝʔδΛ͍͍ͨ h"ps://github.com/mazgi/docker-ml/blob/326189d5be224b52c58ff2000da0f7a14b48e43f/packer.json#L30-L58
© DeNA Co., Ltd. ੳΠϯϑϥͷ՝ 13
© DeNA Co., Ltd. ੳΠϯϑϥͷಛ 14 ੳج൫ Log Gateway Hadoop
Argus Dashboard Medjed +Embulk HP VerAca Hue Jenkins & WorkstaAon Services Analyst Log DB Snapshot Web UI Web UI & SSH Query Query Google BigQuery ”ॏྔڃ”ϛυϧΣΞΛ׆༻ͯ͠ ҆ఆͨ͠ੳڥΛఏڙ
ੳج൫ʢDevʣ ੳج൫ʢDevʣ © DeNA Co., Ltd. VagrantʹΑΔղܾͱ՝ 15 ੳج൫ʢຊ൪ʣ Hadoop
Jenkins & WorkstaAon ੳج൫ͷݕূେมɺͦ͜ͰVagrantʂɾɾɾͰͬͺΓେม
© DeNA Co., Ltd. ͍͞͝ʹ 16 ࠓ͝དྷ͋Γ͕ͱ͏͍͟͝·͢ʂ Ұॹʹָ͠Έ·͠ΐ͏̇