Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
20-minutes-ecs-batch
Search
ryo nakamaru
December 13, 2016
Technology
0
460
20-minutes-ecs-batch
re:Port 2016 大阪での登壇資料です
ryo nakamaru
December 13, 2016
Tweet
Share
More Decks by ryo nakamaru
See All by ryo nakamaru
AWSで楽をするサービスメッシュ入門/appmesh-trial
pottava
1
1.5k
reinforce-2019-recap-lt
pottava
2
4.1k
ScaleShift-jp-2019-summer
pottava
1
210
Firecracker とは何か/what is Firecracker
pottava
12
5.4k
ハイブリッド並列 on Kubernetes/hybrid-parallel-program-on-kubernetes
pottava
1
440
AWS Fargate + Code 兄弟で始める継続的デリバリー / Continuous Delivery with AWS Fargate and Code brothers
pottava
12
3.2k
Singularity と NVIDIA GPU Cloud で作る ハイブリッド機械学習環境の構築 / Building a hybrid environment for Machine Learning with Singularity and NGC
pottava
3
1.4k
明日から始めるちょい足し λ / get-started-with-aws-lambda
pottava
4
2.5k
NGC と Singularity によるハイブリッド機械学習環境 / A hybrid environment for Machine Learning with NGC and Singularity
pottava
0
490
Other Decks in Technology
See All in Technology
Devinを使ったモバイルアプリ開発 / Mobile app development with Devin
yanzm
0
190
Goss: Faiss向けの新しい本番環境対応 Goバインディング #coefl_go_jp
bengo4com
0
1.4k
制約理論(ToC)入門
recruitengineers
PRO
5
910
マイクロモビリティシェアサービスを支える プラットフォームアーキテクチャ
grimoh
1
240
実践アプリケーション設計 ②トランザクションスクリプトへの対応
recruitengineers
PRO
4
540
ソフトウェア エンジニアとしての 姿勢と心構え
recruitengineers
PRO
8
2k
攻撃と防御で実践するプロダクトセキュリティ演習~導入パート~
recruitengineers
PRO
3
440
人を動かすことについて考える
ichimichi
2
330
Goss: New Production-Ready Go Binding for Faiss #coefl_go_jp
bengo4com
0
1.1k
新規案件の立ち上げ専門チームから見たAI駆動開発の始め方
shuyakinjo
0
140
【 LLMエンジニアがヒューマノイド開発に挑んでみた 】 - 第104回 Machine Learning 15minutes! Hybrid
soneo1127
0
120
Go で言うところのアレは TypeScript で言うとコレ / Kyoto.なんか #7
susisu
7
1.9k
Featured
See All Featured
YesSQL, Process and Tooling at Scale
rocio
173
14k
Producing Creativity
orderedlist
PRO
347
40k
GitHub's CSS Performance
jonrohan
1031
460k
How GitHub (no longer) Works
holman
315
140k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
30
9.6k
The Pragmatic Product Professional
lauravandoore
36
6.8k
How to Think Like a Performance Engineer
csswizardry
25
1.8k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
229
22k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
6k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
820
The Power of CSS Pseudo Elements
geoffreycrofte
77
5.9k
Transcript
20 ͰΘ͔Δ ECS / Batch AWS re:Invent ࢀՃใࠂ re:Port 2016
@ 2016.12.13
@pottava SUPINF Inc.
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α ɹͦ͏Ͱͳ͍͚Ͳɻ
ࠓͷྲྀΕ 1. Docker / ECS ͷ͓͞Β͍গʑ 2. ͦͷ্Ͱ re:Invent લޙͷൃදͬͯͲ͏ͩͬͨͷʁ
Dockerͱ
Docker OS ԾԽͷͻͱͭͷํ๏ɻ 1. ιϑτΣΞΛ Docker Πϝʔδʹ·ͱΊ͓͖ͯ 2. ϗετϚγϯͰ Docker
ίϯςφͱͯ͠ىಈ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ͳ݁Ռ ɾ࣮ߦڥʹґଘ͠ͳ͍Έ͕Ͱ͖Δ ɾൺֱత؆୯ʹϦιʔεར༻ޮΛվળͰ͖Δ ɾόʔδϣϯཧ͕༰қʹ ɾ..
Α͛͞Ͱ͢Ͷ
୯Ұϗετ·Ͱͳ
Docker ͷΈ ɾෳϗετͰಈ͔ͦ͏ͱ͢Δͱӡ༻͍͠ ɾϗετ / ίϯςφؒͷ௨৴ɺͲ͏Δͷʁ ɾϗετ / ίϯςφ͕མͪͨΒͲ͏ͳΔͷʁ ɾDB
ͱ͔ϩάɺӬଓԽ͍ͨ͠σʔλͲ͏͢Δͷʁ
ͦ͜Ͱ
ECS EC2 Container Service Ͱ͢Α ɾϑϧϚωʔδυͳίϯςφΫϥελཧ ɾELB ΛͬͨαʔϏεؒ௨৴ ɾAZ Λҙࣝͨ͠Φʔτεέʔϧ
ɾIAM / CloudWatch ͱͷͱ͍͍ͯײ͡ͳ౷߹
ECS ECR ECS EC2 ᶃ docker push ᶄ λεΫఆٛ &
ɹ αʔϏεߋ৽ ᶅ ΤʔδΣϯτʹࢦࣔ ΤϯδχΞ Ϣʔβ ᶆ docker pull ᶇ σϓϩΠ ࠷খߏɿ
CON316 @ re:Invent 2016 State of the Union: Containers https://www.youtube.com/watch?v=UR8BI2Exkbc
ɾECS ͷΈɺϢʔεέʔε ɾϢʔβར༻ࣄྫʢAmazonɺNetflixɺmapboxɾɾʣ
Docker ίϯςφཧ ϑϧϚωʔδυք۾
EC2 Container Service (ECS) Google Container Engine (GKE) Azure Container
Service (ACS) based on ಠࣗ + Blox Kubernetes Docker swarm or DC / OS or Kubernetes unit λεΫ Pod Service or Pod Google Cloud Platform
CON303 @ re:Invent 2016 Introduction to Container Management on AWS
https://www.youtube.com/watch?v=nkguMBVsRbE ɾίϯςφΦʔέετϨʔγϣϯͷ 3 ཁૉɿ αʔϏεཧ / εέδϡʔϦϯά / Ϧιʔεཧ ɾECS / Kubernetes / Mesos / Docker Datacenter ͦΕͧΕͷಛͱϢʔεέʔεΛհ
͓͞Β͍͓ΘΓ
ͦΕͰ
re:Invent લޙͷൃදͬͯ Ͳ͏ͩͬͨͷʁ
Amazon ECS
ECS Ξοϓσʔτ ϦϦʔεࡁΈ + ۙͷ༧ఆ ɾWindows ίϯςφ ɾλεΫͷஔʮ੍ʯͷ֦ு ɾλεΫͷஔʮઓུʯͷ࣮ ɾΠϕϯτετϦʔϜ
ɾBlox new! new! coming soon! coming soon! β ఏڙத
Windows ίϯςφ ݱࡏ β ѻ͍ͰαʔϏεఏڙதɻ http://docs.aws.amazon.com/ja_jp/AmazonECS/latest/developerguide/ECS_Windows.html ɾWindows Server 2016 +
Windows ༻ ECS ΤʔδΣϯτ ɾͪΖΜ Linux ΠϯελϯεͰಈ͔ͳ͍ ɾຊ൪ڥͰΘͳ͍ͰͶ ɾҙॻ͖͍ͬͺ͍͋Δ
λεΫͷஔʮ੍ʯͷ֦ு طଘͷϦιʔε੍ʹՃ͑ͯɺҎԼࢦఆͰ͖Δɻ ɾAMI-IDɺAZɺInstanceTypeɺΧελϜଐੑ ྫ) attribute:ecs.instance-type == g2.2xlarge ɾஔީิͱͳΔϗετΛΑΓҰߜΓࠐΊΔ Coming soon!
λεΫͷஔʮઓུʯͷ࣮ ߜΓࠐΜͩϗετͷ͏ͪɺͲΕʹஔ͢Δ͔ɻ ɾBinpackingɺSpreadɺAffinityɺDistinct Instance ɾ͜ΕΛΈ߹Θͤͯ͑Δ ྫ) AZ Ͱ Spread ্ͨ͠Ͱ
Binpack Coming soon!
ECS ΠϕϯτετϦʔϜ λεΫͱΠϯελϯεͷঢ়ଶߋ৽௨ɻ ɾCloudWatch Events ʹྲྀΕΔঢ়ଶมԽΛτϦΨʹ ɾLambda / Kinesis /
SQS / SNS Λىಈ͢Δ ɾαʔϏεσΟεΧόϦো௨ͳͲ ྫ) ASG ʹϗετ͕Ճ͞ΕͨΒ Datadog ίϯςφىಈ
ΠϕϯτετϦʔϜΛͬͨ OSS ͷεέδϡʔϥɻ ɾECS ͷΧελϜεέδϡʔϥΛΈΜͳͷྗͰʂ ɾBlox ࣗΛαʔϏεͱͯ͠ಈ͔͢ඞཁ͋Γ Blox
CON307 @ re:Invent 2016 Advanced Task Scheduling with Amazon ECS
and Blox https://www.youtube.com/watch?v=nkguMBVsRbE ɾECS ͷ৽ػೳ܈ͷհ ɾ৽͍͠λεΫஔͷίϚϯυΛަ͑ͨ۩ମྫ
AWS Batch
AWS Batch ɾϑϧϚωʔδυ όονδϣϒ࣮ߦڥ ɾγΣϧɺLinux ࣮ߦϑΝΠϧɺDocker Πϝʔδ ɾฒྻδϣϒαϙʔτ ɾ༏ઌ͖δϣϒΩϡʔ ɾϫʔΫϑϩʔΤϯδϯͷαϙʔτ
AWS Batch ɾECS ্ʹߏங͞ΕΔ - ECS ͷϦιʔεཧػೳ͕׆͔ͤΔ - ECS ͷίϯςφஔػೳ͕׆͔ͤΔ
- ༏ΕͨՄ༻ੑɺ֦ுੑ - δϣϒ͝ͱͷదͳݖݶཧ ɾGlue EFS ͱͷΈ߹Θͤॏཁ
CON316: State of the Union: Containers ΑΓ https://www.youtube.com/watch?v=UR8BI2Exkbc
ଓ͖໌
ECS Λத৺ʹɺίϯςφ·ΘΓͷ࠷৽ใΛ͓ಧ͚ʂ http://jawsug-container.connpass.com/
ίϯςφ ָ͍͠Ͱ͢Ͷʂʂ
͓ΘΓ
גࣜձࣾεϐϯϑ ΞΠσΟΞΛ͔ͨͪʹʂ +
http://prtimes.jp/main/html/rd/p/000000007.000007768.html Comfy for Docker ϓϩδΣΫτͷ Docker ಋೖɾ։ൃࢧԉɾӡ༻ࢹߦΛ͍ͨ͠·͢ɻ ʢGCP / Azure
ͪΖΜରԠ͍ͯ͠·͢ɾɾʣ https://www.supinf.co.jp/service/dockersupport/
͝૬ஊ͓ؾܰʹͪ͜Β·Ͱ.. 44 <Thank you !! https://www.supinf.co.jp/service/dockersupport/