Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
20-minutes-ecs-batch
Search
ryo nakamaru
December 13, 2016
Technology
0
420
20-minutes-ecs-batch
re:Port 2016 大阪での登壇資料です
ryo nakamaru
December 13, 2016
Tweet
Share
More Decks by ryo nakamaru
See All by ryo nakamaru
AWSで楽をするサービスメッシュ入門/appmesh-trial
pottava
1
1.2k
reinforce-2019-recap-lt
pottava
2
4k
ScaleShift-jp-2019-summer
pottava
1
180
Firecracker とは何か/what is Firecracker
pottava
13
5k
ハイブリッド並列 on Kubernetes/hybrid-parallel-program-on-kubernetes
pottava
1
370
AWS Fargate + Code 兄弟で始める継続的デリバリー / Continuous Delivery with AWS Fargate and Code brothers
pottava
12
2.9k
Singularity と NVIDIA GPU Cloud で作る ハイブリッド機械学習環境の構築 / Building a hybrid environment for Machine Learning with Singularity and NGC
pottava
3
1.1k
明日から始めるちょい足し λ / get-started-with-aws-lambda
pottava
4
2.3k
NGC と Singularity によるハイブリッド機械学習環境 / A hybrid environment for Machine Learning with NGC and Singularity
pottava
0
440
Other Decks in Technology
See All in Technology
レガシーをぶっ壊せ。AEONで始めるDevRelの話 / Qiita Night 2024-2-22
aeonpeople
3
1.3k
Cracking the KubeCon CfP
inductor
2
250
Azureの基本的な権限管理の勉強会
yhana
0
590
SIEMを用いて、セキュリティログ分析の可視化と分析を実現し、PDCAサイクルを回してみた
coconala_engineer
0
330
Terraformあれやこれ/terraform-this-and-that
emiki
8
1.4k
DevOpsメトリクスとアウトカムの接続にトライ!開発プロセスを通して計測できるメトリクスの活用方法
ham0215
2
240
よく聞くけど使ったことないソフトウェアNo.1 KafkaとSnowflake
foursue
4
360
AOAI をきっかけに 社内の Azure 管理を見直した話
recruitengineers
PRO
1
300
プロトタイピングによる不確実性の低減 / Reducing Uncertainty through Prototyping
ohbarye
5
390
20分で完全に理解するGrafanaダッシュボード
hamadakoji
3
670
ExaDB-D dbaascli で出来ること
oracle4engineer
PRO
0
2.1k
ServiceNow Knowledge Learning Rise up
manarobot
0
210
Featured
See All Featured
The Cult of Friendly URLs
andyhume
74
5.7k
Designing for humans not robots
tammielis
248
25k
The Illustrated Children's Guide to Kubernetes
chrisshort
31
46k
Building Applications with DynamoDB
mza
88
5.6k
ParisWeb 2013: Learning to Love: Crash Course in Emotional UX Design
dotmariusz
104
6.6k
jQuery: Nuts, Bolts and Bling
dougneiner
59
7.1k
The World Runs on Bad Software
bkeepers
PRO
61
6.7k
Facilitating Awesome Meetings
lara
42
5.6k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
659
120k
It's Worth the Effort
3n
180
27k
Agile that works and the tools we love
rasmusluckow
325
20k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
78
43k
Transcript
20 ͰΘ͔Δ ECS / Batch AWS re:Invent ࢀՃใࠂ re:Port 2016
@ 2016.12.13
@pottava SUPINF Inc.
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α ɹͦ͏Ͱͳ͍͚Ͳɻ
ࠓͷྲྀΕ 1. Docker / ECS ͷ͓͞Β͍গʑ 2. ͦͷ্Ͱ re:Invent લޙͷൃදͬͯͲ͏ͩͬͨͷʁ
Dockerͱ
Docker OS ԾԽͷͻͱͭͷํ๏ɻ 1. ιϑτΣΞΛ Docker Πϝʔδʹ·ͱΊ͓͖ͯ 2. ϗετϚγϯͰ Docker
ίϯςφͱͯ͠ىಈ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ͳ݁Ռ ɾ࣮ߦڥʹґଘ͠ͳ͍Έ͕Ͱ͖Δ ɾൺֱత؆୯ʹϦιʔεར༻ޮΛվળͰ͖Δ ɾόʔδϣϯཧ͕༰қʹ ɾ..
Α͛͞Ͱ͢Ͷ
୯Ұϗετ·Ͱͳ
Docker ͷΈ ɾෳϗετͰಈ͔ͦ͏ͱ͢Δͱӡ༻͍͠ ɾϗετ / ίϯςφؒͷ௨৴ɺͲ͏Δͷʁ ɾϗετ / ίϯςφ͕མͪͨΒͲ͏ͳΔͷʁ ɾDB
ͱ͔ϩάɺӬଓԽ͍ͨ͠σʔλͲ͏͢Δͷʁ
ͦ͜Ͱ
ECS EC2 Container Service Ͱ͢Α ɾϑϧϚωʔδυͳίϯςφΫϥελཧ ɾELB ΛͬͨαʔϏεؒ௨৴ ɾAZ Λҙࣝͨ͠Φʔτεέʔϧ
ɾIAM / CloudWatch ͱͷͱ͍͍ͯײ͡ͳ౷߹
ECS ECR ECS EC2 ᶃ docker push ᶄ λεΫఆٛ &
ɹ αʔϏεߋ৽ ᶅ ΤʔδΣϯτʹࢦࣔ ΤϯδχΞ Ϣʔβ ᶆ docker pull ᶇ σϓϩΠ ࠷খߏɿ
CON316 @ re:Invent 2016 State of the Union: Containers https://www.youtube.com/watch?v=UR8BI2Exkbc
ɾECS ͷΈɺϢʔεέʔε ɾϢʔβར༻ࣄྫʢAmazonɺNetflixɺmapboxɾɾʣ
Docker ίϯςφཧ ϑϧϚωʔδυք۾
EC2 Container Service (ECS) Google Container Engine (GKE) Azure Container
Service (ACS) based on ಠࣗ + Blox Kubernetes Docker swarm or DC / OS or Kubernetes unit λεΫ Pod Service or Pod Google Cloud Platform
CON303 @ re:Invent 2016 Introduction to Container Management on AWS
https://www.youtube.com/watch?v=nkguMBVsRbE ɾίϯςφΦʔέετϨʔγϣϯͷ 3 ཁૉɿ αʔϏεཧ / εέδϡʔϦϯά / Ϧιʔεཧ ɾECS / Kubernetes / Mesos / Docker Datacenter ͦΕͧΕͷಛͱϢʔεέʔεΛհ
͓͞Β͍͓ΘΓ
ͦΕͰ
re:Invent લޙͷൃදͬͯ Ͳ͏ͩͬͨͷʁ
Amazon ECS
ECS Ξοϓσʔτ ϦϦʔεࡁΈ + ۙͷ༧ఆ ɾWindows ίϯςφ ɾλεΫͷஔʮ੍ʯͷ֦ு ɾλεΫͷஔʮઓུʯͷ࣮ ɾΠϕϯτετϦʔϜ
ɾBlox new! new! coming soon! coming soon! β ఏڙத
Windows ίϯςφ ݱࡏ β ѻ͍ͰαʔϏεఏڙதɻ http://docs.aws.amazon.com/ja_jp/AmazonECS/latest/developerguide/ECS_Windows.html ɾWindows Server 2016 +
Windows ༻ ECS ΤʔδΣϯτ ɾͪΖΜ Linux ΠϯελϯεͰಈ͔ͳ͍ ɾຊ൪ڥͰΘͳ͍ͰͶ ɾҙॻ͖͍ͬͺ͍͋Δ
λεΫͷஔʮ੍ʯͷ֦ு طଘͷϦιʔε੍ʹՃ͑ͯɺҎԼࢦఆͰ͖Δɻ ɾAMI-IDɺAZɺInstanceTypeɺΧελϜଐੑ ྫ) attribute:ecs.instance-type == g2.2xlarge ɾஔީิͱͳΔϗετΛΑΓҰߜΓࠐΊΔ Coming soon!
λεΫͷஔʮઓུʯͷ࣮ ߜΓࠐΜͩϗετͷ͏ͪɺͲΕʹஔ͢Δ͔ɻ ɾBinpackingɺSpreadɺAffinityɺDistinct Instance ɾ͜ΕΛΈ߹Θͤͯ͑Δ ྫ) AZ Ͱ Spread ্ͨ͠Ͱ
Binpack Coming soon!
ECS ΠϕϯτετϦʔϜ λεΫͱΠϯελϯεͷঢ়ଶߋ৽௨ɻ ɾCloudWatch Events ʹྲྀΕΔঢ়ଶมԽΛτϦΨʹ ɾLambda / Kinesis /
SQS / SNS Λىಈ͢Δ ɾαʔϏεσΟεΧόϦো௨ͳͲ ྫ) ASG ʹϗετ͕Ճ͞ΕͨΒ Datadog ίϯςφىಈ
ΠϕϯτετϦʔϜΛͬͨ OSS ͷεέδϡʔϥɻ ɾECS ͷΧελϜεέδϡʔϥΛΈΜͳͷྗͰʂ ɾBlox ࣗΛαʔϏεͱͯ͠ಈ͔͢ඞཁ͋Γ Blox
CON307 @ re:Invent 2016 Advanced Task Scheduling with Amazon ECS
and Blox https://www.youtube.com/watch?v=nkguMBVsRbE ɾECS ͷ৽ػೳ܈ͷհ ɾ৽͍͠λεΫஔͷίϚϯυΛަ͑ͨ۩ମྫ
AWS Batch
AWS Batch ɾϑϧϚωʔδυ όονδϣϒ࣮ߦڥ ɾγΣϧɺLinux ࣮ߦϑΝΠϧɺDocker Πϝʔδ ɾฒྻδϣϒαϙʔτ ɾ༏ઌ͖δϣϒΩϡʔ ɾϫʔΫϑϩʔΤϯδϯͷαϙʔτ
AWS Batch ɾECS ্ʹߏங͞ΕΔ - ECS ͷϦιʔεཧػೳ͕׆͔ͤΔ - ECS ͷίϯςφஔػೳ͕׆͔ͤΔ
- ༏ΕͨՄ༻ੑɺ֦ுੑ - δϣϒ͝ͱͷదͳݖݶཧ ɾGlue EFS ͱͷΈ߹Θͤॏཁ
CON316: State of the Union: Containers ΑΓ https://www.youtube.com/watch?v=UR8BI2Exkbc
ଓ͖໌
ECS Λத৺ʹɺίϯςφ·ΘΓͷ࠷৽ใΛ͓ಧ͚ʂ http://jawsug-container.connpass.com/
ίϯςφ ָ͍͠Ͱ͢Ͷʂʂ
͓ΘΓ
גࣜձࣾεϐϯϑ ΞΠσΟΞΛ͔ͨͪʹʂ +
http://prtimes.jp/main/html/rd/p/000000007.000007768.html Comfy for Docker ϓϩδΣΫτͷ Docker ಋೖɾ։ൃࢧԉɾӡ༻ࢹߦΛ͍ͨ͠·͢ɻ ʢGCP / Azure
ͪΖΜରԠ͍ͯ͠·͢ɾɾʣ https://www.supinf.co.jp/service/dockersupport/
͝૬ஊ͓ؾܰʹͪ͜Β·Ͱ.. 44 <Thank you !! https://www.supinf.co.jp/service/dockersupport/