Upgrade to PRO for Only $50/Year—Limited-Time Offer! 🔥
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
20-minutes-ecs-batch
Search
ryo nakamaru
December 13, 2016
Technology
0
460
20-minutes-ecs-batch
re:Port 2016 大阪での登壇資料です
ryo nakamaru
December 13, 2016
Tweet
Share
More Decks by ryo nakamaru
See All by ryo nakamaru
AWSで楽をするサービスメッシュ入門/appmesh-trial
pottava
1
1.6k
reinforce-2019-recap-lt
pottava
2
4.1k
ScaleShift-jp-2019-summer
pottava
1
220
Firecracker とは何か/what is Firecracker
pottava
12
5.5k
ハイブリッド並列 on Kubernetes/hybrid-parallel-program-on-kubernetes
pottava
1
440
AWS Fargate + Code 兄弟で始める継続的デリバリー / Continuous Delivery with AWS Fargate and Code brothers
pottava
12
3.3k
Singularity と NVIDIA GPU Cloud で作る ハイブリッド機械学習環境の構築 / Building a hybrid environment for Machine Learning with Singularity and NGC
pottava
3
1.4k
明日から始めるちょい足し λ / get-started-with-aws-lambda
pottava
4
2.5k
NGC と Singularity によるハイブリッド機械学習環境 / A hybrid environment for Machine Learning with NGC and Singularity
pottava
0
500
Other Decks in Technology
See All in Technology
Oracle Technology Night #95 GoldenGate 26ai の実装に迫る1
oracle4engineer
PRO
0
150
Sansanが実践する Platform EngineeringとSREの協創
sansantech
PRO
2
660
Ruby で作る大規模イベントネットワーク構築・運用支援システム TTDB
taketo1113
1
210
新 Security HubがついにGA!仕組みや料金を深堀り #AWSreInvent #regrowth / AWS Security Hub Advanced GA
masahirokawahara
1
1.4k
直接メモリアクセス
koba789
0
280
Uncertainty in the LLM era - Science, more than scale
gaelvaroquaux
0
810
「Managed Instances」と「durable functions」で広がるAWS Lambdaのユースケース
lamaglama39
0
280
最近のLinux普段づかいWaylandデスクトップ元年
penguin2716
1
660
【pmconf2025】PdMの「責任感」がチームを弱くする?「分業型」から全員がユーザー価値に本気で向き合う「共創型開発チーム」への変遷
toshimasa012345
0
270
ブロックテーマとこれからの WordPress サイト制作 / Toyama WordPress Meetup Vol.81
torounit
0
490
[CMU-DB-2025FALL] Apache Fluss - A Streaming Storage for Real-Time Lakehouse
jark
0
110
第4回 「メタデータ通り」 リアル開催
datayokocho
0
120
Featured
See All Featured
Building Flexible Design Systems
yeseniaperezcruz
330
39k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
32
1.8k
Measuring & Analyzing Core Web Vitals
bluesmoon
9
700
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
21
1.3k
Facilitating Awesome Meetings
lara
57
6.7k
The Invisible Side of Design
smashingmag
302
51k
The World Runs on Bad Software
bkeepers
PRO
72
12k
Building an army of robots
kneath
306
46k
Code Review Best Practice
trishagee
74
19k
Become a Pro
speakerdeck
PRO
31
5.7k
What’s in a name? Adding method to the madness
productmarketing
PRO
24
3.8k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
9
1k
Transcript
20 ͰΘ͔Δ ECS / Batch AWS re:Invent ࢀՃใࠂ re:Port 2016
@ 2016.12.13
@pottava SUPINF Inc.
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α ɹͦ͏Ͱͳ͍͚Ͳɻ
ࠓͷྲྀΕ 1. Docker / ECS ͷ͓͞Β͍গʑ 2. ͦͷ্Ͱ re:Invent લޙͷൃදͬͯͲ͏ͩͬͨͷʁ
Dockerͱ
Docker OS ԾԽͷͻͱͭͷํ๏ɻ 1. ιϑτΣΞΛ Docker Πϝʔδʹ·ͱΊ͓͖ͯ 2. ϗετϚγϯͰ Docker
ίϯςφͱͯ͠ىಈ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ͳ݁Ռ ɾ࣮ߦڥʹґଘ͠ͳ͍Έ͕Ͱ͖Δ ɾൺֱత؆୯ʹϦιʔεར༻ޮΛվળͰ͖Δ ɾόʔδϣϯཧ͕༰қʹ ɾ..
Α͛͞Ͱ͢Ͷ
୯Ұϗετ·Ͱͳ
Docker ͷΈ ɾෳϗετͰಈ͔ͦ͏ͱ͢Δͱӡ༻͍͠ ɾϗετ / ίϯςφؒͷ௨৴ɺͲ͏Δͷʁ ɾϗετ / ίϯςφ͕མͪͨΒͲ͏ͳΔͷʁ ɾDB
ͱ͔ϩάɺӬଓԽ͍ͨ͠σʔλͲ͏͢Δͷʁ
ͦ͜Ͱ
ECS EC2 Container Service Ͱ͢Α ɾϑϧϚωʔδυͳίϯςφΫϥελཧ ɾELB ΛͬͨαʔϏεؒ௨৴ ɾAZ Λҙࣝͨ͠Φʔτεέʔϧ
ɾIAM / CloudWatch ͱͷͱ͍͍ͯײ͡ͳ౷߹
ECS ECR ECS EC2 ᶃ docker push ᶄ λεΫఆٛ &
ɹ αʔϏεߋ৽ ᶅ ΤʔδΣϯτʹࢦࣔ ΤϯδχΞ Ϣʔβ ᶆ docker pull ᶇ σϓϩΠ ࠷খߏɿ
CON316 @ re:Invent 2016 State of the Union: Containers https://www.youtube.com/watch?v=UR8BI2Exkbc
ɾECS ͷΈɺϢʔεέʔε ɾϢʔβར༻ࣄྫʢAmazonɺNetflixɺmapboxɾɾʣ
Docker ίϯςφཧ ϑϧϚωʔδυք۾
EC2 Container Service (ECS) Google Container Engine (GKE) Azure Container
Service (ACS) based on ಠࣗ + Blox Kubernetes Docker swarm or DC / OS or Kubernetes unit λεΫ Pod Service or Pod Google Cloud Platform
CON303 @ re:Invent 2016 Introduction to Container Management on AWS
https://www.youtube.com/watch?v=nkguMBVsRbE ɾίϯςφΦʔέετϨʔγϣϯͷ 3 ཁૉɿ αʔϏεཧ / εέδϡʔϦϯά / Ϧιʔεཧ ɾECS / Kubernetes / Mesos / Docker Datacenter ͦΕͧΕͷಛͱϢʔεέʔεΛհ
͓͞Β͍͓ΘΓ
ͦΕͰ
re:Invent લޙͷൃදͬͯ Ͳ͏ͩͬͨͷʁ
Amazon ECS
ECS Ξοϓσʔτ ϦϦʔεࡁΈ + ۙͷ༧ఆ ɾWindows ίϯςφ ɾλεΫͷஔʮ੍ʯͷ֦ு ɾλεΫͷஔʮઓུʯͷ࣮ ɾΠϕϯτετϦʔϜ
ɾBlox new! new! coming soon! coming soon! β ఏڙத
Windows ίϯςφ ݱࡏ β ѻ͍ͰαʔϏεఏڙதɻ http://docs.aws.amazon.com/ja_jp/AmazonECS/latest/developerguide/ECS_Windows.html ɾWindows Server 2016 +
Windows ༻ ECS ΤʔδΣϯτ ɾͪΖΜ Linux ΠϯελϯεͰಈ͔ͳ͍ ɾຊ൪ڥͰΘͳ͍ͰͶ ɾҙॻ͖͍ͬͺ͍͋Δ
λεΫͷஔʮ੍ʯͷ֦ு طଘͷϦιʔε੍ʹՃ͑ͯɺҎԼࢦఆͰ͖Δɻ ɾAMI-IDɺAZɺInstanceTypeɺΧελϜଐੑ ྫ) attribute:ecs.instance-type == g2.2xlarge ɾஔީิͱͳΔϗετΛΑΓҰߜΓࠐΊΔ Coming soon!
λεΫͷஔʮઓུʯͷ࣮ ߜΓࠐΜͩϗετͷ͏ͪɺͲΕʹஔ͢Δ͔ɻ ɾBinpackingɺSpreadɺAffinityɺDistinct Instance ɾ͜ΕΛΈ߹Θͤͯ͑Δ ྫ) AZ Ͱ Spread ্ͨ͠Ͱ
Binpack Coming soon!
ECS ΠϕϯτετϦʔϜ λεΫͱΠϯελϯεͷঢ়ଶߋ৽௨ɻ ɾCloudWatch Events ʹྲྀΕΔঢ়ଶมԽΛτϦΨʹ ɾLambda / Kinesis /
SQS / SNS Λىಈ͢Δ ɾαʔϏεσΟεΧόϦো௨ͳͲ ྫ) ASG ʹϗετ͕Ճ͞ΕͨΒ Datadog ίϯςφىಈ
ΠϕϯτετϦʔϜΛͬͨ OSS ͷεέδϡʔϥɻ ɾECS ͷΧελϜεέδϡʔϥΛΈΜͳͷྗͰʂ ɾBlox ࣗΛαʔϏεͱͯ͠ಈ͔͢ඞཁ͋Γ Blox
CON307 @ re:Invent 2016 Advanced Task Scheduling with Amazon ECS
and Blox https://www.youtube.com/watch?v=nkguMBVsRbE ɾECS ͷ৽ػೳ܈ͷհ ɾ৽͍͠λεΫஔͷίϚϯυΛަ͑ͨ۩ମྫ
AWS Batch
AWS Batch ɾϑϧϚωʔδυ όονδϣϒ࣮ߦڥ ɾγΣϧɺLinux ࣮ߦϑΝΠϧɺDocker Πϝʔδ ɾฒྻδϣϒαϙʔτ ɾ༏ઌ͖δϣϒΩϡʔ ɾϫʔΫϑϩʔΤϯδϯͷαϙʔτ
AWS Batch ɾECS ্ʹߏங͞ΕΔ - ECS ͷϦιʔεཧػೳ͕׆͔ͤΔ - ECS ͷίϯςφஔػೳ͕׆͔ͤΔ
- ༏ΕͨՄ༻ੑɺ֦ுੑ - δϣϒ͝ͱͷదͳݖݶཧ ɾGlue EFS ͱͷΈ߹Θͤॏཁ
CON316: State of the Union: Containers ΑΓ https://www.youtube.com/watch?v=UR8BI2Exkbc
ଓ͖໌
ECS Λத৺ʹɺίϯςφ·ΘΓͷ࠷৽ใΛ͓ಧ͚ʂ http://jawsug-container.connpass.com/
ίϯςφ ָ͍͠Ͱ͢Ͷʂʂ
͓ΘΓ
גࣜձࣾεϐϯϑ ΞΠσΟΞΛ͔ͨͪʹʂ +
http://prtimes.jp/main/html/rd/p/000000007.000007768.html Comfy for Docker ϓϩδΣΫτͷ Docker ಋೖɾ։ൃࢧԉɾӡ༻ࢹߦΛ͍ͨ͠·͢ɻ ʢGCP / Azure
ͪΖΜରԠ͍ͯ͠·͢ɾɾʣ https://www.supinf.co.jp/service/dockersupport/
͝૬ஊ͓ؾܰʹͪ͜Β·Ͱ.. 44 <Thank you !! https://www.supinf.co.jp/service/dockersupport/