$30 off During Our Annual Pro Sale. View Details »
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
20-minutes-ecs-batch
Search
ryo nakamaru
December 13, 2016
Technology
0
460
20-minutes-ecs-batch
re:Port 2016 大阪での登壇資料です
ryo nakamaru
December 13, 2016
Tweet
Share
More Decks by ryo nakamaru
See All by ryo nakamaru
AWSで楽をするサービスメッシュ入門/appmesh-trial
pottava
1
1.6k
reinforce-2019-recap-lt
pottava
2
4.1k
ScaleShift-jp-2019-summer
pottava
1
220
Firecracker とは何か/what is Firecracker
pottava
12
5.5k
ハイブリッド並列 on Kubernetes/hybrid-parallel-program-on-kubernetes
pottava
1
440
AWS Fargate + Code 兄弟で始める継続的デリバリー / Continuous Delivery with AWS Fargate and Code brothers
pottava
12
3.3k
Singularity と NVIDIA GPU Cloud で作る ハイブリッド機械学習環境の構築 / Building a hybrid environment for Machine Learning with Singularity and NGC
pottava
3
1.4k
明日から始めるちょい足し λ / get-started-with-aws-lambda
pottava
4
2.5k
NGC と Singularity によるハイブリッド機械学習環境 / A hybrid environment for Machine Learning with NGC and Singularity
pottava
0
510
Other Decks in Technology
See All in Technology
Lessons from Migrating to OpenSearch: Shard Design, Log Ingestion, and UI Decisions
sansantech
PRO
1
130
[CMU-DB-2025FALL] Apache Fluss - A Streaming Storage for Real-Time Lakehouse
jark
0
120
エンジニアリングをやめたくないので問い続ける
estie
2
1.2k
MapKitとオープンデータで実現する地図情報の拡張と可視化
zozotech
PRO
1
140
5分で知るMicrosoft Ignite
taiponrock
PRO
0
380
Jakarta Agentic AI Specification - Status and Future
reza_rahman
0
110
文字列の並び順 / Unicode Collation
tmtms
3
590
RAG/Agent開発のアップデートまとめ
taka0709
0
180
Gemini でコードレビュー知見を見える化
zozotech
PRO
1
260
LLM-Readyなデータ基盤を高速に構築するためのアジャイルデータモデリングの実例
kashira
0
250
Haskell を武器にして挑む競技プログラミング ─ 操作的思考から意味モデル思考へ
naoya
6
1.5k
WordPress は終わったのか ~今のWordPress の制作手法ってなにがあんねん?~ / Is WordPress Over? How We Build with WordPress Today
tbshiki
1
780
Featured
See All Featured
Navigating Team Friction
lara
191
16k
How to Think Like a Performance Engineer
csswizardry
28
2.4k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
12
970
Bootstrapping a Software Product
garrettdimon
PRO
307
120k
Building an army of robots
kneath
306
46k
Fireside Chat
paigeccino
41
3.7k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
1.1k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
508
140k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
25
1.6k
Unsuck your backbone
ammeep
671
58k
How GitHub (no longer) Works
holman
316
140k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
35
3.3k
Transcript
20 ͰΘ͔Δ ECS / Batch AWS re:Invent ࢀՃใࠂ re:Port 2016
@ 2016.12.13
@pottava SUPINF Inc.
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α ɹͦ͏Ͱͳ͍͚Ͳɻ
ࠓͷྲྀΕ 1. Docker / ECS ͷ͓͞Β͍গʑ 2. ͦͷ্Ͱ re:Invent લޙͷൃදͬͯͲ͏ͩͬͨͷʁ
Dockerͱ
Docker OS ԾԽͷͻͱͭͷํ๏ɻ 1. ιϑτΣΞΛ Docker Πϝʔδʹ·ͱΊ͓͖ͯ 2. ϗετϚγϯͰ Docker
ίϯςφͱͯ͠ىಈ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ͳ݁Ռ ɾ࣮ߦڥʹґଘ͠ͳ͍Έ͕Ͱ͖Δ ɾൺֱత؆୯ʹϦιʔεར༻ޮΛվળͰ͖Δ ɾόʔδϣϯཧ͕༰қʹ ɾ..
Α͛͞Ͱ͢Ͷ
୯Ұϗετ·Ͱͳ
Docker ͷΈ ɾෳϗετͰಈ͔ͦ͏ͱ͢Δͱӡ༻͍͠ ɾϗετ / ίϯςφؒͷ௨৴ɺͲ͏Δͷʁ ɾϗετ / ίϯςφ͕མͪͨΒͲ͏ͳΔͷʁ ɾDB
ͱ͔ϩάɺӬଓԽ͍ͨ͠σʔλͲ͏͢Δͷʁ
ͦ͜Ͱ
ECS EC2 Container Service Ͱ͢Α ɾϑϧϚωʔδυͳίϯςφΫϥελཧ ɾELB ΛͬͨαʔϏεؒ௨৴ ɾAZ Λҙࣝͨ͠Φʔτεέʔϧ
ɾIAM / CloudWatch ͱͷͱ͍͍ͯײ͡ͳ౷߹
ECS ECR ECS EC2 ᶃ docker push ᶄ λεΫఆٛ &
ɹ αʔϏεߋ৽ ᶅ ΤʔδΣϯτʹࢦࣔ ΤϯδχΞ Ϣʔβ ᶆ docker pull ᶇ σϓϩΠ ࠷খߏɿ
CON316 @ re:Invent 2016 State of the Union: Containers https://www.youtube.com/watch?v=UR8BI2Exkbc
ɾECS ͷΈɺϢʔεέʔε ɾϢʔβར༻ࣄྫʢAmazonɺNetflixɺmapboxɾɾʣ
Docker ίϯςφཧ ϑϧϚωʔδυք۾
EC2 Container Service (ECS) Google Container Engine (GKE) Azure Container
Service (ACS) based on ಠࣗ + Blox Kubernetes Docker swarm or DC / OS or Kubernetes unit λεΫ Pod Service or Pod Google Cloud Platform
CON303 @ re:Invent 2016 Introduction to Container Management on AWS
https://www.youtube.com/watch?v=nkguMBVsRbE ɾίϯςφΦʔέετϨʔγϣϯͷ 3 ཁૉɿ αʔϏεཧ / εέδϡʔϦϯά / Ϧιʔεཧ ɾECS / Kubernetes / Mesos / Docker Datacenter ͦΕͧΕͷಛͱϢʔεέʔεΛհ
͓͞Β͍͓ΘΓ
ͦΕͰ
re:Invent લޙͷൃදͬͯ Ͳ͏ͩͬͨͷʁ
Amazon ECS
ECS Ξοϓσʔτ ϦϦʔεࡁΈ + ۙͷ༧ఆ ɾWindows ίϯςφ ɾλεΫͷஔʮ੍ʯͷ֦ு ɾλεΫͷஔʮઓུʯͷ࣮ ɾΠϕϯτετϦʔϜ
ɾBlox new! new! coming soon! coming soon! β ఏڙத
Windows ίϯςφ ݱࡏ β ѻ͍ͰαʔϏεఏڙதɻ http://docs.aws.amazon.com/ja_jp/AmazonECS/latest/developerguide/ECS_Windows.html ɾWindows Server 2016 +
Windows ༻ ECS ΤʔδΣϯτ ɾͪΖΜ Linux ΠϯελϯεͰಈ͔ͳ͍ ɾຊ൪ڥͰΘͳ͍ͰͶ ɾҙॻ͖͍ͬͺ͍͋Δ
λεΫͷஔʮ੍ʯͷ֦ு طଘͷϦιʔε੍ʹՃ͑ͯɺҎԼࢦఆͰ͖Δɻ ɾAMI-IDɺAZɺInstanceTypeɺΧελϜଐੑ ྫ) attribute:ecs.instance-type == g2.2xlarge ɾஔީิͱͳΔϗετΛΑΓҰߜΓࠐΊΔ Coming soon!
λεΫͷஔʮઓུʯͷ࣮ ߜΓࠐΜͩϗετͷ͏ͪɺͲΕʹஔ͢Δ͔ɻ ɾBinpackingɺSpreadɺAffinityɺDistinct Instance ɾ͜ΕΛΈ߹Θͤͯ͑Δ ྫ) AZ Ͱ Spread ্ͨ͠Ͱ
Binpack Coming soon!
ECS ΠϕϯτετϦʔϜ λεΫͱΠϯελϯεͷঢ়ଶߋ৽௨ɻ ɾCloudWatch Events ʹྲྀΕΔঢ়ଶมԽΛτϦΨʹ ɾLambda / Kinesis /
SQS / SNS Λىಈ͢Δ ɾαʔϏεσΟεΧόϦো௨ͳͲ ྫ) ASG ʹϗετ͕Ճ͞ΕͨΒ Datadog ίϯςφىಈ
ΠϕϯτετϦʔϜΛͬͨ OSS ͷεέδϡʔϥɻ ɾECS ͷΧελϜεέδϡʔϥΛΈΜͳͷྗͰʂ ɾBlox ࣗΛαʔϏεͱͯ͠ಈ͔͢ඞཁ͋Γ Blox
CON307 @ re:Invent 2016 Advanced Task Scheduling with Amazon ECS
and Blox https://www.youtube.com/watch?v=nkguMBVsRbE ɾECS ͷ৽ػೳ܈ͷհ ɾ৽͍͠λεΫஔͷίϚϯυΛަ͑ͨ۩ମྫ
AWS Batch
AWS Batch ɾϑϧϚωʔδυ όονδϣϒ࣮ߦڥ ɾγΣϧɺLinux ࣮ߦϑΝΠϧɺDocker Πϝʔδ ɾฒྻδϣϒαϙʔτ ɾ༏ઌ͖δϣϒΩϡʔ ɾϫʔΫϑϩʔΤϯδϯͷαϙʔτ
AWS Batch ɾECS ্ʹߏங͞ΕΔ - ECS ͷϦιʔεཧػೳ͕׆͔ͤΔ - ECS ͷίϯςφஔػೳ͕׆͔ͤΔ
- ༏ΕͨՄ༻ੑɺ֦ுੑ - δϣϒ͝ͱͷదͳݖݶཧ ɾGlue EFS ͱͷΈ߹Θͤॏཁ
CON316: State of the Union: Containers ΑΓ https://www.youtube.com/watch?v=UR8BI2Exkbc
ଓ͖໌
ECS Λத৺ʹɺίϯςφ·ΘΓͷ࠷৽ใΛ͓ಧ͚ʂ http://jawsug-container.connpass.com/
ίϯςφ ָ͍͠Ͱ͢Ͷʂʂ
͓ΘΓ
גࣜձࣾεϐϯϑ ΞΠσΟΞΛ͔ͨͪʹʂ +
http://prtimes.jp/main/html/rd/p/000000007.000007768.html Comfy for Docker ϓϩδΣΫτͷ Docker ಋೖɾ։ൃࢧԉɾӡ༻ࢹߦΛ͍ͨ͠·͢ɻ ʢGCP / Azure
ͪΖΜରԠ͍ͯ͠·͢ɾɾʣ https://www.supinf.co.jp/service/dockersupport/
͝૬ஊ͓ؾܰʹͪ͜Β·Ͱ.. 44 <Thank you !! https://www.supinf.co.jp/service/dockersupport/