Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
20-minutes-ecs-batch
Search
ryo nakamaru
December 13, 2016
Technology
0
440
20-minutes-ecs-batch
re:Port 2016 大阪での登壇資料です
ryo nakamaru
December 13, 2016
Tweet
Share
More Decks by ryo nakamaru
See All by ryo nakamaru
AWSで楽をするサービスメッシュ入門/appmesh-trial
pottava
1
1.3k
reinforce-2019-recap-lt
pottava
2
4.1k
ScaleShift-jp-2019-summer
pottava
1
190
Firecracker とは何か/what is Firecracker
pottava
13
5.2k
ハイブリッド並列 on Kubernetes/hybrid-parallel-program-on-kubernetes
pottava
1
400
AWS Fargate + Code 兄弟で始める継続的デリバリー / Continuous Delivery with AWS Fargate and Code brothers
pottava
12
3k
Singularity と NVIDIA GPU Cloud で作る ハイブリッド機械学習環境の構築 / Building a hybrid environment for Machine Learning with Singularity and NGC
pottava
3
1.2k
明日から始めるちょい足し λ / get-started-with-aws-lambda
pottava
4
2.4k
NGC と Singularity によるハイブリッド機械学習環境 / A hybrid environment for Machine Learning with NGC and Singularity
pottava
0
450
Other Decks in Technology
See All in Technology
軽いノリで"自動化"に取り組んではいけないという話
tetsuyaooooo
1
600
tenntennはなんでnewmoにnew社したの? - YAPC::Hakodate 2024
tenntenn
PRO
0
310
I tried the newly introduced certification "Applied Skills" on Microsoft Learn
mappie_kochi
0
250
What a Good Platform Looks Like and How to Get There @ Large Financial Organization, Oct 2024
mfpais
PRO
0
100
UE5の雑多なテク
ryuichikawano
0
440
New Relicを活用したシステム監視の強化とオブザーバビリティ向上
sugoto911
1
110
プロダクト開発の貢献をアピールするための目標設計や認知活動 / Goal design and recognition activities to promote product development contributions.
oomatomo
5
930
Microsoft 365 でデータセキュリティを強化しよう
sophiakunii
2
290
入社半年(合計1年)でGoogle Cloud 認定を全冠した秘訣🤫
risatube
1
240
The People First Approach to Engineering Success - DevNot 2024
zikriyeurkmez
0
170
Qdrant を用いた検索改善施策の紹介 / Search Engineering Tech Talk 2024 Summer
visional_engineering_and_design
1
210
O'Reilly Superstream: Building a RAG App to Chat with Your Data
pamelafox
0
120
Featured
See All Featured
Being A Developer After 40
akosma
84
590k
Art, The Web, and Tiny UX
lynnandtonic
296
20k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
225
22k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
39
2.1k
Gamification - CAS2011
davidbonilla
80
5k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
Rebuilding a faster, lazier Slack
samanthasiow
79
8.6k
Raft: Consensus for Rubyists
vanstee
136
6.6k
The Language of Interfaces
destraynor
154
24k
Designing for humans not robots
tammielis
249
25k
Designing the Hi-DPI Web
ddemaree
280
34k
ParisWeb 2013: Learning to Love: Crash Course in Emotional UX Design
dotmariusz
110
6.9k
Transcript
20 ͰΘ͔Δ ECS / Batch AWS re:Invent ࢀՃใࠂ re:Port 2016
@ 2016.12.13
@pottava SUPINF Inc.
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α
ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾɺ࣌ Docker ͢Α ɹͦ͏Ͱͳ͍͚Ͳɻ
ࠓͷྲྀΕ 1. Docker / ECS ͷ͓͞Β͍গʑ 2. ͦͷ্Ͱ re:Invent લޙͷൃදͬͯͲ͏ͩͬͨͷʁ
Dockerͱ
Docker OS ԾԽͷͻͱͭͷํ๏ɻ 1. ιϑτΣΞΛ Docker Πϝʔδʹ·ͱΊ͓͖ͯ 2. ϗετϚγϯͰ Docker
ίϯςφͱͯ͠ىಈ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΣΞͷ࣮ߦʹඞཁͳͯ͢Λύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋ΕɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ
Docker ͳ݁Ռ ɾ࣮ߦڥʹґଘ͠ͳ͍Έ͕Ͱ͖Δ ɾൺֱత؆୯ʹϦιʔεར༻ޮΛվળͰ͖Δ ɾόʔδϣϯཧ͕༰қʹ ɾ..
Α͛͞Ͱ͢Ͷ
୯Ұϗετ·Ͱͳ
Docker ͷΈ ɾෳϗετͰಈ͔ͦ͏ͱ͢Δͱӡ༻͍͠ ɾϗετ / ίϯςφؒͷ௨৴ɺͲ͏Δͷʁ ɾϗετ / ίϯςφ͕མͪͨΒͲ͏ͳΔͷʁ ɾDB
ͱ͔ϩάɺӬଓԽ͍ͨ͠σʔλͲ͏͢Δͷʁ
ͦ͜Ͱ
ECS EC2 Container Service Ͱ͢Α ɾϑϧϚωʔδυͳίϯςφΫϥελཧ ɾELB ΛͬͨαʔϏεؒ௨৴ ɾAZ Λҙࣝͨ͠Φʔτεέʔϧ
ɾIAM / CloudWatch ͱͷͱ͍͍ͯײ͡ͳ౷߹
ECS ECR ECS EC2 ᶃ docker push ᶄ λεΫఆٛ &
ɹ αʔϏεߋ৽ ᶅ ΤʔδΣϯτʹࢦࣔ ΤϯδχΞ Ϣʔβ ᶆ docker pull ᶇ σϓϩΠ ࠷খߏɿ
CON316 @ re:Invent 2016 State of the Union: Containers https://www.youtube.com/watch?v=UR8BI2Exkbc
ɾECS ͷΈɺϢʔεέʔε ɾϢʔβར༻ࣄྫʢAmazonɺNetflixɺmapboxɾɾʣ
Docker ίϯςφཧ ϑϧϚωʔδυք۾
EC2 Container Service (ECS) Google Container Engine (GKE) Azure Container
Service (ACS) based on ಠࣗ + Blox Kubernetes Docker swarm or DC / OS or Kubernetes unit λεΫ Pod Service or Pod Google Cloud Platform
CON303 @ re:Invent 2016 Introduction to Container Management on AWS
https://www.youtube.com/watch?v=nkguMBVsRbE ɾίϯςφΦʔέετϨʔγϣϯͷ 3 ཁૉɿ αʔϏεཧ / εέδϡʔϦϯά / Ϧιʔεཧ ɾECS / Kubernetes / Mesos / Docker Datacenter ͦΕͧΕͷಛͱϢʔεέʔεΛհ
͓͞Β͍͓ΘΓ
ͦΕͰ
re:Invent લޙͷൃදͬͯ Ͳ͏ͩͬͨͷʁ
Amazon ECS
ECS Ξοϓσʔτ ϦϦʔεࡁΈ + ۙͷ༧ఆ ɾWindows ίϯςφ ɾλεΫͷஔʮ੍ʯͷ֦ு ɾλεΫͷஔʮઓུʯͷ࣮ ɾΠϕϯτετϦʔϜ
ɾBlox new! new! coming soon! coming soon! β ఏڙத
Windows ίϯςφ ݱࡏ β ѻ͍ͰαʔϏεఏڙதɻ http://docs.aws.amazon.com/ja_jp/AmazonECS/latest/developerguide/ECS_Windows.html ɾWindows Server 2016 +
Windows ༻ ECS ΤʔδΣϯτ ɾͪΖΜ Linux ΠϯελϯεͰಈ͔ͳ͍ ɾຊ൪ڥͰΘͳ͍ͰͶ ɾҙॻ͖͍ͬͺ͍͋Δ
λεΫͷஔʮ੍ʯͷ֦ு طଘͷϦιʔε੍ʹՃ͑ͯɺҎԼࢦఆͰ͖Δɻ ɾAMI-IDɺAZɺInstanceTypeɺΧελϜଐੑ ྫ) attribute:ecs.instance-type == g2.2xlarge ɾஔީิͱͳΔϗετΛΑΓҰߜΓࠐΊΔ Coming soon!
λεΫͷஔʮઓུʯͷ࣮ ߜΓࠐΜͩϗετͷ͏ͪɺͲΕʹஔ͢Δ͔ɻ ɾBinpackingɺSpreadɺAffinityɺDistinct Instance ɾ͜ΕΛΈ߹Θͤͯ͑Δ ྫ) AZ Ͱ Spread ্ͨ͠Ͱ
Binpack Coming soon!
ECS ΠϕϯτετϦʔϜ λεΫͱΠϯελϯεͷঢ়ଶߋ৽௨ɻ ɾCloudWatch Events ʹྲྀΕΔঢ়ଶมԽΛτϦΨʹ ɾLambda / Kinesis /
SQS / SNS Λىಈ͢Δ ɾαʔϏεσΟεΧόϦো௨ͳͲ ྫ) ASG ʹϗετ͕Ճ͞ΕͨΒ Datadog ίϯςφىಈ
ΠϕϯτετϦʔϜΛͬͨ OSS ͷεέδϡʔϥɻ ɾECS ͷΧελϜεέδϡʔϥΛΈΜͳͷྗͰʂ ɾBlox ࣗΛαʔϏεͱͯ͠ಈ͔͢ඞཁ͋Γ Blox
CON307 @ re:Invent 2016 Advanced Task Scheduling with Amazon ECS
and Blox https://www.youtube.com/watch?v=nkguMBVsRbE ɾECS ͷ৽ػೳ܈ͷհ ɾ৽͍͠λεΫஔͷίϚϯυΛަ͑ͨ۩ମྫ
AWS Batch
AWS Batch ɾϑϧϚωʔδυ όονδϣϒ࣮ߦڥ ɾγΣϧɺLinux ࣮ߦϑΝΠϧɺDocker Πϝʔδ ɾฒྻδϣϒαϙʔτ ɾ༏ઌ͖δϣϒΩϡʔ ɾϫʔΫϑϩʔΤϯδϯͷαϙʔτ
AWS Batch ɾECS ্ʹߏங͞ΕΔ - ECS ͷϦιʔεཧػೳ͕׆͔ͤΔ - ECS ͷίϯςφஔػೳ͕׆͔ͤΔ
- ༏ΕͨՄ༻ੑɺ֦ுੑ - δϣϒ͝ͱͷదͳݖݶཧ ɾGlue EFS ͱͷΈ߹Θͤॏཁ
CON316: State of the Union: Containers ΑΓ https://www.youtube.com/watch?v=UR8BI2Exkbc
ଓ͖໌
ECS Λத৺ʹɺίϯςφ·ΘΓͷ࠷৽ใΛ͓ಧ͚ʂ http://jawsug-container.connpass.com/
ίϯςφ ָ͍͠Ͱ͢Ͷʂʂ
͓ΘΓ
גࣜձࣾεϐϯϑ ΞΠσΟΞΛ͔ͨͪʹʂ +
http://prtimes.jp/main/html/rd/p/000000007.000007768.html Comfy for Docker ϓϩδΣΫτͷ Docker ಋೖɾ։ൃࢧԉɾӡ༻ࢹߦΛ͍ͨ͠·͢ɻ ʢGCP / Azure
ͪΖΜରԠ͍ͯ͠·͢ɾɾʣ https://www.supinf.co.jp/service/dockersupport/
͝૬ஊ͓ؾܰʹͪ͜Β·Ͱ.. 44 <Thank you !! https://www.supinf.co.jp/service/dockersupport/