20-minutes-ecs-batch - Speaker Deck

20-minutes-ecs-batch

by ryo nakamaru

Slide 1

Slide 1 text

20 ෼ͰΘ͔Δ ECS / Batch AWS re:Invent ࢀՃใࠂ re:Port 2016 @ 2016.12.13

Slide 2

Slide 2 text

@pottava SUPINF Inc.

Slide 3

Slide 3 text

ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾ௕ɺ࣌୅͸ Docker ͢Α

Slide 4

Slide 4 text

ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷίϯςφܥαʔϏεͳΒԶʹฉ͚ ɾࣾ௕ɺ࣌୅͸ Docker ͢Α ɹͦ͏Ͱ΋ͳ͍͚Ͳɻ

Slide 5

Slide 5 text

ࠓ೔ͷྲྀΕ 1. Docker / ECS ͷ͓͞Β͍গʑ 2. ͦͷ্Ͱ re:Invent લޙͷൃදͬͯͲ͏ͩͬͨͷʁ

Slide 6

Slide 6 text

Dockerͱ͸

Slide 7

Slide 7 text

Docker OS Ծ૝Խͷͻͱͭͷํ๏ɻ 1. ιϑτ΢ΣΞΛ Docker Πϝʔδʹ·ͱΊ͓͖ͯ 2. ϗετϚγϯͰ Docker ίϯςφͱͯ͠ىಈ

Slide 8

Slide 8 text

Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΢ΣΞͷ࣮ߦʹඞཁͳ͢΂ͯΛύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ

Slide 9

Slide 9 text

Docker Πϝʔδ ιʔείʔυɺϥϯλΠϜɺϥΠϒϥϦͳͲɺιϑτ ΢ΣΞͷ࣮ߦʹඞཁͳ͢΂ͯΛύοέʔδʹ·ͱΊɺ ࣋ͪӡͿ͜ͱ͕Ͱ͖·͢ɻ

Slide 10

Slide 10 text

Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯ΋ɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋Ε͹ɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ

Slide 11

Slide 11 text

Docker ίϯςφ OS ͕ͳΜͰ͋ͬͯ΋ɺDocker ͷΠϯετʔϧ͞Εͨ ϗετͰ͋Ε͹ɺDocker Πϝʔδʹ·ͱΊΒΕͨ ΞϓϦέʔγϣϯΛ؆୯ɾܰշʹىಈͰ͖·͢ɻ

Slide 12

Slide 12 text

Docker ͳ݁Ռ ɾ࣮ߦ؀ڥʹґଘ͠ͳ͍࢓૊Έ͕Ͱ͖Δ ɾൺֱత؆୯ʹϦιʔεར༻ޮ཰ΛվળͰ͖Δ ɾόʔδϣϯ؅ཧ͕༰қʹ ɾ..

Slide 13

Slide 13 text

Α͛͞Ͱ͢Ͷ

Slide 14

Slide 14 text

୯Ұϗετ·Ͱ͸ͳ

Slide 15

Slide 15 text

Docker ͷ೰Έ ɾෳ਺ϗετͰಈ͔ͦ͏ͱ͢Δͱӡ༻೉͍͠ ɾϗετ / ίϯςφؒͷ௨৴ɺͲ͏΍Δͷʁ ɾϗετ / ίϯςφ͕མͪͨΒͲ͏ͳΔͷʁ ɾDB ͱ͔ϩάɺӬଓԽ͍ͨ͠σʔλ͸Ͳ͏͢Δͷʁ

Slide 16

Slide 16 text

ͦ͜Ͱ

Slide 17

Slide 17 text

ECS EC2 Container Service Ͱ͢Α ɾϑϧϚωʔδυͳίϯςφΫϥελ؅ཧ ɾELB Λ࢖ͬͨαʔϏεؒ௨৴ ɾAZ Λҙࣝͨ͠Φʔτεέʔϧ ɾIAM / CloudWatch ͱͷͱͯ΋͍͍ײ͡ͳ౷߹

Slide 18

Slide 18 text

ECS ECR ECS EC2 ᶃ docker push ᶄ λεΫఆٛ & ɹ αʔϏεߋ৽ ᶅ ΤʔδΣϯτʹࢦࣔ ΤϯδχΞ Ϣʔβ ᶆ docker pull ᶇ σϓϩΠ ࠷খߏ੒ɿ

Slide 19

Slide 19 text

CON316 @ re:Invent 2016 State of the Union: Containers https://www.youtube.com/watch?v=UR8BI2Exkbc ɾECS ͷ࢓૊ΈɺϢʔεέʔε ɾϢʔβར༻ࣄྫʢAmazonɺNetﬂixɺmapboxɾɾʣ

Slide 20

Slide 20 text

Docker ίϯςφ؅ཧ ϑϧϚωʔδυք۾

Slide 21

Slide 21 text

EC2 Container Service (ECS) Google Container Engine (GKE) Azure Container Service (ACS) based on ಠࣗ + Blox Kubernetes Docker swarm or DC / OS or Kubernetes unit λεΫ Pod Service or Pod Google Cloud Platform

Slide 22

Slide 22 text

CON303 @ re:Invent 2016 Introduction to Container Management on AWS https://www.youtube.com/watch?v=nkguMBVsRbE ɾίϯςφΦʔέετϨʔγϣϯͷ 3 ཁૉɿ αʔϏε؅ཧ / εέδϡʔϦϯά / Ϧιʔε؅ཧ ɾECS / Kubernetes / Mesos / Docker Datacenter ͦΕͧΕͷಛ௃ͱϢʔεέʔεΛ঺հ

Slide 23

Slide 23 text

͓͞Β͍͓ΘΓ

Slide 24

Slide 24 text

ͦΕͰ

Slide 25

Slide 25 text

re:Invent લޙͷൃදͬͯ Ͳ͏ͩͬͨͷʁ

Slide 26

Slide 26 text

Amazon ECS

Slide 27

Slide 27 text

ECS Ξοϓσʔτ ϦϦʔεࡁΈ + ௚ۙͷ༧ఆ ɾWindows ίϯςφ ɾλεΫͷ഑ஔʮ੍໿ʯͷ֦ு ɾλεΫͷ഑ஔʮઓུʯͷ࣮૷ ɾΠϕϯτετϦʔϜ ɾBlox new! new! coming soon! coming soon! β ఏڙத

Slide 28

Slide 28 text

Windows ίϯςφ ݱࡏ β ѻ͍ͰαʔϏεఏڙதɻ http://docs.aws.amazon.com/ja_jp/AmazonECS/latest/developerguide/ECS_Windows.html ɾWindows Server 2016 + Windows ༻ ECS ΤʔδΣϯτ ɾ΋ͪΖΜ Linux ΠϯελϯεͰ͸ಈ͔ͳ͍ ɾຊ൪؀ڥͰ͸࢖Θͳ͍ͰͶ ɾ஫ҙॻ͖͍ͬͺ͍͋Δ

Slide 29

Slide 29 text

λεΫͷ഑ஔʮ੍໿ʯͷ֦ு طଘͷϦιʔε੍໿ʹՃ͑ͯɺҎԼ΋ࢦఆͰ͖Δɻ ɾAMI-IDɺAZɺInstanceTypeɺΧελϜଐੑ ྫ) attribute:ecs.instance-type == g2.2xlarge ɾ഑ஔީิͱͳΔϗετΛΑΓҰ૚ߜΓࠐΊΔ Coming soon!

Slide 30

Slide 30 text

λεΫͷ഑ஔʮઓུʯͷ࣮૷ ߜΓࠐΜͩϗετͷ͏ͪɺͲΕʹ഑ஔ͢Δ͔ɻ ɾBinpackingɺSpreadɺAfﬁnityɺDistinct Instance ɾ͜ΕΛ૊Έ߹Θͤͯ࢖͑Δ ྫ) AZ Ͱ Spread ্ͨ͠Ͱ Binpack Coming soon!

Slide 31

Slide 31 text

ECS ΠϕϯτετϦʔϜ λεΫͱΠϯελϯεͷঢ়ଶߋ৽௨஌ɻ ɾCloudWatch Events ʹྲྀΕΔঢ়ଶมԽΛτϦΨʹ ɾLambda / Kinesis / SQS / SNS Λىಈ͢Δ ɾαʔϏεσΟεΧόϦ΍ো֐௨஌ͳͲ ྫ) ASG ʹϗετ͕௥Ճ͞ΕͨΒ Datadog ίϯςφىಈ

Slide 32

Slide 32 text

ΠϕϯτετϦʔϜΛ࢖ͬͨ OSS ͷεέδϡʔϥɻ ɾECS ͷΧελϜεέδϡʔϥΛΈΜͳͷྗͰʂ ɾBlox ࣗ਎ΛαʔϏεͱͯ͠ಈ͔͢ඞཁ͋Γ Blox

Slide 33

Slide 33 text

CON307 @ re:Invent 2016 Advanced Task Scheduling with Amazon ECS and Blox https://www.youtube.com/watch?v=nkguMBVsRbE ɾECS ͷ৽ػೳ܈ͷ঺հ ɾ৽͍͠λεΫ഑ஔͷίϚϯυΛަ͑ͨ۩ମྫ

Slide 34

Slide 34 text

AWS Batch

Slide 35

Slide 35 text

AWS Batch ɾϑϧϚωʔδυ όονδϣϒ࣮ߦ؀ڥ ɾγΣϧɺLinux ࣮ߦϑΝΠϧɺDocker Πϝʔδ ɾฒྻδϣϒαϙʔτ ɾ༏ઌ౓෇͖δϣϒΩϡʔ ɾϫʔΫϑϩʔΤϯδϯͷαϙʔτ

Slide 36

Slide 36 text

AWS Batch ɾECS ্ʹߏங͞ΕΔ - ECS ͷϦιʔε؅ཧػೳ͕׆͔ͤΔ - ECS ͷίϯςφ഑ஔػೳ͕׆͔ͤΔ - ༏ΕͨՄ༻ੑɺ֦ுੑ - δϣϒ͝ͱͷద੾ͳݖݶ؅ཧ ɾGlue ΍ EFS ͱͷ૊Έ߹Θͤ΋ॏཁ

Slide 37

Slide 37 text

CON316: State of the Union: Containers ΑΓ https://www.youtube.com/watch?v=UR8BI2Exkbc

Slide 38

Slide 38 text

ଓ͖͸໌೔

Slide 39

Slide 39 text

ECS Λத৺ʹɺίϯςφ·ΘΓͷ࠷৽৘ใΛ͓ಧ͚ʂ http://jawsug-container.connpass.com/

Slide 40

Slide 40 text

ίϯςφ ΋ָ͍͠Ͱ͢Ͷʂʂ

Slide 41

Slide 41 text

͓ΘΓ

Slide 42

Slide 42 text

גࣜձࣾεϐϯϑ ΞΠσΟΞΛ͔ͨͪʹʂ +

Slide 43

Slide 43 text

http://prtimes.jp/main/html/rd/p/000000007.000007768.html Comfy for Docker ϓϩδΣΫτ΁ͷ Docker ಋೖɾ։ൃࢧԉɾӡ༻؂ࢹ୅ߦΛ͍ͨ͠·͢ɻ ʢGCP / Azure ΋΋ͪΖΜରԠ͍ͯ͠·͢ɾɾʣ https://www.supinf.co.jp/service/dockersupport/

Slide 44

Slide 44 text

͝૬ஊ͸͓ؾܰʹͪ͜Β·Ͱ.. 44