Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
re:Invent2016で発表された新サービス「AWS Batch」を使う想像をしてみた話 ...
Search
Shimizu Toshiya
December 06, 2016
0
1.5k
re:Invent2016で発表された新サービス「AWS Batch」を使う想像をしてみた話 #cmdevio
Shimizu Toshiya
December 06, 2016
Tweet
Share
More Decks by Shimizu Toshiya
See All by Shimizu Toshiya
サイト高速化のためのCloudFront導入と活用
shimizutoshiya
0
820
AKIBA.AWS #12 Cloudinaryで画像や動画配信を最適化しよう「デイリーポータルZでのCloudinary導入に向けての検証について」
shimizutoshiya
1
1k
「Web担当者Forum安田編集統括が訊く デイリーポータルZのサイトリニューアル裏話ぜんぶ」インフラ編 #dpz裏話
shimizutoshiya
0
2.7k
Developers.IO 2018「AWSのマネージドサービスを使ってはじめる動画配信」
shimizutoshiya
1
1.2k
AKIBA.AWS 第4回 基礎編 動画配信入門「AWSではじめるライブ動画配信入門」
shimizutoshiya
2
1.3k
AKIBA.aws 第1回 基礎編「AWSのDNS」 #akibaaws
shimizutoshiya
4
2.6k
Featured
See All Featured
Building Flexible Design Systems
yeseniaperezcruz
328
39k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
139
34k
Faster Mobile Websites
deanohume
309
31k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
33
2.4k
Making Projects Easy
brettharned
117
6.3k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
44
2.4k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.8k
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
36
2.5k
StorybookのUI Testing Handbookを読んだ
zakiyama
30
6k
Navigating Team Friction
lara
189
15k
Done Done
chrislema
185
16k
Transcript
re:Invent2016Ͱൃද͞Εͨ৽αʔϏε ʮAWS BatchʯΛ͏૾Λͯ͠Έͨ re:Growth2016 TOKYO 1 2016/12/07 @SAPδϟύϯ ਗ਼ਫ ढ़
#cmdevio
ࣗݾհ • ਗ਼ਫ ढ़ʢ͠Έͣ ͱ͠ʣ • AWSίϯαϧςΟϯά෦ॴଐ • ಘҙ –
ಈը৴ – Amazon Elastic Transcoder • ϞοζͷγϯϘϧϚʔΫ͕ΞΠίϯͰ͢ – ͚ͲϞοζ͖ͷόϯυ͕͖ͰϞοζৄ͘͠ͳ͍ 2
AWS Batch • ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε 3
AWS Batchͬͯ͏͑Δͷʁ • όʔδχΞϦʔδϣϯʹͯϓϨϏϡʔར༻։࢝ – ࢲ·ͩ͑Δঢ়گʹ͋Γ·ͤΜ • ຊൃදʹ͍ͭͯʮͬͯΈͨʯͰͳ͘ʮͬ ͨ૾Λͯ͠ΈͨʯͰ͢ɻɻɻ •
ߏཁૉΛ֬ೝ͠ͳ͕ΒɺAWS BatchΛಈ͔ͨ͠ ؾʹͳͬͯΈ·͠ΐ͏ 4
AWS Batchͷใݯ • AWSެࣜϖʔδ • AWSެࣜϒϩά(AWS Batch – AWSͰόονॲཧδϣϒΛ࣮ߦ͢Δ) •
re:Invent2016 Breakout Session • CMP323 - NEW LAUNCH! Introducing AWS Batch: Easy and efficient batch computing on Amazon Web Services • ηογϣϯಈը(YouTube) • re:invent2016 cmp323 ͱ͔Ͱݕࡧ͢Δͱग़͖ͯ·͢ • ຊൃදͪ͜Βͷϒϩά/ηογϣϯΛେ͍ʹࢀߟʹ͠ ͍ͯ·͢ 5
ͱ͜ΖͰAWS BatchͷγϯϓϧΞΠίϯʁ • CMP323 Introducing AWS BatchͷηογϣϯಈըΑΓҾ༻ 6
AWS Batchͷ4ͭͷߏཁૉ • ͜ΕΒͷ֓ཁΛԡ͑͞ͳ͕ΒAWS BatchΛ͏૾Λͯ͠ΈΑ͏ 7 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ
δϣϒ C4 C4 R3 C4 R3 R3 R3
1. ίϯϐϡʔςΟϯάڥͷ࡞ 8 C4 ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4 R3
R3 R3
1. ίϯϐϡʔςΟϯάڥͷ࡞ • ίϯϐϡʔςΟϯάڥʢCompute Environmentʣ – όονͷδϣϒΛ࣮ߦ͢ΔॴʢϦιʔεʣ – AWSʹཧͤ͞Δ͔ɺࣗલͰཧ͢Δ͔ •
Managed / Unmanaged – ΠϯελϯελΠϓͳͲͷࢦఆ • ಛఆϞσϧc4.2xlarge/m4.10xlarge • ΠϯελϯεϑΝϛϦʔࢦఆʢc5 family) – ΦϯσϚϯυΠϯελϯε/εϙοτΠϯελϯεͷࢦఆ – vCPUͷׂʢ࠷খɺرɺ࠷େʣ – VPCɺSubnetɺSecurity GroupɺIAMϩʔϧ 9
1. ίϯϐϡʔςΟϯάڥͷ࡞ 10 C4 ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4 R3
R3 R3
2. δϣϒΩϡʔͷ࡞ 11 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4
R3 R3 R3
2. δϣϒΩϡʔͷ࡞ • δϣϒΩϡʔʢJob Queueʣ – ίϯϐϡʔςΟϯάڥʹεέδϡʔϧ͞ΕΔ· Ͱδϣϒ͕ฒͿ – ࡞࣌ʹίϯϐϡʔςΟϯάڥΛࢦఆ
• ෳࢦఆ͕Մೳ – ΦϯσϚϯυͷίϯϐϡʔςΟϯάڥ – εϙοτͷίϯϐϡʔςΟϯάڥ » ೖࡳͰ͖ͨͱ͖͚ͩ༻Մೳ 12
2. δϣϒΩϡʔͷ࡞ 13 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4
R3 R3 R3
3. δϣϒఆٛͷ࡞ 14 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ C4 C4 R3
C4 R3 R3 R3
3. δϣϒఆٛͷ࡞ • δϣϒఆٛʢJob Definitionsʣ – δϣϒͷ࣮ߦํ๏Λࢦఆ͢Δ • ࢦఆͰ͖ΔଐੑʢͷҰ෦ʣ –
δϣϒʹؔ࿈͚ΔIAMϩʔϧ – ґଘ͢Δδϣϒ – vCPUɺϝϞϦ – ίϯςφͷϓϩύςΟ – ڥม 15
3. δϣϒఆٛͷ࡞ 16 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ C4 C4 R3
C4 R3 R3 R3
4. δϣϒͷ࡞ 17 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ δϣϒ C4 C4
R3 C4 R3 R3 R3
4. δϣϒͷ࡞ • δϣϒʢJobsʣ – AWS Batchʹૹ৴͢Δ࡞ۀ୯Ґ • γΣϧεΫϦϓτɺLinux࣮ߦՄೳϑΝΠϧɺίϯςφΠϝʔδ –
EC2্ͷίϯςφԽ͞ΕͨΞϓϦέʔγϣϯͱ࣮ͯ͠ߦ͞ΕΔ – ໊લ·ͨIDͰଞͷδϣϒΛࢀরՄೳ – ଞͷδϣϒͷਖ਼ৗऴྃʹґଘՄೳ – δϣϒఆ͔ٛΒύϥϝʔλΛมߋՄೳ – αϒϛοτ͢ΔͱδϣϒΩϡʔʹฒͼɺ࣮ߦ͞Ε͍ͯ͘ 18
4. δϣϒͷ࡞ 19 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ δϣϒ C4 C4
R3 C4 R3 R3 R3
όον͕ॲཧ͞ΕΔ 20 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ δϣϒ C4 C4 R3
C4 R3 R3 R3
AWS Batch Actions • CMP323 Introducing AWS Batch ηογϣϯࢿྉΑΓ 21
·ͱΊ • AWS Batch – ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε – ϓϨϏϡʔ։࢝தͳͷͰ͏ͱ͜ΖΛ૾ͯ͠Έͨ – ߏཁૉ4ͭ
• ίϯϐϡʔςΟϯάڥ • δϣϒΩϡʔ • δϣϒఆٛ • δϣϒ 22
23