Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
re:Invent2016で発表された新サービス「AWS Batch」を使う想像をしてみた話 ...
Search
Shimizu Toshiya
December 06, 2016
0
1.5k
re:Invent2016で発表された新サービス「AWS Batch」を使う想像をしてみた話 #cmdevio
Shimizu Toshiya
December 06, 2016
Tweet
Share
More Decks by Shimizu Toshiya
See All by Shimizu Toshiya
サイト高速化のためのCloudFront導入と活用
shimizutoshiya
0
840
AKIBA.AWS #12 Cloudinaryで画像や動画配信を最適化しよう「デイリーポータルZでのCloudinary導入に向けての検証について」
shimizutoshiya
1
1k
「Web担当者Forum安田編集統括が訊く デイリーポータルZのサイトリニューアル裏話ぜんぶ」インフラ編 #dpz裏話
shimizutoshiya
0
2.7k
Developers.IO 2018「AWSのマネージドサービスを使ってはじめる動画配信」
shimizutoshiya
1
1.2k
AKIBA.AWS 第4回 基礎編 動画配信入門「AWSではじめるライブ動画配信入門」
shimizutoshiya
2
1.3k
AKIBA.aws 第1回 基礎編「AWSのDNS」 #akibaaws
shimizutoshiya
4
2.6k
Featured
See All Featured
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4k
Scaling GitHub
holman
463
140k
GitHub's CSS Performance
jonrohan
1032
470k
Context Engineering - Making Every Token Count
addyosmani
6
260
Balancing Empowerment & Direction
lara
4
690
Building Applications with DynamoDB
mza
96
6.7k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
980
Building an army of robots
kneath
306
46k
jQuery: Nuts, Bolts and Bling
dougneiner
65
7.9k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
37
2.6k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
8
910
GraphQLの誤解/rethinking-graphql
sonatard
73
11k
Transcript
re:Invent2016Ͱൃද͞Εͨ৽αʔϏε ʮAWS BatchʯΛ͏૾Λͯ͠Έͨ re:Growth2016 TOKYO 1 2016/12/07 @SAPδϟύϯ ਗ਼ਫ ढ़
#cmdevio
ࣗݾհ • ਗ਼ਫ ढ़ʢ͠Έͣ ͱ͠ʣ • AWSίϯαϧςΟϯά෦ॴଐ • ಘҙ –
ಈը৴ – Amazon Elastic Transcoder • ϞοζͷγϯϘϧϚʔΫ͕ΞΠίϯͰ͢ – ͚ͲϞοζ͖ͷόϯυ͕͖ͰϞοζৄ͘͠ͳ͍ 2
AWS Batch • ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε 3
AWS Batchͬͯ͏͑Δͷʁ • όʔδχΞϦʔδϣϯʹͯϓϨϏϡʔར༻։࢝ – ࢲ·ͩ͑Δঢ়گʹ͋Γ·ͤΜ • ຊൃදʹ͍ͭͯʮͬͯΈͨʯͰͳ͘ʮͬ ͨ૾Λͯ͠ΈͨʯͰ͢ɻɻɻ •
ߏཁૉΛ֬ೝ͠ͳ͕ΒɺAWS BatchΛಈ͔ͨ͠ ؾʹͳͬͯΈ·͠ΐ͏ 4
AWS Batchͷใݯ • AWSެࣜϖʔδ • AWSެࣜϒϩά(AWS Batch – AWSͰόονॲཧδϣϒΛ࣮ߦ͢Δ) •
re:Invent2016 Breakout Session • CMP323 - NEW LAUNCH! Introducing AWS Batch: Easy and efficient batch computing on Amazon Web Services • ηογϣϯಈը(YouTube) • re:invent2016 cmp323 ͱ͔Ͱݕࡧ͢Δͱग़͖ͯ·͢ • ຊൃදͪ͜Βͷϒϩά/ηογϣϯΛେ͍ʹࢀߟʹ͠ ͍ͯ·͢ 5
ͱ͜ΖͰAWS BatchͷγϯϓϧΞΠίϯʁ • CMP323 Introducing AWS BatchͷηογϣϯಈըΑΓҾ༻ 6
AWS Batchͷ4ͭͷߏཁૉ • ͜ΕΒͷ֓ཁΛԡ͑͞ͳ͕ΒAWS BatchΛ͏૾Λͯ͠ΈΑ͏ 7 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ
δϣϒ C4 C4 R3 C4 R3 R3 R3
1. ίϯϐϡʔςΟϯάڥͷ࡞ 8 C4 ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4 R3
R3 R3
1. ίϯϐϡʔςΟϯάڥͷ࡞ • ίϯϐϡʔςΟϯάڥʢCompute Environmentʣ – όονͷδϣϒΛ࣮ߦ͢ΔॴʢϦιʔεʣ – AWSʹཧͤ͞Δ͔ɺࣗલͰཧ͢Δ͔ •
Managed / Unmanaged – ΠϯελϯελΠϓͳͲͷࢦఆ • ಛఆϞσϧc4.2xlarge/m4.10xlarge • ΠϯελϯεϑΝϛϦʔࢦఆʢc5 family) – ΦϯσϚϯυΠϯελϯε/εϙοτΠϯελϯεͷࢦఆ – vCPUͷׂʢ࠷খɺرɺ࠷େʣ – VPCɺSubnetɺSecurity GroupɺIAMϩʔϧ 9
1. ίϯϐϡʔςΟϯάڥͷ࡞ 10 C4 ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4 R3
R3 R3
2. δϣϒΩϡʔͷ࡞ 11 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4
R3 R3 R3
2. δϣϒΩϡʔͷ࡞ • δϣϒΩϡʔʢJob Queueʣ – ίϯϐϡʔςΟϯάڥʹεέδϡʔϧ͞ΕΔ· Ͱδϣϒ͕ฒͿ – ࡞࣌ʹίϯϐϡʔςΟϯάڥΛࢦఆ
• ෳࢦఆ͕Մೳ – ΦϯσϚϯυͷίϯϐϡʔςΟϯάڥ – εϙοτͷίϯϐϡʔςΟϯάڥ » ೖࡳͰ͖ͨͱ͖͚ͩ༻Մೳ 12
2. δϣϒΩϡʔͷ࡞ 13 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4
R3 R3 R3
3. δϣϒఆٛͷ࡞ 14 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ C4 C4 R3
C4 R3 R3 R3
3. δϣϒఆٛͷ࡞ • δϣϒఆٛʢJob Definitionsʣ – δϣϒͷ࣮ߦํ๏Λࢦఆ͢Δ • ࢦఆͰ͖ΔଐੑʢͷҰ෦ʣ –
δϣϒʹؔ࿈͚ΔIAMϩʔϧ – ґଘ͢Δδϣϒ – vCPUɺϝϞϦ – ίϯςφͷϓϩύςΟ – ڥม 15
3. δϣϒఆٛͷ࡞ 16 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ C4 C4 R3
C4 R3 R3 R3
4. δϣϒͷ࡞ 17 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ δϣϒ C4 C4
R3 C4 R3 R3 R3
4. δϣϒͷ࡞ • δϣϒʢJobsʣ – AWS Batchʹૹ৴͢Δ࡞ۀ୯Ґ • γΣϧεΫϦϓτɺLinux࣮ߦՄೳϑΝΠϧɺίϯςφΠϝʔδ –
EC2্ͷίϯςφԽ͞ΕͨΞϓϦέʔγϣϯͱ࣮ͯ͠ߦ͞ΕΔ – ໊લ·ͨIDͰଞͷδϣϒΛࢀরՄೳ – ଞͷδϣϒͷਖ਼ৗऴྃʹґଘՄೳ – δϣϒఆ͔ٛΒύϥϝʔλΛมߋՄೳ – αϒϛοτ͢ΔͱδϣϒΩϡʔʹฒͼɺ࣮ߦ͞Ε͍ͯ͘ 18
4. δϣϒͷ࡞ 19 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ δϣϒ C4 C4
R3 C4 R3 R3 R3
όον͕ॲཧ͞ΕΔ 20 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ δϣϒ C4 C4 R3
C4 R3 R3 R3
AWS Batch Actions • CMP323 Introducing AWS Batch ηογϣϯࢿྉΑΓ 21
·ͱΊ • AWS Batch – ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε – ϓϨϏϡʔ։࢝தͳͷͰ͏ͱ͜ΖΛ૾ͯ͠Έͨ – ߏཁૉ4ͭ
• ίϯϐϡʔςΟϯάڥ • δϣϒΩϡʔ • δϣϒఆٛ • δϣϒ 22
23