Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
re:Invent2016で発表された新サービス「AWS Batch」を使う想像をしてみた話 ...
Search
Shimizu Toshiya
December 06, 2016
0
1.4k
re:Invent2016で発表された新サービス「AWS Batch」を使う想像をしてみた話 #cmdevio
Shimizu Toshiya
December 06, 2016
Tweet
Share
More Decks by Shimizu Toshiya
See All by Shimizu Toshiya
サイト高速化のためのCloudFront導入と活用
shimizutoshiya
0
700
AKIBA.AWS #12 Cloudinaryで画像や動画配信を最適化しよう「デイリーポータルZでのCloudinary導入に向けての検証について」
shimizutoshiya
1
960
「Web担当者Forum安田編集統括が訊く デイリーポータルZのサイトリニューアル裏話ぜんぶ」インフラ編 #dpz裏話
shimizutoshiya
0
2.6k
Developers.IO 2018「AWSのマネージドサービスを使ってはじめる動画配信」
shimizutoshiya
1
1.1k
AKIBA.AWS 第4回 基礎編 動画配信入門「AWSではじめるライブ動画配信入門」
shimizutoshiya
2
1.2k
AKIBA.aws 第1回 基礎編「AWSのDNS」 #akibaaws
shimizutoshiya
4
2.4k
Featured
See All Featured
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
26
2k
A designer walks into a library…
pauljervisheath
202
24k
Art, The Web, and Tiny UX
lynnandtonic
296
20k
Music & Morning Musume
bryan
46
6.1k
What's in a price? How to price your products and services
michaelherold
243
11k
Gamification - CAS2011
davidbonilla
80
5k
A Tale of Four Properties
chriscoyier
156
22k
Code Review Best Practice
trishagee
64
17k
A Philosophy of Restraint
colly
203
16k
Automating Front-end Workflow
addyosmani
1365
200k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
26
1.4k
The World Runs on Bad Software
bkeepers
PRO
65
11k
Transcript
re:Invent2016Ͱൃද͞Εͨ৽αʔϏε ʮAWS BatchʯΛ͏૾Λͯ͠Έͨ re:Growth2016 TOKYO 1 2016/12/07 @SAPδϟύϯ ਗ਼ਫ ढ़
#cmdevio
ࣗݾհ • ਗ਼ਫ ढ़ʢ͠Έͣ ͱ͠ʣ • AWSίϯαϧςΟϯά෦ॴଐ • ಘҙ –
ಈը৴ – Amazon Elastic Transcoder • ϞοζͷγϯϘϧϚʔΫ͕ΞΠίϯͰ͢ – ͚ͲϞοζ͖ͷόϯυ͕͖ͰϞοζৄ͘͠ͳ͍ 2
AWS Batch • ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε 3
AWS Batchͬͯ͏͑Δͷʁ • όʔδχΞϦʔδϣϯʹͯϓϨϏϡʔར༻։࢝ – ࢲ·ͩ͑Δঢ়گʹ͋Γ·ͤΜ • ຊൃදʹ͍ͭͯʮͬͯΈͨʯͰͳ͘ʮͬ ͨ૾Λͯ͠ΈͨʯͰ͢ɻɻɻ •
ߏཁૉΛ֬ೝ͠ͳ͕ΒɺAWS BatchΛಈ͔ͨ͠ ؾʹͳͬͯΈ·͠ΐ͏ 4
AWS Batchͷใݯ • AWSެࣜϖʔδ • AWSެࣜϒϩά(AWS Batch – AWSͰόονॲཧδϣϒΛ࣮ߦ͢Δ) •
re:Invent2016 Breakout Session • CMP323 - NEW LAUNCH! Introducing AWS Batch: Easy and efficient batch computing on Amazon Web Services • ηογϣϯಈը(YouTube) • re:invent2016 cmp323 ͱ͔Ͱݕࡧ͢Δͱग़͖ͯ·͢ • ຊൃදͪ͜Βͷϒϩά/ηογϣϯΛେ͍ʹࢀߟʹ͠ ͍ͯ·͢ 5
ͱ͜ΖͰAWS BatchͷγϯϓϧΞΠίϯʁ • CMP323 Introducing AWS BatchͷηογϣϯಈըΑΓҾ༻ 6
AWS Batchͷ4ͭͷߏཁૉ • ͜ΕΒͷ֓ཁΛԡ͑͞ͳ͕ΒAWS BatchΛ͏૾Λͯ͠ΈΑ͏ 7 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ
δϣϒ C4 C4 R3 C4 R3 R3 R3
1. ίϯϐϡʔςΟϯάڥͷ࡞ 8 C4 ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4 R3
R3 R3
1. ίϯϐϡʔςΟϯάڥͷ࡞ • ίϯϐϡʔςΟϯάڥʢCompute Environmentʣ – όονͷδϣϒΛ࣮ߦ͢ΔॴʢϦιʔεʣ – AWSʹཧͤ͞Δ͔ɺࣗલͰཧ͢Δ͔ •
Managed / Unmanaged – ΠϯελϯελΠϓͳͲͷࢦఆ • ಛఆϞσϧc4.2xlarge/m4.10xlarge • ΠϯελϯεϑΝϛϦʔࢦఆʢc5 family) – ΦϯσϚϯυΠϯελϯε/εϙοτΠϯελϯεͷࢦఆ – vCPUͷׂʢ࠷খɺرɺ࠷େʣ – VPCɺSubnetɺSecurity GroupɺIAMϩʔϧ 9
1. ίϯϐϡʔςΟϯάڥͷ࡞ 10 C4 ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4 R3
R3 R3
2. δϣϒΩϡʔͷ࡞ 11 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4
R3 R3 R3
2. δϣϒΩϡʔͷ࡞ • δϣϒΩϡʔʢJob Queueʣ – ίϯϐϡʔςΟϯάڥʹεέδϡʔϧ͞ΕΔ· Ͱδϣϒ͕ฒͿ – ࡞࣌ʹίϯϐϡʔςΟϯάڥΛࢦఆ
• ෳࢦఆ͕Մೳ – ΦϯσϚϯυͷίϯϐϡʔςΟϯάڥ – εϙοτͷίϯϐϡʔςΟϯάڥ » ೖࡳͰ͖ͨͱ͖͚ͩ༻Մೳ 12
2. δϣϒΩϡʔͷ࡞ 13 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ C4 C4 R3 C4
R3 R3 R3
3. δϣϒఆٛͷ࡞ 14 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ C4 C4 R3
C4 R3 R3 R3
3. δϣϒఆٛͷ࡞ • δϣϒఆٛʢJob Definitionsʣ – δϣϒͷ࣮ߦํ๏Λࢦఆ͢Δ • ࢦఆͰ͖ΔଐੑʢͷҰ෦ʣ –
δϣϒʹؔ࿈͚ΔIAMϩʔϧ – ґଘ͢Δδϣϒ – vCPUɺϝϞϦ – ίϯςφͷϓϩύςΟ – ڥม 15
3. δϣϒఆٛͷ࡞ 16 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ C4 C4 R3
C4 R3 R3 R3
4. δϣϒͷ࡞ 17 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ δϣϒ C4 C4
R3 C4 R3 R3 R3
4. δϣϒͷ࡞ • δϣϒʢJobsʣ – AWS Batchʹૹ৴͢Δ࡞ۀ୯Ґ • γΣϧεΫϦϓτɺLinux࣮ߦՄೳϑΝΠϧɺίϯςφΠϝʔδ –
EC2্ͷίϯςφԽ͞ΕͨΞϓϦέʔγϣϯͱ࣮ͯ͠ߦ͞ΕΔ – ໊લ·ͨIDͰଞͷδϣϒΛࢀরՄೳ – ଞͷδϣϒͷਖ਼ৗऴྃʹґଘՄೳ – δϣϒఆ͔ٛΒύϥϝʔλΛมߋՄೳ – αϒϛοτ͢ΔͱδϣϒΩϡʔʹฒͼɺ࣮ߦ͞Ε͍ͯ͘ 18
4. δϣϒͷ࡞ 19 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ δϣϒ C4 C4
R3 C4 R3 R3 R3
όον͕ॲཧ͞ΕΔ 20 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯάڥ δϣϒఆٛ δϣϒ C4 C4 R3
C4 R3 R3 R3
AWS Batch Actions • CMP323 Introducing AWS Batch ηογϣϯࢿྉΑΓ 21
·ͱΊ • AWS Batch – ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε – ϓϨϏϡʔ։࢝தͳͷͰ͏ͱ͜ΖΛ૾ͯ͠Έͨ – ߏཁૉ4ͭ
• ίϯϐϡʔςΟϯάڥ • δϣϒΩϡʔ • δϣϒఆٛ • δϣϒ 22
23