re:Invent2016で発表された新サービス「AWS Batch」を使う想像をしてみた話 #cmdevio

by Shimizu Toshiya

Slide 1

Slide 1 text

re:Invent2016Ͱൃද͞Εͨ৽αʔϏε ʮAWS BatchʯΛ࢖͏૝૾Λͯ͠Έͨ࿩ re:Growth2016 TOKYO 1 2016/12/07 @SAPδϟύϯ ਗ਼ਫ ढ़໵ #cmdevio

Slide 2

Slide 2 text

ࣗݾ঺հ • ਗ਼ਫ ढ़໵ʢ͠Έͣ ͱ͠΍ʣ • AWSίϯαϧςΟϯά෦ॴଐ • ಘҙ෼໺ – ಈը഑৴ – Amazon Elastic Transcoder • ϞοζͷγϯϘϧϚʔΫ͕ΞΠίϯͰ͢ – ͚ͲϞοζ޷͖ͷόϯυ͕޷͖ͰϞοζ͸ৄ͘͠ͳ͍ 2

Slide 3

Slide 3 text

AWS Batch • ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε 3

Slide 4

Slide 4 text

AWS Batchͬͯ΋͏࢖͑Δͷʁ • όʔδχΞϦʔδϣϯʹͯϓϨϏϡʔར༻։࢝ – ࢲ͸·ͩ࢖͑Δঢ়گʹ͋Γ·ͤΜ • ຊൃදʹ͍ͭͯ͸ʮ΍ͬͯΈͨʯͰ͸ͳ͘ʮ΍ͬ ͨ૝૾Λͯ͠Έͨʯ࿩Ͱ͢ɻɻɻ • ߏ੒ཁૉΛ֬ೝ͠ͳ͕ΒɺAWS BatchΛಈ͔ͨ͠ ؾʹͳͬͯΈ·͠ΐ͏ 4

Slide 5

Slide 5 text

AWS Batchͷ৘ใݯ • AWSެࣜϖʔδ • AWSެࣜϒϩά(AWS Batch – AWSͰόονॲཧδϣϒΛ࣮ߦ͢Δ) • re:Invent2016 Breakout Session • CMP323 - NEW LAUNCH! Introducing AWS Batch: Easy and efficient batch computing on Amazon Web Services • ηογϣϯಈը(YouTube) • re:invent2016 cmp323 ͱ͔Ͱݕࡧ͢Δͱग़͖ͯ·͢ • ຊൃද͸ͪ͜Βͷϒϩά/ηογϣϯΛେ͍ʹࢀߟʹ͠ ͍ͯ·͢ 5

Slide 6

Slide 6 text

ͱ͜ΖͰAWS BatchͷγϯϓϧΞΠίϯ͸ʁ • CMP323 Introducing AWS BatchͷηογϣϯಈըΑΓҾ༻ 6

Slide 7

Slide 7 text

AWS Batchͷ4ͭͷߏ੒ཁૉ • ͜ΕΒͷ֓ཁΛԡ͑͞ͳ͕ΒAWS BatchΛ࢖͏૝૾Λͯ͠ΈΑ͏ 7 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ δϣϒ C4 C4 R3 C4 R3 R3 R3

Slide 8

Slide 8 text

1. ίϯϐϡʔςΟϯά؀ڥͷ࡞੒ 8 C4 ίϯϐϡʔςΟϯά؀ڥ C4 C4 R3 C4 R3 R3 R3

Slide 9

Slide 9 text

1. ίϯϐϡʔςΟϯά؀ڥͷ࡞੒ • ίϯϐϡʔςΟϯά؀ڥʢCompute Environmentʣ – όονͷδϣϒΛ࣮ߦ͢Δ৔ॴʢϦιʔεʣ – AWSʹ؅ཧͤ͞Δ͔ɺࣗલͰ؅ཧ͢Δ͔ • Managed / Unmanaged – ΠϯελϯελΠϓͳͲͷࢦఆ • ಛఆϞσϧc4.2xlarge/m4.10xlarge • ΠϯελϯεϑΝϛϦʔࢦఆʢc5 family) – ΦϯσϚϯυΠϯελϯε/εϙοτΠϯελϯεͷࢦఆ – vCPUͷׂ౰਺ʢ࠷খɺر๬ɺ࠷େʣ – VPCɺSubnetɺSecurity GroupɺIAMϩʔϧ 9

Slide 10

Slide 10 text

1. ίϯϐϡʔςΟϯά؀ڥͷ࡞੒ 10 C4 ίϯϐϡʔςΟϯά؀ڥ C4 C4 R3 C4 R3 R3 R3

Slide 11

Slide 11 text

2. δϣϒΩϡʔͷ࡞੒ 11 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ C4 C4 R3 C4 R3 R3 R3

Slide 12

Slide 12 text

2. δϣϒΩϡʔͷ࡞੒ • δϣϒΩϡʔʢJob Queueʣ – ίϯϐϡʔςΟϯά؀ڥʹεέδϡʔϧ͞ΕΔ· Ͱδϣϒ͕ฒͿ – ࡞੒࣌ʹίϯϐϡʔςΟϯά؀ڥΛࢦఆ • ෳ਺ࢦఆ͕Մೳ – ΦϯσϚϯυͷίϯϐϡʔςΟϯά؀ڥ – εϙοτͷίϯϐϡʔςΟϯά؀ڥ » ೖࡳͰ͖ͨͱ͖͚ͩ࢖༻Մೳ 12

Slide 13

Slide 13 text

2. δϣϒΩϡʔͷ࡞੒ 13 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ C4 C4 R3 C4 R3 R3 R3

Slide 14

Slide 14 text

3. δϣϒఆٛͷ࡞੒ 14 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ C4 C4 R3 C4 R3 R3 R3

Slide 15

Slide 15 text

3. δϣϒఆٛͷ࡞੒ • δϣϒఆٛʢJob Definitionsʣ – δϣϒͷ࣮ߦํ๏Λࢦఆ͢Δ • ࢦఆͰ͖ΔଐੑʢͷҰ෦ʣ – δϣϒʹؔ࿈෇͚ΔIAMϩʔϧ – ґଘ͢Δδϣϒ – vCPUɺϝϞϦ – ίϯςφͷϓϩύςΟ – ؀ڥม਺ 15

Slide 16

Slide 16 text

3. δϣϒఆٛͷ࡞੒ 16 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ C4 C4 R3 C4 R3 R3 R3

Slide 17

Slide 17 text

4. δϣϒͷ࡞੒ 17 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ δϣϒ C4 C4 R3 C4 R3 R3 R3

Slide 18

Slide 18 text

4. δϣϒͷ࡞੒ • δϣϒʢJobsʣ – AWS Batchʹૹ৴͢Δ࡞ۀ୯Ґ • γΣϧεΫϦϓτɺLinux࣮ߦՄೳϑΝΠϧɺίϯςφΠϝʔδ – EC2্ͷίϯςφԽ͞ΕͨΞϓϦέʔγϣϯͱ࣮ͯ͠ߦ͞ΕΔ – ໊લ·ͨ͸IDͰଞͷδϣϒΛࢀরՄೳ – ଞͷδϣϒͷਖ਼ৗऴྃʹґଘՄೳ – δϣϒఆ͔ٛΒύϥϝʔλΛมߋՄೳ – αϒϛοτ͢ΔͱδϣϒΩϡʔʹฒͼɺ࣮ߦ͞Ε͍ͯ͘ 18

Slide 19

Slide 19 text

4. δϣϒͷ࡞੒ 19 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ δϣϒ C4 C4 R3 C4 R3 R3 R3

Slide 20

Slide 20 text

όον͕ॲཧ͞ΕΔ 20 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ δϣϒ C4 C4 R3 C4 R3 R3 R3

Slide 21

Slide 21 text

AWS Batch Actions • CMP323 Introducing AWS Batch ηογϣϯࢿྉΑΓ 21

Slide 22

Slide 22 text

·ͱΊ • AWS Batch – ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε – ϓϨϏϡʔ։࢝தͳͷͰ࢖͏ͱ͜ΖΛ૝૾ͯ͠Έͨ – ߏ੒ཁૉ͸4ͭ • ίϯϐϡʔςΟϯά؀ڥ • δϣϒΩϡʔ • δϣϒఆٛ • δϣϒ 22