re:Invent2016で発表された新サービス「AWS Batch」を使う想像をしてみた話 #cmdevio

Transcript

1. re:Invent2016Ͱൃද͞Εͨ৽αʔϏε ʮAWS BatchʯΛ࢖͏૝૾Λͯ͠Έͨ࿩ re:Growth2016 TOKYO 1 2016/12/07 @SAPδϟύϯ ਗ਼ਫ ढ़໵ #cmdevio
2. ࣗݾ঺հ • ਗ਼ਫ ढ़໵ʢ͠Έͣ ͱ͠΍ʣ • AWSίϯαϧςΟϯά෦ॴଐ • ಘҙ෼໺ – ಈը഑৴ – Amazon Elastic Transcoder • ϞοζͷγϯϘϧϚʔΫ͕ΞΠίϯͰ͢ – ͚ͲϞοζ޷͖ͷόϯυ͕޷͖ͰϞοζ͸ৄ͘͠ͳ͍ 2
3. AWS Batch • ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε 3
4. AWS Batchͬͯ΋͏࢖͑Δͷʁ • όʔδχΞϦʔδϣϯʹͯϓϨϏϡʔར༻։࢝ – ࢲ͸·ͩ࢖͑Δঢ়گʹ͋Γ·ͤΜ • ຊൃදʹ͍ͭͯ͸ʮ΍ͬͯΈͨʯͰ͸ͳ͘ʮ΍ͬ ͨ૝૾Λͯ͠Έͨʯ࿩Ͱ͢ɻɻɻ • ߏ੒ཁૉΛ֬ೝ͠ͳ͕ΒɺAWS BatchΛಈ͔ͨ͠ ؾʹͳͬͯΈ·͠ΐ͏ 4
5. AWS Batchͷ৘ใݯ • AWSެࣜϖʔδ • AWSެࣜϒϩά(AWS Batch – AWSͰόονॲཧδϣϒΛ࣮ߦ͢Δ) • re:Invent2016 Breakout Session • CMP323 - NEW LAUNCH! Introducing AWS Batch: Easy and efficient batch computing on Amazon Web Services • ηογϣϯಈը(YouTube) • re:invent2016 cmp323 ͱ͔Ͱݕࡧ͢Δͱग़͖ͯ·͢ • ຊൃද͸ͪ͜Βͷϒϩά/ηογϣϯΛେ͍ʹࢀߟʹ͠ ͍ͯ·͢ 5
6. ͱ͜ΖͰAWS BatchͷγϯϓϧΞΠίϯ͸ʁ • CMP323 Introducing AWS BatchͷηογϣϯಈըΑΓҾ༻ 6
7. AWS Batchͷ4ͭͷߏ੒ཁૉ • ͜ΕΒͷ֓ཁΛԡ͑͞ͳ͕ΒAWS BatchΛ࢖͏૝૾Λͯ͠ΈΑ͏ 7 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ δϣϒ C4 C4 R3 C4 R3 R3 R3
8. 1. ίϯϐϡʔςΟϯά؀ڥͷ࡞੒ 8 C4 ίϯϐϡʔςΟϯά؀ڥ C4 C4 R3 C4 R3 R3 R3
9. 1. ίϯϐϡʔςΟϯά؀ڥͷ࡞੒ • ίϯϐϡʔςΟϯά؀ڥʢCompute Environmentʣ – όονͷδϣϒΛ࣮ߦ͢Δ৔ॴʢϦιʔεʣ – AWSʹ؅ཧͤ͞Δ͔ɺࣗલͰ؅ཧ͢Δ͔ • Managed / Unmanaged – ΠϯελϯελΠϓͳͲͷࢦఆ • ಛఆϞσϧc4.2xlarge/m4.10xlarge • ΠϯελϯεϑΝϛϦʔࢦఆʢc5 family) – ΦϯσϚϯυΠϯελϯε/εϙοτΠϯελϯεͷࢦఆ – vCPUͷׂ౰਺ʢ࠷খɺر๬ɺ࠷େʣ – VPCɺSubnetɺSecurity GroupɺIAMϩʔϧ 9
10. 1. ίϯϐϡʔςΟϯά؀ڥͷ࡞੒ 10 C4 ίϯϐϡʔςΟϯά؀ڥ C4 C4 R3 C4 R3 R3 R3
11. 2. δϣϒΩϡʔͷ࡞੒ 11 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ C4 C4 R3 C4 R3 R3 R3
12. 2. δϣϒΩϡʔͷ࡞੒ • δϣϒΩϡʔʢJob Queueʣ – ίϯϐϡʔςΟϯά؀ڥʹεέδϡʔϧ͞ΕΔ· Ͱδϣϒ͕ฒͿ – ࡞੒࣌ʹίϯϐϡʔςΟϯά؀ڥΛࢦఆ • ෳ਺ࢦఆ͕Մೳ – ΦϯσϚϯυͷίϯϐϡʔςΟϯά؀ڥ – εϙοτͷίϯϐϡʔςΟϯά؀ڥ » ೖࡳͰ͖ͨͱ͖͚ͩ࢖༻Մೳ 12
13. 2. δϣϒΩϡʔͷ࡞੒ 13 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ C4 C4 R3 C4 R3 R3 R3
14. 3. δϣϒఆٛͷ࡞੒ 14 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ C4 C4 R3 C4 R3 R3 R3
15. 3. δϣϒఆٛͷ࡞੒ • δϣϒఆٛʢJob Definitionsʣ – δϣϒͷ࣮ߦํ๏Λࢦఆ͢Δ • ࢦఆͰ͖ΔଐੑʢͷҰ෦ʣ – δϣϒʹؔ࿈෇͚ΔIAMϩʔϧ – ґଘ͢Δδϣϒ – vCPUɺϝϞϦ – ίϯςφͷϓϩύςΟ – ؀ڥม਺ 15
16. 3. δϣϒఆٛͷ࡞੒ 16 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ C4 C4 R3 C4 R3 R3 R3
17. 4. δϣϒͷ࡞੒ 17 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ δϣϒ C4 C4 R3 C4 R3 R3 R3
18. 4. δϣϒͷ࡞੒ • δϣϒʢJobsʣ – AWS Batchʹૹ৴͢Δ࡞ۀ୯Ґ • γΣϧεΫϦϓτɺLinux࣮ߦՄೳϑΝΠϧɺίϯςφΠϝʔδ – EC2্ͷίϯςφԽ͞ΕͨΞϓϦέʔγϣϯͱ࣮ͯ͠ߦ͞ΕΔ – ໊લ·ͨ͸IDͰଞͷδϣϒΛࢀরՄೳ – ଞͷδϣϒͷਖ਼ৗऴྃʹґଘՄೳ – δϣϒఆ͔ٛΒύϥϝʔλΛมߋՄೳ – αϒϛοτ͢ΔͱδϣϒΩϡʔʹฒͼɺ࣮ߦ͞Ε͍ͯ͘ 18
19. 4. δϣϒͷ࡞੒ 19 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ δϣϒ C4 C4 R3 C4 R3 R3 R3
20. όον͕ॲཧ͞ΕΔ 20 C4 δϣϒΩϡʔ ίϯϐϡʔςΟϯά؀ڥ δϣϒఆٛ δϣϒ C4 C4 R3 C4 R3 R3 R3
21. AWS Batch Actions • CMP323 Introducing AWS Batch ηογϣϯࢿྉΑΓ 21
22. ·ͱΊ • AWS Batch – ϑϧϚωʔδυͳόονॲཧ࣮ߦαʔϏε – ϓϨϏϡʔ։࢝தͳͷͰ࢖͏ͱ͜ΖΛ૝૾ͯ͠Έͨ – ߏ੒ཁૉ͸4ͭ • ίϯϐϡʔςΟϯά؀ڥ • δϣϒΩϡʔ • δϣϒఆٛ • δϣϒ 22