AWSサービスで実現するバッチ実行環境のコンテナ/サーバレス化/ Container service of batch execution environment realized by AWS service

Slide 1

Slide 1 text

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. T O K Y O 2 0 1 9 . 1 0 . 0 3 - 0 4 AWSαʔϏεͰ࣮ݱ͢Δ όον࣮ߦ؀ڥͷίϯςφ/αʔόϨεԽ ӬҪ উҰ࿠ ίωώτגࣜձࣾ © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. T O K Y O 2 0 1 9 . 1 0 . 0 3 - 0 4 AWSαʔϏεͰ࣮ݱ͢Δ όον࣮ߦ؀ڥͷίϯςφ/αʔόϨεԽ ӬҪ উҰ࿠ ίωώτגࣜձࣾ G - 5

Slide 2

Slide 2 text

ࣗݾ঺հ ӬҪউҰ࿠ ओͳ׆ಈ  +BQBO$POUBJOFS%BZTW "844VNNJU  ͸͡Ίͯͷ1)1ϓϩϑΣογϣφϧ։ൃ ೔ܦ4:45&.4 ϚϚϦ͕࣮ફ͢Δɹίϯ ςφҠߦͷਖ਼߈๏   ίωώτΤϯδχΞϒϩάIUUQTUFDIDPOOFIJUPDPNBSDIJWFBVUIPSOBHBJT ίωώτגࣜձࣾɹΤϯδχΞ  Πϯϑϥ΢ΣϒΦϖϨʔγϣϯػցֶश ࠷ۙ !TIOBHBJ

Slide 3

Slide 3 text

"CPVUϚϚϦ ࣗΒબͿͨΊͷʮ஌ࣝʯΛఏڙ͢Δ Ո଒ʹͱͬͯΑΓྑ͍બ୒Λ͢ΔͨΊʹඞཁͳ͔֬ͳ৘ใʹج͍ͮͨʮ஌ࣝʯΛఏڙ͠·͢ ҰาΛ౿Έग़͢ʮࣗ৴ʯΛҭΉ ஌ࣝͱͱ΋ʹɺҰาΛ౿Έग़͢ݪಈྗͱͳΔʮࣗ৴ʯΛҭΉͨΊͷ৔Λఏڙ͠·͢ ߦಈͨ͠ϚϚΛड͚ೖΕΔʮࣾձʯΛͭ͘Δ ϚϚͷ੠Λࣾձʹൃ৴͠ɺϚϚͷબ୒Λड͚ೖΕΔ౔৕ͷ͋ΔࣾձΛͭ͘Γ·͢ ʮͭͷ੾ΓޱʯͰϚϚΛࢧ͑·͢ Ո଒ͷ଩औΓ໾Ͱ͋ΔzϚϚzΛࢧ͑Δ͜ͱΛ௨ͯ͠ɺՈ଒͕΋ͬͱ޾ͤʹաͤ͝ΔੈͷதΛͭ͘Γ·͢ɻ ϚϚϦ͕໿ଋ͢Δ͜ͱ ϚϚϦ͸ɺʮϚϚͷҰาΛࢧ͑ΔʯϒϥϯυͰ͢

Slide 4

Slide 4 text

˞ʮӾཡ਺ʯʮར༻ऀ਺ʯ͸ϝσΟΞͱΞϓϦͷ߹ܭ஋ʢ೥݄݄ͷฏۉ஋ʣ ˞ʮϚϚ޲͚/PΞϓϦʯ͸೥݄Πϯςʔδௐ΂ɹௐࠪର৅ɿ೛৷தʙ̎ࡀ̌ϲ݄ͷࢠڙΛ࣋ͭঁੑ O Λநग़ ˞*OTUBHSBNͷϑΥϩϫʔ਺ɺ'BDFCPPLͷ͍͍Ͷ਺ɺ-*/&ͷͱ΋ͩͪ਺ͷ߹ܭ஋ ೥݄࣌఺ ϚϚϦ ΞϓϦɾ8FC 4/4 *OTUBHSBNɾ-*/&ɾ'BDFCPPL هࣄ ϚϚಉ࢜Ͱ೰ΈΛ૬ஊ͠߹͏2"ίϛϡχςΟΛத৺ʹ ϢʔβʔΛ֦େ͍ͯ͠·͢ ʮϚϚϦʯͰϢʔβʔಉ͕࢜ ͲΜͲΜܨ͕͍ͬͯ·͢ ϚϚͷੜ׆ʹ໾ཱͭهࣄΛ ෯޿͍δϟϯϧͰ഑৴͍ͯ͠·͢ ϚϚ޲͚/P̍ΞϓϦʹબग़ ਓͷϚϚ͕બͿʮݱࡏ࢖͍ͬͯΔΞϓϦʯʹͯɺ ߲໨ ଞͷϚϚʹΦεεϝ͍ͨ͠ɺೝ஌౓ɺ  ར༻཰ɺརศੑɺ޷ײ౓ Ͱ̍ҐΛ֫ಘ͠·ͨ͠ هࣄ਺ 6,000 هࣄҎ্ ྦྷܭϑΝϯ਺ ໿ 91 ສਓ ˞ ݄ؒӾཡ਺ ໿ 1.5ԯճ ˞ ݄ؒར༻ऀ਺ ໿ 650ສਓ ˞ ˞ l೰ΈzͱzڞײzΛ࣠ʹϚϚʹدΓఴ͍ ΞϓϦɾ8FCɾ4/4ͱଟ֯తʹαʔϏεΛల։͍ͯ͠·͢ "CPVUϚϚϦ

Slide 5

Slide 5 text

0 450,000 900,000 1,350,000 1,800,000 2014/4 2014/5 2014/6 2014/7 2014/8 2014/9 2014/10 2014/11 2014/12 2015/1 2015/2 2015/3 2015/4 2015/5 2015/6 2015/7 2015/8 2015/9 2015/10 2015/11 2015/12 2016/1 2016/2 2016/3 2016/4 2016/5 2016/6 2016/7 2016/8 2016/9 2016/10 2016/11 2016/12 2017/1 2017/2 2017/3 2017/4 2017/5 2017/6 2017/7 2017/8 2017/9 2017/10 2017/11 2017/12 2018/1 2018/2 2018/3 2018/4 2018/5 2018/6 2018/7 2018/8 ݄ؒ౤ߘ਺ ໿ 150ສ݅ िʹ೔Ҏ্ىಈ͢Δ ΞΫςΟϒϢʔβʔ ໿ 50 ਓʹਓ 57$. ์ө ΞϓϦ૯%-਺ສ ਓʹਓ ਓʹਓ ਓʹਓ ਓʹਓ ˞ ˞ʮϚϚϦʯ಺ͷग़࢈༧ఆ೔Λઃఆͨ͠Ϣʔβʔ਺ͱɺްੜ࿑ಇলൃදʮਓޱಈଶ౷ܭʯͷग़ੜ਺͔Βࢉग़  ˞िʹճҎ্ىಈ͢ΔϢʔβʔ ˞ ೥ʹग़࢈ͨ͠ϚϚͷʮਓʹਓʯ͕ϚϚϦΛར༻த ೔ຊ࠷େڃن໛ΛތΔϒϥϯυ΁ͱ੒௕͍ͯ͠·͢ ˞ ೔ຊ࠷େڃن໛ΛތΔϒϥϯυ΁

Slide 6

Slide 6 text

w ϗετܕόον࣮ߦ؀ڥͷ՝୊ΛৼΓฦΔ w όονॲཧͷίϯςφԽ  ʲࣄྫʳ  εέδϡʔϧܥόονॲཧΛίϯςφԽͯ͠&$44DIFEVMF5BTLʹҠߦ w όονॲཧͷίϯςφαʔόϨεԽ  ʲࣄྫʳ  ػցֶशͷֶशσʔλલॲཧϑϩʔ (MVF'BSHBUF Λ  4UFQ'VODUJPOTͰඪ४Խ ΞδΣϯμ

Slide 7

Slide 7 text

"84Ͱͷόονॲཧύλʔϯʹ͍ͭͯ ҰͭͰ΋ؾ͖ͮΛಘͯ΋Β͑Ε͹͏Ε͍͠Ͱ͢

Slide 8

Slide 8 text

Slide 9

Slide 9 text

ϗετܕόοναʔόͷྫ

Slide 10

Slide 10 text

୆ͷόοναʔό αʔϏεAόον: cron(10 0 * * *) αʔϏεBόον: cron(20 0 * * *) ӡ༻Cόον: cron(30 0 * * *) EC2 1୆ͷEC2Ͱӡ༻ cronͰεέδϡʔϧ؅ཧ ༷ʑͳόονॲཧΛू໿ େ͖ͳίϯϐϡʔςΟϯάϦιʔε

Slide 11

Slide 11 text

୆ߏ੒ʹͯ͠৑௕Խ αʔϏεAόον: cron(10 0 * * *) αʔϏεBόον: cron(20 0 * * *) ӡ༻Cόον: cron(30 0 * * *) EC2 αʔϏεAόον: cron(10 0 * * *) αʔϏεBόον: cron(20 0 * * *) ӡ༻Cόον: cron(30 0 * * *) EC2

Slide 12

Slide 12 text

όονຖʹ"DUJWF4UBOECZʹ͢Δ αʔϏεAόον: cron(10 0 * * *) αʔϏεBόον: cron(20 0 * * *) # ӡ༻Cόον: cron(30 0 * * *) EC2 # αʔϏεAόον: cron(10 0 * * *) # αʔϏεBόον: cron(20 0 * * *) ӡ༻Cόον: cron(30 0 * * *) EC2 αʔϏεܥόοναʔό ӡ༻ܥόοναʔό

Slide 13

Slide 13 text

୆ࢮΜͩΒखಈͰϑΣΠϧΦʔόʔ αʔϏεAόον: cron(10 0 * * *) αʔϏεBόον: cron(20 0 * * *) # ӡ༻Cόον: cron(30 0 * * *) EC2 αʔϏεAόον: cron(10 0 * * *) αʔϏεBόον: cron(20 0 * * *) ӡ༻Cόον: cron(30 0 * * *) EC2 αʔϏεܥόοναʔό ӡ༻ܥόοναʔό ☓ ίϝϯτΞ΢τ ֎ͯ͠Activeʹ

Slide 14

Slide 14 text

ෳ਺ͷαʔόʹશ͘ಉ͡มߋΛߦ͏ඞཁ͕͋Δ αʔϏεAόον: cron(10 0 * * *) αʔϏεBόον: cron(20 0 * * *) # ӡ༻Cόον: cron(30 0 * * *) EC2 # αʔϏεAόον: cron(10 0 * * *) # αʔϏεBόον: cron(20 0 * * *) ӡ༻Cόον: cron(30 0 * * *) EC2 αʔϏεܥόοναʔό ӡ༻ܥόοναʔό ΞϓϦέʔγϣϯσϓϩΠ ϓϥοτϑΥʔϜͷมߋ

Slide 15

Slide 15 text

Slide 16

Slide 16 text

w ϓϥοτϑΥʔϜʹมߋΛՃ͑Δϋʔυϧ͕ߴ͍  όοναʔόͰಈ͘ଟذʹΘͨΔॲཧ͕໰୊ͳ͘ಈ͘Α͏ʹߟྀ͢Δඞཁ͕͋Δ  ෳ਺αʔόʹશ͘ಉ͡มߋΛՃ͑Δඞཁ͕͋Δ  ৗʹԿ͔͠Βͷॲཧ͕ಈ͍͍ͯΔͷͰϩʔϧόοΫ͕೉͍͠ w ӡ༻ෛՙ͕ߴ͍  όοναʔόͷΠϯϑϥઃఆมߋ  DSPOొ࿥ͷΦϖϨʔγϣϯ΍εςʔδϯάͰͷςετ࣮ߦ  ো֐࣌ͷ੾Γ෼͚ όονݸผͷ໰୊ αʔόϦιʔε κϯϏϓϩηε͕ɺɺɺ ϗετܕόονॲཧͷ՝୊

Slide 17

Slide 17 text

Slide 18

Slide 18 text

w ϦιʔεΛڞ༗͢Δ؍఺͔Β៛ີͳεέδϡʔϧ؅ཧ͕ඞཁ  ݶΒΕͨϚγϯϦιʔεΛڞ༗͢ΔͷͰॏ͍ॲཧ͕ॏͳΒͳ͍Α͏ߟྀ  ៛ີͳεέδϡʔϧ؅ཧ όον؅ཧ୆ா   δϣϒεέδϡʔϥͷಋೖˠδϣϒεέδϡʔϥࣗମͷӡ༻͕ൃੜ  εέδϡʔϦϯάͷܦҢ౳͸Ұ෦ʹଐਓԽ͢Δ͜ͱ΋͓͖͕ͪ w අ༻͕ߴ͘ͳΓ͕ͪ  Ұ൪ϚγϯϦιʔεΛ࢖͏ॲཧΛϕʔεʹΠϯελϯεΛܾఆ͠ৗ࣌ىಈ  ৑௕Խ΍໾ׂຖόοναʔόΛ࡞Δͱߋʹඅ༻͕ߴ͘ͳΔ  Ϋϥ΢υͷ৔߹͸ɺඞཁͳ࣌ʹ࢖ͬͨ෼͚ͩͷඅ༻Λ෷͏ܗʹ͍ͨ͠ ϗετܕόονॲཧͷ՝୊

Slide 19

Slide 19 text

Slide 20

Slide 20 text

͜Ε͔ΒͭͷࣄྫΛϕʔεʹ

Slide 21

Slide 21 text

όον࣮ߦ؀ڥΛίϯςφɾαʔόϨεԽ͢Δ ϝϦοτʹ͍͓ͭͯ࿩͠·͢

Slide 22

Slide 22 text

Slide 23

Slide 23 text

w αʔϏεӡ༻Ͱ࢖͏εέδϡʔϧϕʔεόονΛίϯςφԽ w ͦΕʹΑΓղܾͨ͠՝୊ͱߏ੒ʹ͍ͭͯ ͜ͷࣄྫͰ͓࿩͢Δ͜ͱ

Slide 24

Slide 24 text

w εέδϡʔϧܥͷόονॲཧ  ࣄલʹఆٛͨ࣌ؒ͠ʹਖ਼֬ʹಈ͘͜ͱ͕ظ଴͞ΕΔ  ಛఆͷαΠΫϧ ෼ຖ Ͱಈ͘͜ͱ͕ظ଴͞ΕΔ w όοναʔόͷDSPOͰεέδϡʔϧ؅ཧ  όοναʔόʹΞϓϦέʔγϣϯΛσϓϩΠ  DSPOUBCͰεέδϡʔϧ؅ཧ ѻ͏όονॲཧ

Slide 25

Slide 25 text

w όονΛ࢘ΔDSPOαʔόͷӡ༻Λ΍Ί͍ͨ  શαʔϏεڞ௨ͷ&$  ಈ͍͍ͯΔͷ͸ɺ࣌ؒ௨Γʹಈ͘͜ͱ͕ظ଴͞ΕΔεέδϡʔϧܥόον w ΞϓϦέʔγϣϯ͸ίϯςφԽࡁͰͦͷࢿ࢈Λ׆͔͍ͨ͠  ϕʔείʔυ͸XFCͱڞ௨ͳͷͰίϯςφԽࡁ  "84Λج൫ͱͯ͠࢖͍ͬͯΔͷͰɺ"84ͰίϯςφͷόονॲཧΛ࣮ݱ͍ͨ͠  ࣾ಺Ͱ͸%PDLFSͰͷ։ൃ͕ೃછΜͰ͖͍ͯͨ  ʲίϯςφಋೖͷਖ਼߈๏ʳ  IUUQTTQFBLFSEFDLDPNTIPJDIJSPODPOGSPOUBUJPOPGDPOUBJOFSUSBOTGFS ίωώτͷόοναʔόʹର͢Δ՝୊

Slide 26

Slide 26 text

w ଐਓԽ͠΍͘͢ϨΨγʔͳӡ༻͕࢒͍ͬͯΔ  ৽نొ࿥࣌͸ɺDSPOUBCͰखಈεέδϡʔϧొ࿥  ϦϦʔεલͷςετ࣮ߦ͸44)ܦ༝Ͱόοναʔό͔Βಈ࡞֬ೝ  DSPOUBCʹొ࿥͢Δͷ͸Ұ෦ͷΤϯδχΞͷΈ Ұ෦͔͠શ༰Λ஌Βͳ͍ঢ়ଶ w ΞϓϦέʔγϣϯϦϦʔεҎ֎͸ۃྗมߋΛՃ͑ͳ͍Α͏ʹ  γϯάϧϙΠϯτͳͷͰࢭ·ΔͱαʔϏεʹӨڹେ  ग़དྷΔ͚ͩมߋ͸Ճ͑ͣʹӡ༻͍ͨ͠ͱ͍͏ҙ͕ࣝಇ͘ ίωώτͷόοναʔόʹର͢Δ՝୊

Slide 27

Slide 27 text

͜ΕΒͷ՝୊Λղܾ͢ΔͨΊʹ ίϯςφۦಈͳόον࣮ߦ؀ڥΛߏங

Slide 28

Slide 28 text

όονॲཧΛίϯςφԽ͢Δ͜ͱͰ ͲͷΑ͏ͳϝϦοτ͕ಘΒΕΔͷ͔ʁ

Slide 29

Slide 29 text

ᶃՄൖੑͷߴ͞Λ׆͔͢͜ͱͰϓϥοτϑΥʔϜมߋͷෑډ͕Լ͕Δ εςʔδϯά؀ڥ ϓϩμΫγϣϯ؀ڥ ։ൃ؀ڥ ΞϓϦέʔγϣϯ ΞϓϦέʔγϣϯ ΞϓϦέʔγϣϯ ΞϓϦέʔγϣϯ όοναʔό ࣮ߦ؀ڥ όοναʔό ࣮ߦ؀ڥ ΞϓϦέʔγϣϯ ࣮ߦ؀ڥ ΞϓϦέʔγϣϯ ࣮ߦ؀ڥ ઃఆมߋ ઃఆมߋ σϓϩΠ σϓϩΠ σϓϩΠ σϓϩΠ ઃఆมߋ͸ίϯςφ಺Ͱ׬݁

Slide 30

Slide 30 text

Slide 31

Slide 31 text

w ઐ༻ͷόοναʔό͸ෆཁʹ  ͲͷόονΛͲͷϗετͰಈ͔͔͢͸ΦʔέετϨʔγϣϯπʔϧʹ͓೚ͤ  όονॲཧίϯςφϓϩηεͷ࣮ߦʹूதग़དྷΔ  DSPOUBCӡ༻͔Βͷଔۀ w ଐਓԽΛഉআग़དྷΔ  ϓϥοτϑΥʔϜͷఆٛ͸%PDLFSGJMFͰίʔυԽ  όον࣮ߦͷఆٛ΋ίʔυԽ͢Δ͜ͱͰ௨ৗͷ։ൃϑϩʔͰόονӡ༻͕ग़དྷΔ ᶄӡ༻ෛՙ͕Լ͕Δ

Slide 32

Slide 32 text

"84ͰͲͷΑ͏ʹ ίϯςφج൫ͷόον࣮ߦ؀ڥΛ࡞Δ͔

Slide 33

Slide 33 text

w ίϯςφPODSPO -BNCEB "84#BUDI౳Λൺֱݕ౼  ౰࣌ͷΞʔΩςΫνϟબఆ࣌ͷQSPTDPOT͸ͪ͜Βʹ  ʲ"NB[PO&$44DIFEVMF5BTLͰ࣮ݱ͢ΔεϚʔτͳ%PDLFSϕʔεͷόον࣮ߦ؀ڥʳ   IUUQTUFDIDPOOFIJUPDPNFOUSZ w શͯͷཁ݅Λຬͨͨ͠ͷͰ&$44DIFEVMF5BTLͷ࠾༻Λܾఆ  ͜Ε͔Β΍ΔͳΒཁ݅ʹΑͬͯ͸"84#BUDIͰ΋͍͍ͷ͔΋ େن໛σʔλ౳   ౰࣌͸εέδϡʔϧىಈʹରԠ͍ͯ͠ͳ͔ͬͨ w ಋೖ౰ॳ͸ଞࣾࣄྫ͕͋·Γͳ͍ͱ͍͏ෆ҆͸͋ͬͨ  4"ʹ૬ஊͯ͠ΞʔΩςΫνϟͷϨϏϡʔΛड͚Δ  &$4ͷӡ༻࣮੷͸͋Γ஌ݟ͕͋ͬͨͷͰಋೖΛܾఆ ٕज़બఆ

Slide 34

Slide 34 text

w &$4͸"84͕ఏڙ͢Δίϯςφ؅ཧͷϚωʔδυαʔϏε  ίϯςφΦʔέετϨʔγϣϯπʔϧ w &$44DIFEVMF5BTL͸λεΫ ίϯςφ ͷ࣮ߦΛεέδϡʔ ϧ؅ཧͯ͘͠ΕΔػೳ  $MPVE8BUDI&WFOUͱ࿈ܞ &$44DIFEVMF5BTLͱ͸ Event   (time-based)

Slide 35

Slide 35 text

ΞʔΩςΫνϟ ECR ECS ScheduleTask Task CloudWatch Event   (time-based) Aόον: cron(10 0 * * ? *) Bόον: cron(20 0 * * ? *) Cόον: cron(30 0 * * ? *) Tag: Release Task Task Aόον Bόον Cόον pull pull pull EC2 EC2Λ৑௕ߏ੒ʹ͠SPOFճආ ECSλεΫ഑ஔઓུʹଇΓɺόϥ ϯεΑ͘λεΫ͸ىಈ͞ΕΔ

Slide 36

Slide 36 text

&$44DIFEVMF5BTLͰͷ όον࣮ߦͷྲྀΕΛݟͯΈ·͠ΐ͏

Slide 37

Slide 37 text

όον࣮ߦͷྲྀΕ +45 ECR ECS ScheduleTask Task CloudWatch Event   (time-based) Aόον: cron(10 0 * * ? *) Bόον: cron(20 0 * * ? *) Cόον: cron(30 0 * * ? *) Tag: Release Aόον pull EC2

Slide 38

Slide 38 text

όον࣮ߦͷྲྀΕ +45 ECR ECS ScheduleTask Task CloudWatch Event   (time-based) Aόον: cron(10 0 * * ? *) Bόον: cron(20 0 * * ? *) Cόον: cron(30 0 * * ? *) Tag: Release Task Aόον Bόον pull EC2 Bόονىಈ࣌͸ɺ Aόονىಈ࣌ʹग़དྷͨEC2্ͷ DockerϨΠϠΩϟογϡ͕ޮ͘ͷ Ͱߴ଎ىಈ

Slide 39

Slide 39 text

+45 ʹຊ൪σϓϩΠൃੜ

Slide 40

Slide 40 text

Cόον͸ɺσϓϩΠ͞Εͨ৽͠ ͍DockerΠϝʔδͰόονΛىಈ σϓϩΠ࣌ʹىಈ͍ͯͨ͠Bόο ν͸ɺӨڹͳ͘ॲཧΛଓ͚Δ όον࣮ߦͷྲྀΕ +45 ECR ECS CloudWatch Event   (time-based) Aόον: cron(10 0 * * ? *) Bόον: cron(20 0 * * ? *) Cόον: cron(30 0 * * ? *) Tag: Release Task Task Bόον Cόον pull (new image) EC2

Slide 41

Slide 41 text

w DSPOه๏Ͱεέδϡʔϧఆ͕ٛग़དྷΔͷͰΘ͔Γ΍͍͢  $MPVE8BUDI&WFOUTͷDSPOࣜͷಛ௃  ೥ͱ͍͏֓೦͕͋ΓϑΟʔϧυ  λΠϜκʔϯ͸65$  ຖ೔ʹىಈ͢Δ৔߹ &$44DIFEVMF5BTLͷϝϦοτ

Slide 42

Slide 42 text

w طଘͷ%PDLFSΠϝʔδΛࢿ࢈ͱͯ͠࢖͑Δ  XFCͱಉ͡ίʔυϕʔεͰόονΛಈ͔͢৔߹͸DNE۟ͷॻ׵͚͑ͩͰ0, &$44DIFEVMF5BTLͷϝϦοτ ECR ECS CMD: /usr/sbin/httpd -DFOREGROUND CMD: bin/cake hoge_batch Web Batch Docker Pull

Slide 43

Slide 43 text

w &$όοΫΤϯυߏ੒ͩͱίϯςφͷىಈ͕ૣ͍  ىಈʹ͔͔Δ࣌ؒ͸਺ඵͳͷͰεέδϡʔϧىಈͷཁ݅ΛຬͨͤΔ  %PDLFS࣮ߦϗετ͕ݻఆ͞ΕΔͷͰ%PDLFSͷϨΠϠΩϟογϡ͕ޮ͘  'BSHBUF͸ϗετΛݻఆग़དྷͳ͍ͷͰϨΠϠΩϟογϡ͕ޮ͔ͳ͍&/*ͷ෇͚ସ ͑΋͋Γىಈʹ෼ऑ͔͔Δ લ͸෼΄Ͳ͔͔ͬͯͨͷͰૣ͘͸ͳ͍ͬͯΔ &$44DIFEVMF5BTLͷϝϦοτ

Slide 44

Slide 44 text

w σϓϩΠ࣌ʹ࣮ߦதόον΁ͷߟྀ͕ෆཁ  ىಈ࣌ʹ%PDLFSΠϝʔδΛQVMM͢ΔΞʔΩςΫνϟ  ىಈதͷίϯςφ͸QVMMͨ͠ஈ֊ͷΞϓϦέʔγϣϯΛ࢖͏ͷͰӨڹΛड͚ͳ͍ w $MPVE8BUDI-PHTͰ؆୯ʹϩά͕ݟΕΔ  ඪ४ग़ྗΛ$MPVE8BUDI-PHT΁ग़ྗ  "84ίϯιʔϧ͔ΒΞϓϦέʔγϣϯͷग़ྗΛ؆୯ʹݟΕΔ  Θ͟Θ͟44)Λ͠ͳͯ͘΋0, &$44DIFEVMF5BTLͷϝϦοτ

Slide 45

Slide 45 text

w (6*ͰόονҰཡ͕ݟΕΔ  ίϝϯτ΋͚ͭΕΔͷͰόον؅ཧ୆ாͷ୅༻ʹͳΔ  &$44DIFEVMF5BTLͷϝϦοτ

Slide 46

Slide 46 text

w όοναʔόͷӡ༻͕ෆཁʹͳΔ  ίϯςφͱ&$ͷ؅ཧ͸&$4͕ߦͬͯ͘ΕΔ  &$ΛNVMUJ";Ͱӡ༻͢Δ͜ͱͰ410'ղফˠͲ͜Ͱىಈ͢Δ͔΋&$4͕Α͠ͳʹ w %PDLFSϨΠϠΩϟογϡΛ࢖͏͜ͱͰεέδϡʔϧ௨Γͷ  όον࣮ߦ͕Մೳ w ىಈλΠϓͱͯ͠'BSHBUFΛ࢖͏͜ͱ΋ग़དྷΔ  αʔόϨεͷϝϦοτ΋ڗडՄೳ &$44DIFEVMF5BTL͸Կ͕͏Ε͍͠ͷ͔

Slide 47

Slide 47 text

w λεΫͷ࣮ߦཤྺ͕࣌ܥྻͰݟΕͳ͍  ࣌ؒ࣠ͰͲͷλεΫ͕ಈ͍͍ͯͨͷ͔σόοά͢Δͷ͕গ͠໘౗ɻɻ վળͯ͠΄͍͠ϙΠϯτ

Slide 48

Slide 48 text

w Ϋϥελ  λεΫΛಈ͔͢ϗετ &$ ͷू߹ମ  'BSHBUFͷ࣌͸ɺͨͩͷശ w %PDLFSΠϝʔδ &$3 w λεΫఆٛ  %PDLFSίϯςφͷىಈύϥϝʔλͷఆٛ w Ϋϥελ಺ͷ4DIFEVMF5BTL  $MPVE8BUDI&WFOUTͱཪͰ࿈ܞ͍ͯ͠Δ &$44DIFEVMF5BTLͰόονΛ૊ΉͨΊͷཁૉ

Slide 49

Slide 49 text

w Ϋϥελ  λεΫΛಈ͔͢ϗετ &$ ͷू߹ମ  'BSHBUFͷ࣌͸ɺͨͩͷശ w %PDLFSΠϝʔδ &$3 w λεΫఆٛ  %PDLFSίϯςφͷىಈύϥϝʔλͷఆٛ w Ϋϥελ಺ͷ4DIFEVMF5BTL  $MPVE8BUDI&WFOUTͱཪͰ࿈ܞ͍ͯ͠Δ λεΫఆٛΛ5FSSBGPSNͰ؅ཧ λεΫఆٛΛTerraformͰ؅ཧ

Slide 50

Slide 50 text

w όοναʔόͷӡ༻͕ଐਓԽ  ৽نొ࿥࣌͸ɺDSPOUBCͰखಈεέδϡʔϧొ࿥  ϦϦʔεલͷςετ࣮ߦ͸44)ܦ༝Ͱόοναʔό͔Βಈ࡞֬ೝ  DSPOUBCʹొ࿥͢Δͷ͸Ұ෦ͷΤϯδχΞͷΈ Ұ෦͔͠શ༰Λ஌Βͳ͍ঢ়ଶ w ΞϓϦέʔγϣϯϦϦʔεҎ֎͸ۃྗมߋΛՃ͑ͳ͍Α͏ʹ  γϯάϧϙΠϯτͳͷͰࢭ·ΔͱαʔϏεʹӨڹେ  ग़དྷΔ͚ͩมߋ͸Ճ͑ͣʹӡ༻͍ͨ͠ͱ͍͏ҙ͕ࣝಇ͘ όοναʔόͷଐਓԽղফ΁ TerraformͰ؅ཧ͢Δ͜ͱͰղܾ

Slide 51

Slide 51 text

w ։ൃऀ͕όονͷొ࿥มߋ࡟আΛ1VMM3FRVFTUܗࣜͰߦ͏  5FSSBGPSNͷఆٛΛݟΕ͹ͲΜͳόον͕͋Δͷ͔ཧղͰ͖Δ  DSPOUBCΛ୭͕ొ࿥νΣοΫ͢Δͷ͔໰୊Λղܾ w 5FSSBGPSNͷ࣮ߦ΋։ൃऀ͕ߦ͏  UGTUBUFϑΝΠϧΛ4Ͱڞ௨؅ཧ͢Δ͜ͱͰखݩͰ࣮ߦͰ͖ΔΑ͏ʹ  0QTνʔϜ΁ͷόονొ࿥ґཔ΋ෆཁʹ λεΫఆٛΛ5FSSBGPSNͰ؅ཧ

Slide 52

Slide 52 text

5FSSBGPSNͷఆٛ Descriptionॻ͘͜ͱͰͻͱ໨ͰΘ͔Δ ஋͸variables.tfͰ؅ཧ͢Δ͜ͱͰɺ ؀ڥࠩ෼Λٵऩ

Slide 53

Slide 53 text

13ϕʔεͰͷόονొ࿥ εςʔδϯάͰͷ dry-run݁ՌΛఴ͑ͯPR࡞੒

Slide 54

Slide 54 text

όονͷ։ൃϑϩʔ ίϯςφϕʔεͰ όονॲཧΛϩʔΧϧ։ൃ APͷϦϙδτϦͰ όονॲཧͷPR terraformͷϦϙδτϦͰ όονॲཧఆٛͷPR terraformܦ༝Ͱ ຊ൪ʹλεΫఆٛొ࿥ εςʔδϯάͷECSͰ Ұ౓खಈ࣮ߦ͠ಈ࡞֬ೝ terraformܦ༝Ͱ εςʔδϯάʹλεΫఆٛొ࿥ ϓϥοτϑΥʔϜมߋ͸ίϯςφͰ׬݁ DockerͷՄൖੑͷߴ͞Ͱͦͷ··ผ؀ڥ΁

Slide 55

Slide 55 text

Slide 56

Slide 56 text

w ίϯςφԽ͍ͯ͠ΔΞϓϦέʔγϣϯʹ͓͍ͯDSPOαʔόӡ ༻ͳ͠ʹεέδϡʔϧ࣮ߦ͕Մೳ w όοναʔόΛҙࣝͤͣʹɺόονॲཧϓϩηεͷվमͱ ͍͏ཻ౓ͰϓϥοτϑΥʔϜ΋ؚΊͯมߋ͕Մೳ w ఆٛΛίʔυ؅ཧ͢Δ͜ͱͰ௨ৗͷ։ൃαΠΫϧͰόονొ ࿥͕ՄೳʹͳΔ &$44DIFEVMF5BTLΛ࢖ͬͨόον࣮ߦ؀ڥͷ·ͱΊ

Slide 57

Slide 57 text

Slide 58

Slide 58 text

w ػցֶशͷલॲཧΛαʔόϨεͰ৽نߏங w όονॲཧͰٻΊΒΕΔ͜ͱ΋ଟ͍ϫʔΫϑϩʔ΋αʔόϨ εʹߏங ͜ͷࣄྫͰ͓࿩͢Δ͜ͱ

Slide 59

Slide 59 text

݄ؒ਺ඦສ݅ͷ౤ߘ͔Βෆద੾ͳίϯςϯπΛݟ͚ͭΔ

Slide 60

Slide 60 text

݄ؒ਺ඦສ݅ͷ౤ߘ͔Βෆద੾ͳίϯςϯπΛݟ͚ͭΔ શͯͷ౤ߘΛ໨ࢹ֬ೝ͢Δ͜ͱ͸ ग़དྷͳ͍ͷͰػցֶशΛ׆༻

Slide 61

Slide 61 text

ΞʔΩςΫνϟ

Slide 62

Slide 62 text

ΞʔΩςΫνϟ Ϟσϧ࡞੒લͷલॲཧʹ͓͚Δ όον࣮ߦΞʔΩςΫνϟʹ͍ͭͯઆ໌͠·͢

Slide 63

Slide 63 text

w 3%4ʹอଘ͍ͯ͠Δσʔλ͔ΒֶशσʔλΛநग़  "84(MVFΛ࢖ͬͨσʔλநग़ॲཧ w ֶशσʔλʹର͠ςΩετͷલॲཧͱϕΫτϧԽΛߦ͏  ίϯςφԽͨ͠όονॲཧΛ'BSHBUFλεΫͰ࣮ߦ ͲͷΑ͏ͳॲཧΛߦ͍ͬͯΔ͔

Slide 64

Slide 64 text

w σʔλͷநग़ɺม׵ɺϩʔυΛߦ͏ϚωʔδυαʔϏε w ؆୯ͳૢ࡞Ͱ&5-δϣϒΛߏஙՄೳ w αʔόϨεͳͷͰӡ༻ෆཁ͔ͭ௿ίετӡ༻͕Մೳ  &5-ॲཧ͸Ϛγϯύϫʔ͕ٻΊΒΕΔॲཧ͕ଟ͍ͷͰίετޮ཰͸ॏཁ  %16 %BUB1SPDFTTJOH6OJU ୯Ґͷ՝ۚ "84(MVFͱ͸

Slide 65

Slide 65 text

w 3%4ʹอଘ͞Ε͍ͯΔσʔλΛநग़ɾՃ޻͠ɺ4ʹอଘ w ॲཧͷ಺༁  σʔλ݅਺ɿ໿ສ݅  +PC࣮ߦ࣌ؒɿ෼  ग़ྗUTWσʔλɿ໿(#  ʲ"84(MVFΛ༻͍ͯ&5-؀ڥΛߏங͓ͨ͠࿩ʢ3%4GPS.Z42-ˠ4ʣʳ  IUUQTUFDIDPOOFIJUPDPNFOUSZ (MVFΛ࢖ͬͨσʔλநग़ॲཧ

Slide 66

Slide 66 text

w (MVFͰநग़ͨ͠࠷৽ͷσʔλΛػցֶशͰ࢖͑Δܗʹม׵ w 1ZUIPOΛ࢖ͬͨࣗવݴޠॲཧ͕ϝΠϯ  ಠࣗͷϥϯλΠϜΛ࢖͍͍ͨͷͰίϯςφԽ  4BHF.BLFSͷϏϧτΠϯίϯςφͰ͸࢖͍͍ͨϥΠϒϥϦ͕ରԠ͍ͯ͠ͳ͔ͬͨ w ։ൃϑϩʔ͸ϩʔΧϧ։ൃ13ϕʔε  NBTUFSϚʔδ࣌ʹ&$3ʹ%PDLFSΠϝʔδΛQVTI w αʔόϨεͳͷͰόον࣮ߦ࣌ͷΈ՝͕ۚൃੜ  ػցֶशͷલॲཧ͸ॏΊͷॲཧ͕ଟ͍ͷͰྉۚ໘ͰԸܙΛड͚΍͍͢ 'BSHBUFͰߦ͏લॲཧόον

Slide 67

Slide 67 text

w ετϨʔδ༰ྔʹ੍ݶ͕͋Δ  λεΫ಺ͰίϯςφͷϧʔτϘϦϡʔϜʹ(#ɺϚ΢ϯτ༻ͷڞ༗ϘϦϡʔ Ϝʹ(#ར༻Մೳ  ͜ΕΛ௒͑ΔϑΝΠϧΛѻ͏৔߹͸อଘઌΛ4౳ʹ͢Δඞཁ͕͋Δ  ΍&'4ͷϚ΢ϯτ͸ݱ࣌఺Ͱ͸ग़དྷͳ͍ 'BSHBUFͰେ͖ΊͷϑΝΠϧΛѻ͏৔߹ͷ஫ҙ఺

Slide 68

Slide 68 text

࣮ߦॱং͕ॏཁͳ ͭͷόονॲཧͰϫʔΫϑϩʔΛ૊Έ͍ͨ

Slide 69

Slide 69 text

ͲͷΑ͏ͳύλʔϯ͕͋Δ͔

Slide 70

Slide 70 text

w 424Λ࢖ͬͯδϣϒͷ࣮ߦॱংΛ੍ޚ  -BNCEB·ͨ͸$MPVE8BUDI&WFOUTܦ༝ͰޙଓόονΛىಈ  ΩϡʔΠϯάؒ࿈ͷຊདྷͷॲཧͱ͸ؔ܎ͳ͍ίʔυΛॻ͔ͳ͚Ε͹ͳΒͳ͍ w ॲཧຖʹΤϥʔ௨஌΍ϦτϥΠ੍ޚΛೖΕΔ  (MVFͰͷϦτϥΠ੍ޚͱΤϥʔ௨஌  όονॲཧͷίʔυͰϦτϥΠ੍ޚͱΤϥʔ௨஌ w ॲཧεςοϓ͕૿͑Δ΄Ͳશମ૾Λ೺Ѳ͢Δͷ͕ࠔ೉ʹͳΔ ΩϡʔΠϯάύλʔϯ

Slide 71

Slide 71 text

w ॲཧຖʹεέδϡʔϧ࣮ߦ  (MVFεέδϡʔϧ࣮ߦ ".   'BSHBUFεέδϡʔϧ࣮ߦ ".   ࠷ॳͷॲཧ͕͚ͯ͜ޙଓόον͕ಈ͍ͯ΋͍͍৔߹ͷΈʹ࢖͑Δ w ॲཧຖʹΤϥʔ௨஌΍ϦτϥΠ੍ޚΛೖΕΔ  (MVFͰͷϦτϥΠ੍ޚͱΤϥʔ௨஌  όονॲཧͷίʔυͰϦτϥΠ੍ޚͱΤϥʔ௨஌ wॲཧεςοϓ͕૿͑Δ΄Ͳશମ૾Λ೺Ѳ͢Δͷ͕ࠔ೉ʹͳΔ εέδϡʔϧ࣮ߦύλʔϯ

Slide 72

Slide 72 text

Slide 73

Slide 73 text

Slide 74

Slide 74 text

w "84͕ఏڙ͢ΔαʔόʔϨεϫʔΫϑϩʔαʔϏε w ࿈ܞ͍ͯ͠Δ"84ϦιʔεΛ؆୯ʹ੍ޚग़དྷΔ  ؆୯ʹݺͼग़͔ͭ͠δϣϒऴྃ଴͕ͪग़དྷΔ  ࿈ܞαʔϏε͸ঃʑʹ૿͍͑ͯΔ w +40/ͰϫʔΫϑϩʔΛఆٛ  ϦτϥΠ΍ΤϥʔϋϯυϦϯά͕Մೳ  ॲཧͷલޙؔ܎Λͦͷ··ϏδϡΞϥΠζͯ͘͠ΕΔ  4UFQ'VODUJPOTͱ͸

Slide 75

Slide 75 text

4UFQ'VODUJPOTͷఆٛ ॲཧᶃ ॲཧᶄ Τϥʔ௨஌ ΤϥʔϋϯυϦϯά

Slide 76

Slide 76 text

w TUBUF  ࣮ߦ͢Δॲཧ୯Ґ-BNCEB &$4λεΫ (MVFFUD  5ZQF۟Ͱॲཧ಺༰Λࢦఆ  5BTL ͳΜΒ͔ͷॲཧ࣮ߦ   $IPJDF ೖྗʹج͖ͮॲཧ෼ذ   8BJU Ұఆ࣌ؒεϦʔϓ w TUBUFNBDIJOF  TUFUFͷू߹ମ ϫʔΫϑϩʔຊମ   +40/ϕʔεͷ"NB[POεςʔτϝϯτݴޠͰఆٛ  ͜ͷ୯ҐͰϏδϡΞϥΠζ͞ΕΔ 4UFQ'VODUJPOTͷߏ੒ཁૉ

Slide 77

Slide 77 text

w $BUDI۟Ͱఆٛ͢Δ w ࣄલఆٛ͞ΕͨΤϥʔίʔυ  4UBUFT"--͢΂ͯͷΤϥʔ໊ʹҰக͢ΔϫΠϧυΧʔυ  4UBUFT5JNFPVUλΠϜΞ΢τؔ࿈  4UBUFT5BTL'BJMFEλεΫͷ࣮ߦࣦഊ  4UBUFT1FSNJTTJPOTఆٛͨ͠λεΫͷ࣮ߦݖݶ͕଍Γͳ͍ ΤϥʔϋϯυϦϯά

Slide 78

Slide 78 text

w 3FUSZ۟Ͱఆٛ͢Δ w ઃఆϑΟʔϧυ  &SSPS&RVBMTର৅ͱͳΔΤϥʔ໊  *OUFSWBM4FDPOET࠶ࢼߦ·ͰͷΠϯλʔόϧ  .BY"UUFNQUT࠷େϦτϥΠ਺  #BDLPGG3BUF࠶ࢼߦ࣌ͷ૿Ճ͢Δ৐਺ ྫඵɺඵɺඵɺɺɺ ϦτϥΠॲཧ

Slide 79

Slide 79 text

"84Ϧιʔεͱͷ࿈ܞ೥݄࣌఺ δϣϒͷϋϯυϦϯάΛ Step Functionsଆʹ೚ͤΒΕΔ

Slide 80

Slide 80 text

w ॲཧͷঢ়ଶΛϋϯυϦϯάͯ͘͠ΕΔͷͰ໘౗ͳ࣮૷͕ෆཁ w "84Ͱ׬݁͢ΔόονॲཧͷϫʔΫϑϩʔ͕૊Έ΍͍͢  (MVFˠ&$4ˠMBNCEBΈ͍ͨͳ"84αʔϏεͷ࿈ܞ  ෳ਺ͷ"84#BUDIΛ࢖ͬͨूܭॲཧ  TMBDL௨஌༻ͷڞ௨ͷMBNCEBΛ૊ΈࠐΉ w αʔόϨεͳͷͰӡ༻ෆཁͰϫʔΫϑϩʔ͕૊ΊΔ 4UFQ'VODUJPOTͷྑ͍ͱ͜Ζ

Slide 81

Slide 81 text

w ॲཧͷঢ়ଶΛϋϯυϦϯάͯ͘͠ΕΔͷͰ໘౗ͳ࣮૷͕ෆཁ w "84Ͱ׬݁͢ΔόονॲཧͷϫʔΫϑϩʔ͕૊Έ΍͍͢  (MVF&$4ͰαʔϏεؒ࿈ܥ  ෳ਺ͷ"84#BUDIΛ࢖ͬͨूܭॲཧ w αʔόϨεͳͷͰӡ༻ෆཁͰϫʔΫϑϩʔ͕૊ΊΔ 4UFQ'VODUJPOTͷྑ͍ͱ͜Ζ "84ͰϫʔΫϑϩʔΛ૊ΉέʔεͰ͸ ͔ͳΓ͓͢͢Ί

Slide 82

Slide 82 text

w ϦιʔεΛઐ༗ग़དྷΔͷͰίϯϐϡʔςΟϯάϦιʔεΛଟ ͘ར༻͢Δॲཧʹ޲͍͍ͯΔ  େن໛σʔλͷूܭॲཧ΍ػցֶशͷલॲཧ  ࢖ͬͨ෼͚ͩ՝ۚ͞ΕΔͷͰίετޮ཰͕ߴ͍ w ଞͷॲཧΛߟྀ࣮ͨ͠ߦܭը͕ෆཁ  ίϯϐϡʔςΟϯάϦιʔε໘ͷߟྀ  खΛೖΕΔΞϓϦέʔγϣϯ͚ͩΛߟ͑Ε͹ྑ͍ͷͰ։ൃ΍ࢼݧ͕͠΍͍͢ αʔόϨεͰόονॲཧΛ͢ΔϝϦοτ

Slide 83

Slide 83 text

Slide 84

Slide 84 text

"-#ϩάΛ,JCBOBͰݟΔ࢓૊ΈΛαʔόϨεʹ Amazon Elasticsearch Service ALB S3 Bucket Lambda Event   (time-based) 5෼ຖʹ όέοτʹϩάΛग़ྗ ObjectCreatedτϦΨ ͰLambda͕ىಈ ElasticserachʹBulkLoad GrokͰύʔε͠ɺΠϯ σοΫεొ࿥ ΤϯδχΞ͸ɺ Kibanaܦ༝ͰϩάΛݟΔ աڈ෼ͷΠϯσοΫεΛ ఆظతʹ࡟আ

Slide 85

Slide 85 text

͜ΕΒͷࣄྫ͔Βߟ͑Δ "84Ͱόον࣮ߦΛߟ͑Δ࣌ͷํ਑

Slide 86

Slide 86 text

w ·ͣ"84ͷϚωʔδυαʔϏεͰ࣮ݱग़དྷͳ͍͔ߟ͑Δ  ˠ΋͔ͨ͠͠ΒόονॲཧͰͳͯ͘΋Α͍Մೳੑ΋ඞવతʹαʔόϨεߏ੒ w -BNCEB 'BB4 Ͱ࣮ݱग़དྷͳ͍͔Λߟ͑Δ  ˠϥϯλΠϜͷ؅ཧ͕ෆཁͳͷͰ΍Γ͍ͨॲཧͷ͜ͱ͚ͩʹઐ೦ग़དྷΔ  ˠαʔόϨε͔ͭ"84Ϧιʔεͱॊೈͳ࿈ܞ͕Մೳ w ಠࣗͷϥϯλΠϜΛ࢖ͬͯόονॲཧ͕͍ͨ͠  ˠΞϓϦέʔγϣϯͷίϯςφԽ  ˠ&$44DIFEVMF5BTLPS"84#BUDIΛ࢖͏ LTͱ͍͏બ୒ࢶ΋ग़ͯ͘Δ w "84্ͷॲཧͰϫʔΫϑϩʔΛ૊Έ͍ͨ  ˠ4UFQ'VODUJPOTΛ࢖͏ "84Ͱόον࣮ߦΛߟ͑Δ࣌ͷํ਑

Slide 87

Slide 87 text

Slide 88

Slide 88 text

Slide 89

Slide 89 text

Slide 90

Slide 90 text

Slide 91

Slide 91 text

ίωώτͰ͸ΤϯδχΞੵۃ࠾༻தͰ͢ʂ  ڵຯ͕͋Δํɺ΋ͬͱ࿩Λฉ͍ͯΈ͍ͨͱࢥ͏ํ͕͍·ͨ͠Βɹ ੠Λ͔͚͍͔ͯͨͩ͘ɺɹ!TIOBHBJ·Ͱ͝࿈བྷ͍ͩ͘͞ ͍͞͝ʹએ఻