Share
Embed
fluct-migrate-aws-from-on-premises
「AWSへのマイグレーションのその先に ~リフト&シフトからのクラウド最適化~」でのfluct事例発表
"Engineers in VOYAGE ― 事業をエンジニアリングする技術者たち"
第一章 fluct の続きのお話
※ 2021年11月開催の Engineers in CARTA vol.1 #AWS にて資料を一部更新しました
Takuya Nishigori
June 03, 2021
Transcript
46 slides
-
ࣗݾհ @_nishigori גࣜձࣾ fluct (CARTA HOLDINGS ͷάϧʔϓձࣾ ) ։ൃຊ෦ ΤϯδχΞ
◦ SRE (Site Reliability Engineering ) ◦ Release Engineerin g ◦ Ϗϧυ৬ਓ ◦ ΞϓϦέʔγϣϯίʔυಡΈॻ͖ ◦ AWS fluct ೖࣾޙʹ৮Γ࢝Ίͨ -
Outline ◦ αʔϏεɾߏͷྺ࢙ ◦ ݱঢ়ҡ࣋ͱ՝ղܾͷδϨϯϚ ◦ ͳͥAWSͳͷ͔ ◦ ݕূɺܾஅ ◦
͍͟ɺϦϑτ & γϑτ ◦ ;Γ͔͑Γ -
About fluct גࣜձࣾ fluc t “גࣜձࣾ fl uctʮϝσΟΞͷΛڞ͢ΔʯΛϛογϣϯʹWebϝσΟ ΞεϚʔτϑΥϯΞϓϦʹର͠ɺSSP(Supply-Side Platform)ʮ
fl uctʯͱࠃ Ͱ3ࣾͷΈೝఆΛड͚ͨʮαΠτӡӦऀ͚Googleೝఆύʔτφʔʯͱ͠ ͯɺʮDoubleClick Ad ExchangeʯͷಋೖٴͼίϯαϧςΟϯάΛߦ͏ϝσΟ ΞϚωλΠζࢧԉࣄۀΛ࣠ͱͨ͠ΞυςΫϊϩδʔΧϯύχʔͰ͢ɻ ” https://corp. fl uct.jp/ fluct SSP (Supply Side Platform ) WebαΠτωΠςΟϒΞϓϦͳͲͷഔମʹ࠷దͳࠂΛࣗಈ Ͱ৴͠ɺࠂऩӹΛ࠷େԽ͢ΔͨΊͷαʔϏεΛఏڙ ◦ RTB (Real Time Bidding ) ◦ etc … -
About fluct SSP γεςϜʹٻΊΒΕΔੈք ◦ ߴτϥϑΟοΫʢ݄ؒ2000ԯճҎ্ͷࠂϦΫΤετʣ ◦ ϨΠςϯγ ◦ ʢεέʔϥϏϦςΟʣ
ࠂ৴αʔόʔʢࠂΛબͿׂʣ ಠཱՔಇ ◦ αʔόʔҟৗ͕αʔϏεʹۃྗӨڹΛ༩͑ͳ͍ঢ়ଶʹ ◦ ނো࣌ʹࣗಈͰαʔϏεΞτ ◦ ΦϯϓϨϛεɾAWSͷϋΠϒϦουͳஔ ◦ ಠཱ͍ͯ͠ΔͷͰॴΛબͳ͍ ◦ ΦϯϓϨϛεৗ࣌ඦ ◦ AWSे~ ඦʹΦʔτεέʔϧ ϨΠςϯγͱ҆ఆੑΛੜΉΞʔΩςΫνϟ - SSPͷݱʹֶͿɺߴՄ༻ੑͷͭ͘Γํ: https://eh-career.com/engineerhub/entry/2019/07/12/103000 -
ϋΠϒϦουͳߏʹࢸΔ·Ͱ ◦ αʔϏεϩʔϯνॳΦϯϓϨϛεͷΈʢʣ ◦ ΦϯϓϨϛεαʔόʔௐୡ·ͰͷຒΊ߹ΘͤͰAWSར༻Λ͡Ίͨ ◦ ࣌ͷ༧Λ͑ΔτϥϑΟοΫ૿ ◦ ࠂ৴γεςϜΦϯϓϨϛεো࣌ͷୀආઌͱͯ֬͠อ ◦
ωοτϫʔΫػثোͰɺશϦΫΤετΛAWSʹৼͬͨաڈ Engineers in VOYAGE - ࣄۀΛΤϯδχΞϦϯά͢Δٕज़ऀͨͪ: https://www.lambdanote.com/products/engineers-in-voyage About fluct SSP -
͜ͷൃදɺ ॻ੶ ʮEngineers in VOYAGEʯ ୈҰষ “fluct — ࠂ৴ͷཪͷٕज़ऀͨͪ ”
ͷଓ͖ͷޠͰ͢ Engineers in VOYAGE - ࣄۀΛΤϯδχΞϦϯά͢Δٕज़ऀͨͪ: https://www.lambdanote.com/products/engineers-in-voyage About fluct SSP -
γεςϜͷॅΈ͚ ◦ 30લޙͷαϒγεςϜ͕ଘࡏ ◦ ։ൃڥࢼ࡞ΞϓϦέʔγϣϯओʹAWSͰ TCO (Total Cost of Ownership)
ͷ؍ ◦ ༧ଌՄೳͳγεςϜෛՙΦϯϓϨϛεͰ ◦ ʰnઌಉنͷࠂ৴Λ͍ͯ͠ΔͩΖ͏ʱ ◦ ༧ଌෆՄೳͳྨAW S ◦ ৽͍͠Ϗδωενϟϯε ◦ ಥൃతͳ˓˓ About fluct SSP 2019࣌ͷfluct γεςϜશମ -
ݱঢ়ҡ࣋ͱ՝ղܾͷδϨϯϚ ֦େ͍ͯ͘͠γεςϜ ◦ ৽αʔϏεͷϩʔϯν ◦ ෳࡶੑΛ૿͢ࠂۀք ◦ ࠓ·Ͱ༧ଌՄೳͩͬͨൣғ༧ଌෆՄೳʹ ◦ ϋʔυΣΞߪೖͷݮՁঈ٫༻
◦ 3ઌ? 5ઌʁಡΈͮΒ͘ͳ͖ͬͯͨ ◦ ॊೈੑͷԼʹܨ͕Γ͔Ͷͳ͍ 2019࣌ͷfluct γεςϜશମ -
ݱঢ়ҡ࣋ͱ՝ղܾͷδϨϯϚ ΫϥυαʔϏεͷ͕·͙Δ͍͠ ◦ γεςϜͷઃܭ͕ϋʔυΣΞͰݶఆ͞Εͨ͘ͳ͍ ΦϯϓϨϛεʹڧ͍ਓࡐΛܧଓతʹ֫ಘͰ͖Δͷ͔ ◦ ৽ଔɺΫϥυωΠςΟϒੈ ◦ ΩϟϦΞܗͱͷΪϟοϓ͕ੜ·ΕΔ͜ͱ ◦
࣮ΦϯϓϨϛεࣄۀऀͦ͏…ʁʢԱଌʣ ◦ අ༻Ҏ֎ʹ͔͔Δർฐ ◦ ॻྨରԠ ◦ αϙʔτ͔Βͷి ◦ etc … -
ݱঢ়ҡ࣋ͱ՝ղܾͷδϨϯϚ ࣮ࡍͣͬͱΜͰ·ͨ͠ ◦ 5΄ͲΜͰͷ܁Γฦ͠ ◦ ʹҰग़Δʮશ෦ΫϥυʹҠΔͷͲ͏ͩΖ͏ʁʯ ◦ ͱ͋ΕɺΦϯϓϨϛεͷ΄͏͕·͍ͩ҆…ʁ ◦ ʢ͋ΕʁΦϯϓϨϛεͷ΄͏͕োසଟ͘ͳ͍…ʁʣ
◦ λΠϛϯά͍͕ͭదͳͷ͔ ◦ ͍ͣΕશͯΫϥυαʔϏεͷΔ͔͠Εͳ͍͕ ◦ ݮՁঈ٫ͷλΠϛϯάɺϥοΫ͝ͱʹόϥόϥ ◦ ʮAWSͰผͷۤ࿑͕ੜ·ΕΔͰ͠ΐʁʯ -
զʑ͕Γ͍ͨ͜ͱԿͳͷ͔ ࣄۀͷΛམͱ͞ͳ͍બΛ ◦ ෳࡶԽ͢Δࠂࣾձɺٕज़ΛؚΊͨదԠ ◦ ւ֎ͷࢢ֫ಘ ࣄۀ๊͕͑ΔղܾͷۙಓΛ ◦ ΑΓιϑτΣΞͷ։ൃʹྗ͍ͨ͠ ◦
શͯͷΤϯδχΞ͕AWSʹ৮ΕΔঢ়گ͖ͭͬͯͨ͘ ◦ ʮΠϯϑϥʯͱ͍͏۠ผΛ࣋ͨͳ͍ੈք ◦ ʢͪΖΜ N/W ͕ࣝඞཁͳ͍ͱ͍͏બͰͳ͍ʣ -
αϙʔτͷखް͞ͱ૬ੑ ◦ ΤϯλʔϓϥΠζαϙʔτܖ ◦ ஸೡɻࠂۀքपΓͷ͜ͱৄ͍͠୲ऀ ◦ Slack Ͱͷίϛϡχέʔγϣϯ ◦ ϥϑͳฐࣾελΠϧʹ߹ΘͤͯΒ͍͑ͯΔ
◦ Ϩε͍ νʔϜ͕AWSʹ׳Ε͍ͯΔ ◦ νʔϜͰ৽نɾະ༻ʢAWSʣαʔϏεΩϟον Ξοϓ͢Δ͕Ͱ͖ͨ͜ͱىҼ ◦ ΫϥυαʔϏεͰAWS͕Ұ൪େ͖ͳنͰѻͬͯ ͍ΔʢҰ෦γεςϜͰผͷΫϥυαʔϏεΛར༻ ͳͥAWSͳͷ͔ -
AWS EC2 Graviton Processor (Graviton2 ) "Amazon EC2 C5 ΠϯελϯεΑΓɺ࠷େ
40ˋ ߴ͍ίετ ύϑΥʔϚϯεΛൃش͠·͢ " https://aws.amazon.com/jp/ec2/graviton/ https://aws.amazon.com/jp/about-aws/whats-new/2020/06/ ◦ Architecture = arm6 4 ◦ ϋϠΫφϧʂʂʂϠεΫφϧʂʂʂ AWS Migration Acceleration Program: https://aws.amazon.com/jp/migration-acceleration-program/ ͳͥAWSͳͷ͔ -
AWS Migration Acceleration Program (MAP ) ◦ AWSͷΫϥυҠߦϓϩάϥϜ ◦ 2019ͷ
re:Invent ͰηογϣϯτϥοΫ͋Γ ◦ https://youtu.be/lR27wRbmzoo ◦ Ҡߦ४උͷͨΊͷϓϩάϥϜ༻ҙ͞Ε͍ͯΔʢMRPʣ ◦ ϑΟʔυόοΫͰز͔ͭࢪࡦఏҊΛ͍͍ͨͩͨ ◦ نʹΑͬͯҠߦରͷAWSར༻ྉΫϨδοτ͕༩ ◦ ͜Ε͕ʢૣʑʹʣҠߦ͢ΔܾΊखʹʂ AWS Migration Acceleration Program: https://aws.amazon.com/jp/migration-acceleration-program/ ͳͥAWSͳͷ͔ -
ঈ٫ࢼࢉ ͱ AWSར༻ྉΫϨδοτ ◦ ՁͱAWS MAP࣮ࢪͰ༩͞ΕͨΫϨδοτͷֹۚਪҠͷܭࢉ ◦ Ձ͕େ͖͍͏ͪΦϯϓϨϛεҾ͖ଓ͖Քಇ ◦ ঈ٫ظ͕ؒ༨ͬͯͯҠߦͨ͠΄͏͕ϝϦοτ͕େ͖͍
ΦϯϓϨϛεҡ࣋ͷ··Ͱ͍ͬͨ߹ͱൺֱ ◦ গ҆͘͠ͳΓͦ͏ ◦ ࢼࢉͷஈ֊Ͱ҆͘ͳΔ͜ͱ͚͔ͩΕ͍͍Ԙകʹ ◦ ίετݮҠߦॲͷ͍ͭͨޙʹूதతʹߦ͍ͬͯ͘ AWSҠߦݕূ -
FYI: ͦͷ΄͔ͷׂҾࢪࡦ ʢಉΠϕϯτͰઆ໌͕͋ΔͨΊׂѪʣ ◦ Reserved Instanc e ◦ fluct Ͱߪೖͯ͠1୯Ґ
◦ Saving Plan s ◦ Spot Instanc e ◦ https://aws.amazon.com/jp/ec2/spot/instance-advisor/ ◦ ҠߦظؒதʹEC2 Instanceྉ͕ۚ҆͘ͳΔ͔…ʁʢظ AWSҠߦݕূ AWSͷϚΠάϨʔγϣϯͷͦͷઌʹ ʙϦϑτˍγϑτ͔ΒͷΫϥυ࠷దԽʙ: https://pages.awscloud.com/JAPAN-event-OE-Migration-20210603-reg-event.html -
εέδϡʔϧ ◦ AWSҠߦΛܾஅ͢Δલʹطʹ৽نߪೖ͍ͯͨ͠ ◦ ϦϛοτΦϯϓϨϛεଆͷαʔόʔอकظݶͱಉ͡ ◦ ༨༟Λ࣋ͬͨεέδϡʔϧʹ ◦ ͳΔ͘͘Ҡߦ͢Δ ◦
AWSҠߦ֎ͷ༧ظͤ͵Πϕϯτʹࠨӈ͞Εͳ͍ AWSҠߦݕূ ఆͨ͠େ·͔ͳεέδϡʔϧ -
ΤϯδχΞͷஅɻձࣾͷܾஅ ͜͜·ͰશͯΤϯδχΞνʔϜͷஅ ◦ ܦӦਞͷઆ໌ผ్ߦͬͨʢཧ͍ͭͰʹʣ ◦ һձٞͰʢCTO͕?ʣ͍͍ײ͡ʹઆ໌ͯ͘͠ΕͨΑ͏ ◦ దͳݖݶҠৡ ◦ ͤͯΒ͍ͬͯΔ
◦ Ή͠ΖΦϯϓϨϛεߪೖͰͷٞӠʑϒϩοΫཁૉͩͬͨͷͰ ◦ νʔϜͰ ΦϯϓϨϛε V.S. AWS ͱ͍ͬͨਪਐରཱੜ·Εͳ͔ͬͨ ◦ ߹ཧతͳཧ༝͕͋ΕͦΕΛબ͖͢ ◦ Α͘ѱ͘ݻ͍ࣥͯ͠ͳ͍ʢΑ͍ʣ Ҡߦͷܾஅ Engineers in VOYAGE - ࣄۀΛΤϯδχΞϦϯά͢Δٕज़ऀͨͪ: https://www.lambdanote.com/products/engineers-in-voyage -
࣮ࡍ̏ਓͰҠߦ ◦ ෦ॺͷΤϯδχΞ30໊લޙ ◦ ྗେࣄ ◦ ͜ͷ3໊͡Όͳ͍ͯͣ͘Ε୭͔͕͔ͬͨ ◦ ۩ମతʹ1ҎͰશͯҠߦ͢ΔॲΛݐͯΔඪ ◦
ҠߦޙAWS࠷దԽ͚ͯγϑτʢޙड़ʣ ◦ ΦϯϓϨϛεͷϥοΫఫୀʢཧͰӡͿʣ৽ଔͷ໘ʑͱҰॹʹ ◦ ΤϯδχΞਓੜͰཧ৮Δ࠷ޙͷػձ͔ Ϧϑτˍγϑτ -
ࠂ৴αʔόʔͷҠߦ ◦ ݩʑͷϋΠϒϦουߏΛঃʑʹAWSʹൺҠಈ ◦ Route53 Record > weigh t ◦
EC2 Instance++ (AutoScaling ) ◦ EC2 Instance family C5d serie s ◦ σΟεΫॻ͖ࠐΈ͕ଟ͍ͷͰ Ephemeal-Dis k ◦ ಉλΠϛϯάͰ Root EBS Λ gp2 ͔Β gp3 Ϧϑτˍγϑτ -
ॲཧΛ෦తʹEC2͔ΒΓग़͠ ◦ CRON JOB, ϩάऩू etc … ◦ ϦΫΤετॲཧΛछผ͠ECS, LambdaҠߦ
◦ ΤϯυϙΠϯτϨϕϧͰͷΓ͚ ◦ ϚωʔδυαʔϏεͷར༻ ◦ DynamoDB, Kinesis Data Stream, … ◦ ΈϙΠϯτAWSαϙʔτʹ૬ஊ ◦ ઌͷݮՁঈ٫λΠϛϯάΛΈͯΏͬ͘Γ࣮ࢪ Ϧϑτˍγϑτ ϞϊϦε͔ΒϚΠΫϩαʔϏε ― ϞϊϦεΛਐԽͤ͞Δ࣮ફҠߦΨΠυ: https://www.oreilly.co.jp/books/9784873119311/ -
ࠂ৴αʔόʔϞϊϦεҡ࣋ ◦ ϞδϡϥʔϞϊϦεͰͷͱݱঢ় ◦ monorepoཧ ◦ ಠࣗͷฒྻϏϧυγεςϜ ◦ ̍ʹճͷϦϦʔε ◦
छྨ͋Δࠂ৴αʔόʔͰ͍ͪΞϓϦέʔ γϣϯͷσϓϩΠ͕ΕΔ͜ͱك ◦ ϨΠςϯγʔΛԿΑΓؾʹ͢Δʢmsͷੈքʣ ◦ ղΑΓ݁߹ʹΑΔརΛڗड ◦ ϞχλϦϯά߲ʑ૿Ճத ͱݴ͑ɺదͳղ୯ҐΛࡧ͍ͯ͠Δ Ϧϑτˍγϑτ ϞϊϦε͔ΒϚΠΫϩαʔϏε ― ϞϊϦεΛਐԽͤ͞Δ࣮ફҠߦΨΠυ: https://www.oreilly.co.jp/books/9784873119311/ -
Graviton2 ରԠͷલ͠ ◦ Apple Silicon (M1 Mac) ొ͋Γ ◦ ։ൃڥͷ
arm64 ରԠ߹ΘͤͨରԠΛ ◦ x86_64 ͱฒྻՔಇ͠ͳ͕ΒҠߦ ◦ ࠷ऴతʹ࣮ݕূ ◦ ͍ͭͰϩʔϧόοΫՄೳʹ ◦ ࠂ৴αʔόʔͷϕʔεAMIࣗલϏϧυ ◦ RockyLinux 8. 4 ◦ Kernel Update (like amazon-linux-extras kernel-ng ) ◦ Install SSM Agent, AWS CL I ◦ etc… Ϧϑτˍγϑτ x86_64 ͔Β arm64 ༷ࢠݟ͠ͳ͕ΒΓସΘΔ༷ࢠ -
Multi Architecture Support for Graviton 2 https://github.com/aws/aws-graviton-getting-started ◦ RPM ύοέʔδ
◦ aarch64ެࣜఏڙ͕ແ͍ͷࣗલϏϧυ ◦ Puppet manifest (Configuration Management) ◦ ΞϓϦέʔγϣϯίʔυͷରԠ ◦ fluctͷίʔυϨϕϧͰ΄΅มߋͳ͠ ◦ ϏϧυγεςϜ (Makefile) ͰࠩҟΛٵऩ ◦ ΞʔΩςΫνϟ͝ͱʹArtifact Λ ฒߦϏϧυ ◦ s3://xxxxx/fluct-xxx-aarch64.tar.g z ◦ s3://xxxxx/fluct-xxx-x86_64.tar.g z ◦ Amazon ECR Image (docker buildx) Ϧϑτˍγϑτ -
͍ͪΞϓϦέʔγϣϯͰGraviton2ҠߦલޙͷίετਪҠʢCost Explorerʣ ࠂ৴αʔόʔશͯGraviton2Ҡߦ ◦ ͋ͱΦϯϓϨϛεଆͷঈ٫ʹ߹Θͤͯਵ࣌ൺมߋ ύϑΥʔϚϯε্ʹΑΔίετݮ ◦ ϐʔΫ࣌ ඵؒ 3
~ 5 ສϦΫΤετΛࡹ͖ͭͭ ◦ Πϯελϯε͕ C5d ͱൺ 60% ͰՔಇ (C6gd ) ◦ Price 30 ~ 40% ݮʢεϙοτՁ֨มಈ͋Γʣ ◦ ٯʹͷগͳ͍ʢΠϯελϯεͷʣαϒγεςϜͰ ͦ͜·Ͱֹۚݮ͞Εͳ͔ͬͨ Ϧϑτˍγϑτ -
Spot by NetAp p “Going beyond cloud analytics and recommendations,
Spot by NetApp automates and optimizes your cloud infrastructure in AWS, Azure or Google Cloud to deliver SLA-backed availability and performance at the lowest possible cost.” - https://docs.spot.io/ Case fluc t ◦ AWSͰҰඞཁͳ෦Λସར༻ ◦ EC2, ECS on EC2 ͷεϙοτΠϯελϯεཧ ◦ Cost Analyzing for Multi Clou d Ϧϑτˍγϑτ -
Deployment U I AWS Code γϦʔζͰσϓϩΠج൫Λߏங͢ΔͷͰͳ͘ Spot ElastiGroup (ίϯϐϡʔτϦιʔεཧʣΛར༻ ◦
batch size ࢦఆʢn%ͣͭΠϯελϯεೖΕସ͑ʣ ◦ ࣗಈͰELBͷdetach / attac h AutoScal e ◦ ϦΫΤετ࣮͔Βͷ༧ଌεέʔϦϯά ◦ %ϕʔεͷΩϟύγςΟࢦఆ ◦ AWS্Ͱ࣮ݱͤ͞Δʹ Lambda ར༻Λఆ ◦ Scheduled Scalin g ◦ னɾͷϐʔΫલʹઌʹεέʔϧΞτ͍ͯ͠Δ ◦ ECS on EC2 εέʔϧΠϯલͷࣗಈdraining Ϧϑτˍγϑτ ৴αʔόʔͷσϓϩΠ࣌ͷը໘ -
EC2 Spot Request, Spot Instanc e ◦ SpotՁ֨ࣗಈௐ ◦ ઓུΛબՄೳʢίετॏࢹɾόϥϯεܕʣ
◦ ྫ. AZຖʹΛἧ͑Δ ◦ EC2 Spot InstanceมಈʹΑΔΦϯσϚϯυࣗಈ͑ ◦ fluct Ͱͯ͢εϙοτΠϯελϯεࢦఆ ◦ C6g εϙοτΠϯελϯεΛ༏ઌ ◦ ރׇͨ͠߹ʹ M6g ͕ར༻͞ΕΔ ΦϯσϚϯυൺֱͰׂҾ͞ΕͨྉۚͷҰఆׂ߹Λɺ Spot by NetApp ʹࢧ͍ Ϧϑτˍγϑτ spot priceߴಅ࣌ɺΦϯσϚϯυΠϯελϯεʹࣗಈͰΓସΘΔ༷ࢠ -
Continuous Optimization (ܧଓత࠷దԽ) ◦ ʑͷ։ൃαΠΫϧʹΈࠐΉ ◦ ίετਪҠܧଓతͳܭଌͱվળΛ ◦ ओཁͳΫϥυαʔϏεͰಉ͡ΞϓϩʔνΛऔΕΔ ◦
spot.io Cloud Analyzer Ϧϑτˍγϑτ https://docs.spot.io/?id=we-fit-in-your-delivery-pipeline -
Ϧϑτˍγϑτ FYI: Βͳ͔ͬͨ͜ͱ ◦ AWS τϨʔχϯά ◦ शख़ʹΑ࣮ͬͯࢪ͔ͨ͠ ◦ ંΛݟͯ
◦ OSมߋ ◦ ·ͣΦϯϓϨϛεͱಉ͡Ͱ (CentOS վΊ RockyLinux) ◦ Ubuntu Γ͑গ͠໎ͬͨʢ͍͔ͭػձ͕͋Ε ◦ ECS Bottlerocket Ͱͳ͘ Amazon Linuxʢͨͩͷ༷ࢠݟ -
Ϧϑτˍγϑτ FYI: ࠓޙΓͦ͏ͳ͜ͱ ◦ ϚωʔδυαʔϏεʹΕΔͷΔ ◦ ʢ͓ͪͯ͠·͢ʂʣAmazon TimeStream at Tokyo
regio n ◦ Region୯Ґͷো࣌ͷϑΣΠϧΦʔόʔʢOsaka Regionʣ ◦ ʢ͓ͪͯ͠·͢ʂʣEC2 Graviton2 at Osaka region