ヤプリにおけるAWSコスト最適化の取り組み

Transcript

1. ϠϓϦʹ͓͚Δ AWSίετ࠷దԽͷ औΓ૊Έ
2. Speaker ϓϩμΫτ։ൃຊ෦ ج൫෦ SREάϧʔϓ ࡾڮ ᇈଠ େखSIerͰΠϯϑϥΤϯδχΞ/Ϋϥ΢υΞʔΩςΫ τͱͯ͠ͷܦݧΛੵΈɺ2022೥4݄ΑΓϠϓϦͷ SREϝϯόʔͱͯ͠δϣΠϯɻݱࡏ͸SREϓϥΫς ΟεͷಋೖΛத৺ͱͨ͠ۀ຿ʹྭΜͰ͍ΔɻAWSͱ New Relicͱ່(ࠓ೥࢈·Εͨ)ͱϛχνϡΞμοΫε (·ͩࣂͬͯͳ͍)͕޷͖ɻҭٳ෮ؼϗϠϗϠ
3. 01 02 03 04 05 AWSίετ࠷దԽͷऔΓ૊Έഎܠ ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ ۩ମతͳίετ࠷దԽࢪࡦ ͦͷଞͷऔΓ૊Έ ·ͱΊͱࠓޙͷ՝୊
4. 01 AWSίετ࠷దԽͷ औΓ૊Έഎܠ
5. ͜Ε·Ͱ͸։ൃεϐʔυ΍αʔϏε඼࣭͕༏ઌͰੵۃతͳ౤ࢿ͕ߦΘΕ͖͕ͯͨɺԁ҆ͷ ӨڹʹΑΓίετ͕ॏཁࢹ͞ΕΔΑ͏ʹͳͬͨ ԁ҆ͷӨڹͰίετ͕ॏཁࢹ͞Ε࢝ΊΔ 01 AWSίετ࠷దԽͷऔΓ૊Έഎܠ ্ঢ܏޲ 2021೥1݄ 5݄ 9݄ 2022೥1݄ 5݄ 9݄ ച্ʹର͢ΔΠϯϑϥίετൺ཰
6. ΠϨΪϡϥʔͳίετ૿ʹ͸ରԠ͖ͯͨ͠ 01 AWSίετ࠷దԽͷऔΓ૊Έഎܠ • ίετͷେ͖͍AWSΞΧ΢ϯτͷίετਪҠΛि࣍Ͱ֬ೝ͠ରԠΛߦ͖ͬͯͨ • AWSͰ͸Cost Anomaly DetectionͰҟৗ஋ͷࣗಈݕग़΋Ͱ͖ΔΑ͏ʹ͍ͯ͠Δ 0 50 100 150 200 9/1 9/2 9/3 9/4 9/5 9/6 9/7 RDS ECS CloudWatch ໨ࢹͰͷίετ૿Ճ ܏޲ͷ֬ೝ Cost Anomaly DetectionͰͷࣗಈݕग़
7. ैདྷͷ΍Γํͷམͱ݀͠ 01 AWSίετ࠷దԽͷऔΓ૊Έഎܠ • ͦ΋ͦ΋ͷίετ͕࠷దͰ͋Δͱ͸ݶΒͳ͍ • ࠓճͷΑ͏ʹத௕ظεύϯͰΠϯϑϥίετͷൺ཰্͕ঢ͍ͯ͠Δ৔߹ʹؾ͚ͮͳ͍ 0 50 100 150 200 9/1 9/2 9/3 9/4 9/5 9/6 9/7 RDS ECS CloudWatch ࣮͸࠷ॳ͔Βա৒εϖοΫ ୹ظ܏޲͔͠ݟ͍ͯͳ͍
8. ৽ͨʹ௚໘ͭͭ͋͠Δ՝୊ 01 AWSίετ࠷దԽͷऔΓ૊Έഎܠ ࣄۀ֦େʹ൐͍૿Ճ͢ΔAWSΞΧ΢ϯτʹ໨͕ಧ͔ͳ͘ͳΓͭͭ͋Δ prod stg dev prod stg dev prod stg dev αʔϏεA༻ͷΞΧ΢ϯτ αʔϏεB༻ͷΞΧ΢ϯτ αʔϏεBͷҕୗઌ༻ͷ ΞΧ΢ϯτ SREνʔϜ શһ͕೺Ѳ Ұ෦ϝϯ όʔͷΈ೺Ѳ ར༻ঢ়گෆ໌
9. 01 AWSίετ࠷దԽͷऔΓ૊Έഎܠ ࠓճͷऔΓ૊ΈʹΑΓ ͜Ε·Ͱͷ՝୊Λղܾ͢Δͱͱ΋ʹɺ ୹ظؒͰ$10,000/݄ͷίετΛ ࡟ݮ͢Δ͜ͱʹ੒ޭͨ͠
10. 02 ͲͷΑ͏ʹίετ࠷దԽʹ औΓ૊Μ͔ͩ
11. Cloud Financial Management(CFM)ϑϨʔϜϫʔΫʹ΋͋ΔΑ͏ʹܧଓతͳίετ࠷దԽ Λ࣮ݱ͢Δʹ͸ՄࢹԽ͕ඞཁͰ͋Δ ՄࢹԽ͔Β࢝ΊΔ 02 ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ - ՄࢹԽ https://aws.amazon.com/jp/blogs/news/aws-cost-optimization-guidebook/ ίετΛ࠷దԽ͠Ϧιʔε ޮ཰ͱՁ஋Λ࠷େԽ͢Δ
12. • ΞΧ΢ϯτԣஅͰίετਪҠΛ֬ೝ͍ͨ͠ • த௕ظͰͷ܏޲Λ෼ੳͰ͖ΔΑ͏ʹ͍ͨ͠ • Cost ExplorerͷΑ͏ʹৄࡉͳྉۚ಺༁͕ݟ͑ΔΑ͏ʹ͍ͨ͠ ͱ͸ݴͬͯ΋… • ࡞ΓࠐΈ͸ಋೖ΍ϝϯςφϯε͕େมͳͷͰආ͚͍ͨ • खಈͰͷΦϖϨʔγϣϯ΋ۃྗආ͚͍ͨ • Cost ExplorerͰຖճؤுΔͷ͸ͭΒ͍ ࠷ߴͷμογϡϘʔυΛ࡞Γ͍ͨʂʂ 02 ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ - ՄࢹԽ
13. AWS͔Βఏڙ͞Ε͍ͯΔίετ࠷దԽͷͨΊͷμογϡϘʔυ ςϯϓϨʔτ͕ఏڙ͞Ε͍ͯΔͨΊ਺෼Ͱߏங͕Մೳ Cloud Intelligence Dashboards(CID)ʂʂ 02 ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ - ՄࢹԽ https://www.wellarchitectedlabs.com/cost/200_labs/200_cloud_intelligence/ ༷ʑͳαʔϏεͱ࿈ܞ ؍఺ͷҟͳΔμογϡ ϘʔυΛෳ਺ఏڙ
14. CIDͷಛ௃ 1 02 ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ - ՄࢹԽ ͲͷΞΧ΢ϯτͷͲͷϦιʔε ͷίετ͕ߴ͍͔Ұ໨ྎવ த௕ظͰͷΞΧ΢ϯτશମͷ ίετਪҠ͕Θ͔Δ https://d1s0yx3p3y3rah.cloudfront.net/anonymous-embed?dashboard=cudos
15. CIDͷಛ௃ 2 02 ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ - ՄࢹԽ S3 Storage Lens ͳͲͷίετ࠷దԽʹ໾ཱͭػೳ ͱͷ࿈ܞ ίετ࠷దԽͷͨΊͷਪ঑ࣄ ߲Λදࣔ https://d1s0yx3p3y3rah.cloudfront.net/anonymous-embed?dashboard=cudos
16. CIDͷಛ௃ 3 02 ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ - ՄࢹԽ https://d1s0yx3p3y3rah.cloudfront.net/anonymous-embed?dashboard=cudos ࠓޙ༗ྉԽ͞ΕΔϦιʔεʹ΋ ૉૣ͘ରԠ
17. • ਝ଎ʹίετΛ࠷దԽ͢ΔΫΠοΫ΢Οϯ࠷దԽࢪࡦ͔Βݕ౼͢Δ • ఆ൪ͷࢪࡦ͚ͩͰͳ͘ɺ͔ͬ͠Γ෼ੳ্ͨ͠ͰࣗࣾͰͷΫΠοΫ΢ΟϯࢪࡦΛ໚ࡧ͢Δ ࠷దԽࢪࡦΛݕ౼͢Δ 02 ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ - ࠷దԽ https://aws.amazon.com/jp/blogs/news/aws-cost-optimization-guidebook/ ఆ൪ͷΫΠοΫ΢Οϯ ࠷దԽࢪࡦ
18. 1. ίετͷେ͖͍ϦιʔεΛϦετΞοϓ͠ɺݪҼ෼ੳΛߦ͏ 2. ࠷దԽ༨஍͕͋ΔϦιʔεʹର͠ࢪࡦΛݕ౼͢Δ 3. ࢪࡦͷ࣮ࢪޮՌͱ࣮ࢪ೉౓Λࢉग़͠༏ઌ౓Λ͚ͭΔ ೉қ౓ରޮՌͰࢪࡦʹ༏ઌ౓Λ͚ͭΔ 02 ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ - ࠷దԽ https://aws.amazon.com/jp/blogs/news/aws-cost-optimization-framework/
19. 02 ͲͷΑ͏ʹίετ࠷దԽʹऔΓ૊Μ͔ͩ - ࠷దԽ ΞΧ΢ϯτ αʔϏε ݱঢ় ࢪࡦ ࡟ݮֹ ೉౓ ༏ઌॱҐ ํ਑ Account A RDS m5.8xlarge εϖοΫ࠷దԽ $XXX/݄ 5 3 XXXͷͨΊอཹ Account A S3 ແظݶอଘ ϥΠϑαΠΫϧ ϙϦγʔઃఆ $XXX/݄ 2 2 ࣮ࢪ͢Δ Account B ElastiCache ෆཁϦιʔεՔ ಇ Ϧιʔε࡟আ $XXX/݄ 1 1 ࣮ࢪ͢Δ Account A DynamoDB ΦϯσϚϯυΩ ϟύγςΟ ϦβʔϒυΩϟ ύγςΟߪೖ $XXX/݄ 3 4 XXXͷͨΊ࣮ࢪ ͠ͳ͍ ɾɾɾ
20. 03 ۩ମతͳίετ࠷దԽࢪࡦ
21. S3 VPCΤϯυϙΠϯτΛར༻͢Δ 03 ۩ମతͳίετ࠷దԽࢪࡦ • ϓϥΠϕʔταϒωοτ͔ΒS3ΞΫηεͷࡍʹ͸NAT GateawayΛ௨ΔΑ͏ʹͳ͍ͬͯͨ • S3ʹஔ͔ΕͨେྔͷassetσʔλʹΞΫηε͢ΔͨΊಛʹྉ͕ۚߴ͘ͳ͍ͬͯͨ ※ ap-northeast-1ϦʔδϣϯͰͷ2023೥8݄25೔ݱࡏͷՁ֨ ແྉ Private subnet Public subnet VPC Endpoint (Gateway) AWS Fargate NAT Gateway Amazon Simple Storage Service (Amazon S3) asset $0.062/GB ※
22. • ΄ͱΜͲͷS3όέοτʹϥΠϑαΠΫϧϙϦγʔ͕ઃఆ͞Ε͍ͯͳ͔ͬͨ • S3 Storage LensͰංେԽ͍ͯ͠ΔόέοτΛಛఆ͠ରԠΛߦͬͨ S3ϥΠϑαΠΫϧϙϦγʔΛઃఆ͢Δ 03 ۩ମతͳίετ࠷దԽࢪࡦ S3 Standard S3 Glacier Instant Retrieval Archive Delete όέοτ͝ͱʹཁ݅ ʹ߹Θͤͯઃఆ Ҡߦ࣌ʹίετ͕௓ Ͷͳ͍͜ͱΛ֬ೝ
23. • σϑΥϧτͰContainer Insights༗ޮԽʹͳ͍ͬͯͨ • ಛʹ։ൃ؀ڥͰ͸50ۙ͘ͷECSΫϥελʔ͕ར༻͞Ε͓ͯΓɺେྔͷΧελϜϝτϦΫε ͕ૹ৴͞Ε͍ͯͨ ։ൃ؀ڥͷContainer InsightsແޮԽ͢Δ 03 ۩ମతͳίετ࠷దԽࢪࡦ େྔͷΧελ ϜϝτϦΫε CloudWatch ECS Cluster ECS Cluster ECS Cluster ɾ ɾ ɾ
24. • ۀ຿࣌ؒʹ߹Θͤͯࣗಈىಈ/ఀࢭΛߦ͍͕ͬͯͨɺҰ೔தར༻͞Εͳ͍͜ͱ΋͋ͬͨ • ։ൃऀ͕slack commandΛ࢖ͬͯ޷͖ͳλΠϛϯάͰ؀ڥΛ্ཱͪ͛ΒΕΔΑ͏ʹͨ͠ ։ൃ؀ڥΛσϑΥϧτఀࢭʹ͢Δ 03 ۩ମతͳίετ࠷దԽࢪࡦ User AWS Lambda ໷ؒࣗಈఀࢭ EC2 & Fargate slack command API Call Πϯϑϥىಈ
25. • CloudWatch Logsͷϩάอ࣋ظؒઃఆ • ։ൃ؀ڥ΁ͷAuroraಉظσʔλͷݟ௚͠ • ෆཁϦιʔεͷఀࢭ/࡟আ • AuroraόοΫΞοϓσʔλอ࣋ظؒݟ௚͠ • ։ൃ؀ڥϦιʔεͷڞ௨Խ • etc. ͦͷଞͷࢪࡦ 03 ۩ମతͳίετ࠷దԽࢪࡦ
26. 04 ͦͷଞͷऔΓ૊Έ
27. • ि࣍ఆྫͰͷίετ֬ೝ͸ର৅ΞΧ΢ϯτΛݶఆ͍ͯ͠ΔͨΊɺ݄࣍ͰΞΧ΢ϯτશମͷ ίετਪҠΛݟΔΑ͏ʹ͍ͯ͠Δ(ݱঢ়͸खಈͷͨΊྑ͍ํ๏Λ໛ࡧத) ݄࣍ͰΞΧ΢ϯτશମͷίετΛৼΓฦΔ 04 ͦͷଞͷऔΓ૊Έ ຖ݄ ROIΛධՁ
28. • ։ൃ؀ڥ͸ಉҰϦιʔε͕ෳ਺͋Γɺಛੑ͕ҟͳΔͨΊɺCIDͷଞʹNew RelicΛ׆༻ͯ͠ ֤໘ͷར༻ঢ়گ΋ݟ͑ΔΑ͏ʹ͍ͯ͠Δ ։ൃ؀ڥར༻ঢ়گΛՄࢹԽ͢Δ 04 ͦͷଞͷऔΓ૊Έ
29. 05 ·ͱΊͱࠓޙͷ՝୊
30. • CFMϑϨʔϜϫʔΫʹଇΓίετՄࢹԽͷ࢓૊ΈΛಋೖͨ͜͠ͱͰɺFinOps࣮ફͷͨΊ ͷୈҰาΛ౿Έग़͢͜ͱ͕Ͱ͖ͨ • ΫΠοΫ΢Οϯ࠷దԽΛ࣮ࢪ͢Δ͜ͱͰ୹ظؒͰ໿$10,000/݄ͷίετΛ࡟ݮ͢Δ͜ͱʹ ੒ޭͨ͠ ·ͱΊ 05 ·ͱΊͱࠓޙͷ՝୊
31. • ύϒϦοΫIPv4ͷ༗ྉԽʹ൐͏ରԠΛݕ౼/࣮ࢪ͢Δ • αʔϏε͝ͱʹத௕ظతͳ੒௕Λߟྀͨ͠ίετ࠷దԽࢦඪΛݕ౼͢Δ
 (ROIΛݟΔ͚ͩͰ͸ෛՙରࡦͷͨΊͷϦιʔε૿ڧ࣌౳ʹਖ਼͘͠ධՁͰ͖ͳ͍) • FinOpsΛ࣮ફ͢ΔͨΊͷ࢓૊ΈΛ੔͍͑ͯ͘ • ίετͷઈର஋͕େ͖͘ͳ͍Ϧιʔεʹ͍ͭͯ΋࠷దԽ༨஍͕͋Δ͔෼ੳΛߦ͏ • Savings Plans / Reserved InstanceͷߪೖઓུΛݟ௚͢ • etc. ࠓޙͷ՝୊ 05 ·ͱΊͱࠓޙͷ՝୊
32. • 2023೥3݄29೔ൃച • ͲͷΑ͏ʹAWSͷίετ࠷దԽʹऔΓ૊ΜͰ͍ͬͨ ΒΑ͍͔ɺΦϯϓϨϛεͷ࣌୅ͱ͸Կ͕ҧ͏ͷ͔ମ ܥతʹ·ͱ·ΊΒΕ͍ͯΔ • ॳֶऀͷํʹ΋Θ͔Γ΍͘͢ஸೡʹॻ͔Ε͍ͯΔ ͓͢͢Ίͷॻ੶ 05 ·ͱΊͱࠓޙͷ՝୊ https://www.kadokawa.co.jp/product/322104000266/