LOWYAの信頼性向上とNew Relic

LOWYAの信頼性向上とNew Relic by ベガコーポレーション Kazuma Kohara

本資料は
NRUG (New Relic User Group) SRE支部 Vol.1
テーマ "俺たちのSREとNew Relic" として発表させていただきました。

ベガコーポレーションのSREチームが実施してきた数々の信頼性向上に向けた取り組みの中から

- Observability for Security
- AWS Prototyping Programで実現するGraphQL Cachingによる負荷対策
- CUJ観点でのSLO Review

について、New Relic活用事例と併せてご紹介しています。

Transcript

1. LOWYAͷ৴པੑ޲্ͱNew Relic NRUG SREࢧ෦ Vol.1 2022-05-13 גࣜձࣾϕΨίʔϙϨʔγϣϯ খݪҰਅ @kazumax55
2. ຊ೔ͷςʔϚ “ԶͨͪͷSREͱNew Relic” ࠓ೔࿩͢͜ͱ - ϕΨίʔϙϨʔγϣϯͷSRE - ΍ͬͯΑ͔ͬͨऔΓ૊ΈʢAWSʣ NewRelicͷ׆༻ࣄྫͱซͤͯ͝঺հ͠·͢ʂ
3. খݪҰਅʢKazuma Koharaʣ ٕज़ઓུ෦ SREάϧʔϓ άϧʔϓ௕ 🏢౦ژࢧࣾʢຊࣾ͸෱Ԭʣ झຯ 🏕Ωϟϯϓ 🎣௼Γ 🧖α΢φ ޷͖ͳNew Relicͷػೳ APMͷCompare with last week ࣗݾ঺հ @kazumax55
4. ձࣾ঺հ
5. 2ͭͷEίϚʔεࣄۀ
7. ಛ௃ɿ௕͍όϦϡʔνΣʔϯ
8. ϕΨίʔϙϨʔγϣϯͷSRE
9. ϕΨίʔϙϨʔγϣϯͷSRE ઃཱ͔Β4೥ͪΐͬͱ(2022/05ݱࡏ) ϝϯόʔ਺ : 4໊ ϛογϣϯ : ’’ۀ຿֦େʹ߹Θͤߴ͍৴པੑΛҡ࣋/ఏڙͰ͖Δ͜ͱ” ࣄۀଆͷ໨ඪʹରͯ͠ɺγεςϜ͕ϘτϧωοΫʹͳΒͳ͍ঢ়ଶΛҡ࣋ఏڙ͠ଓ͚Δ ՝୊͕ු্ͯ͠΋࢓૊Ͱղܾ͠ɺ඼࣭ΛߴΊΔࣄ͕Ͱ͖Δ Team Topologies : Enabling team ಛఆͷ։ൃνʔϜʹ͸ଐͣ͞ɺશࣾԣஅͰ৴པੑ޲্ʹऔΓ૊ΈͭͭɺSREͷจԽ/ϓ ϥΫςΟεΛਁಁ͍ͤͯ͞Δ
10. ΍ͬͯΑ͔ͬͨऔΓ૊Έ
13. ηΩϡϦςΟڧԽ - Observability for security -
14. ηΩϡϦςΟڧԽ ॏཁࢹ͍ͯ͠Δ3ͭͷϙΠϯτ ηΩϡϦςΟج४ͷ९क ڴҖݕ஌ ΠϯγσϯτϨεϙϯε
15. ηΩϡϦςΟج४ͷ९क ͳͥॏཁʁ γεςϜ΋ηΩϡϦςΟ΋φϚϞϊ ೔ʑߋ৽͞ΕΔɺηΩϡϦςΟج४΋ਵ࣌Ξοϓσʔτ͞ΕΔ ͍͕ͭ݀։͔͘Θ͔ΒͣɺਓͷྗͰ͸શͯΛνΣοΫ͖͠Εͳ͍ ੬ऑੑ਍அ΍ͬͯΔ͔Βฏؾʁ ਍அ௚ޙ͸OKͰ΋…มߋ͠·͢ΑͶʁ ղܾ͢ΔͨΊʹ͸ʁ Observability͕ඞཁʹ”AWS Security Hub”
16. AWS Security Hubͱ͸ʁ AWS্ͷةݥͳઃఆ/ϕετϓϥΫςΟεʹ൓͢ΔઃఆΛݕ஌/؅ཧ͢Δػೳ ΠϕϯτυϦϒϯʹҧ൓Λݕ஌͠ɺ௨஌͕Մೳ ϦεΫ൑ఆ෇͖(Critical, High …) Critialͷྫ:DB/S3 ͕PublicͰެ։͞Εͨ Highͷྫ:SGͰ80/443Ҏ֎ͷϙʔτ͕AnyͰެ։͞Εͨ ݕ஌ཧ༝ͱम෮खॱ΋ఏࣔͯ͘͠ΕΔ
17. Observability िΠνͰείΞΛूܭͯ͠Slackʹ௨஌ New Relicʹ΋ૹͬͯμογϡϘʔυͰՄࢹԽ ӡ༻ϑϩʔ Slack௨஌ΛτϦΨʔʹݟ௚͠Λ࣮ࢪ ֤ϓϩμΫτνʔϜ͸είΞ80఺Ҏ্Λҡ࣋͢Δ ϋΠϦεΫͳ΋ͷ͔Β༏ઌͯ͠ରԠ Criticalݕ஌࣌͸ଞͷλεΫΛࢭΊͯ࠷༏ઌͰରԠ ରԠ͕೉͍͠΋ͷ͸SREʹؾܰʹ૬ஊ AWS Security Hub ӡ༻
18. ڴҖݕ஌ ͳͥॏཁʁ αʔϏεʹ͸೔ʑ๲େͳྔͷΠϕϯτ͕ൃੜ͍ͯ͠Δ Ͳ͜ͰԿ͕ى͍ͬͯ͜Δ͔/͍ͭඪతʹ͞ΕΔ͔Θ͔Βͳ͍ ਓͷྗͰ͸શͯΛνΣοΫ͖͠Εͳ͍ ةݥ/ո͍͠ ಈ͖͕͋ͬͨΒݕ஌͍ͨ͠ ղܾ͢ΔͨΊʹ͸ʁ Observability͕ඞཁʹ”Amazon GuardDuty”
19. Amazon GuardDutyͱ͸ʁ AWS্ͷڴҖݕ஌αʔϏε ͋ΒΏΔϩάΛࣗಈऩू͠ɺػցֶश΍ڴҖΠϯςϦδΣϯεΛར༻͠ ͯѱҙͷ͋Δ/ෆ৹ͳΞΫςΟϏςΟΛݕ஌͢Δ ྫɿո͍͠APIݺͼग़͕͠ଟൃ͍ͯ͠Δ, ෆਖ਼ʹσʔλऔಘ͞Ε͍ͯͦ͏ …etc ӡ༻ϑϩʔ ݕ஌ͨ͠ΒSlack/PagerDutyʹ௨஌ ॏཁ౓Highͷ৔߹ɺSEV:1Πϯγσϯτͱͯ͠࠷ߴͷPriorityͰରԠ͢Δ
20. ΠϯγσϯτϨεϙϯε ͳͥॏཁʁ ໰୊͕ൃ֮ͨ͠ͱ͖ɺૉૣ͘ௐࠪΛߦ͍ݪҼΛಛఆ͢Δҝ ղܾ͢ΔͨΊʹ͸ʁ SIEM(Security Information and Event Management)͕ඞཁ “Amazon Detective”ͱ”SIEM on Amazon OpenSearch” ӡ༻ϑϩʔ Կ͔໰୊͕͋ͬͨͱ͖ͷௐࠪʹར༻ ηΩϡϦςΟΠϯγσϯτ/ӡ༻ϛε ౳
21. ηΩϡϦςΟڧԽɿ·ͱΊ ηΩϡϦςΟʹ΋ObservabilityΛಋೖ͠Α͏ ηΩϡϦςΟج४ͷ४ڌɿAWS SecurityHub ڴҖݕ஌ɿAmazon GuardDuty Կ͔͋ͬͨͱ͖ʹඋ͑ͯSIEMΛ༗ޮԽ͠Α͏ɹ Amazon DetectiveͱSIEM on Amazon OpenSearch ͦͷଞ ͓͢͢Ί DDoSରࡦɿAWS WAF Sheild Advance & Automatic application layer DDoS mitigation ίετҟৗݕ஌ɿAWS Cost Anomaly Detection ੬ऑੑௐࠪɿAmazon Inspector
22. ෛՙରࡦ
23. ෛՙରࡦ LOWYAͷෛՙରࡦ LOWYAͷྺ࢙ աڈͷରࡦͱ݁Ռ ୈҰͷนɿLOWYAͷ೔ ୈೋͷนɿTV์ө ࠓޙͷରࡦ
24. LOWYAͷྺ࢙ 2004/04 ʙ ओʹϞʔϧ(ָఱ/Amazon/PayPay)Λओମʹͯ͠ࣄۀల։ 2017/09 LOWYAض؋ళαʔϏε։࢝ ECύοέʔδϕϯμʔʹΧελϚΠζΛґཔͯࣗࣾ͠ECΛߏங/ӡ༻ 2018/03 LOWYAض؋ళϦϓϨΠεϓϩδΣΫτ։࢝ʢࣗࣾͰϑϧεΫϥονʣ 2020/08 ϦϓϨΠεલͷෛՙࢼݧͱϘτϧωοΫಛఆͰNew RelicͷPoCΛ։࢝ LOWYAض؋ళϦϓϨΠεʢRuby on Rails + Vue.js : GraphQLʣ
25. ୈҰͷนɿLOWYAͷ೔ 2021/06/08 LOWYAͷ೔ ض؋ళECϦϓϨʔεޙॳͷେن໛ηʔϧΠϕϯτʢશ඼20%OFFʣ ࣄલ४උ ݁ߏڧΊͷن໛ͰΠϯϑϥ૿ڧ AuroraͷεέʔϧΞοϓ ࣗલPre-Warming(APIλεΫͷ࣌ݶࣜεέʔϧΞ΢τ ݁Ռ͸ʁʁʁ
26. LOWYAͷ೔ͷ݁Ռ ೔঎ 5.5ԯ (લ೥ରൺ໿2ഒͷച্)Λୡ੒ʂ ॾʑ໰୊ൃੜͨ͠΋ͷͷɺNewRelicͷઈେͳτϥϒϧγϡʔςΟϯάޮ ՌͰ࠷ॳͷ30෼Ͱऩଋʂ ৄࡉ͸σϒαϛ2021ՆͰ࿩͠·ͨ͠ʂ ؾʹͳΔํ͸QRίʔυΛνΣοΫʂ LOWYAض؋ళʹ͓͚Δࣄۀ੒௕ͱ αʔϏε඼࣭޲্ͷཱ྆Λ໨ࢦ͢SREͷ௅ઓ
27. LOWYAͷ೔Ͱൃੜͨ͠໰୊ͱରࡦ ໰୊1:AuroraίωΫγϣϯރׇ APIͷେ෯ͳεέʔϧΞ΢τʹΑͬͯൃੜ → max_connection ͷ஋Λमਖ਼ LEAST({DBInstanceClassMemory/9531392},5000) ͷLEASTؔ਺Λ֎ͨ͠ ໰୊2:ϝʔϧ഑ૹ஗Ԇ ஫จ׬ྃϝʔϧͷ഑ૹೳྗΛ্ճΔ଎౓Ͱ஫จ͕ೖͬͨҝɺϝʔϧ഑ૹ஗Ԇ͕ൃੜ → ϝʔϧ഑ૹworkerͷεέʔϧΞ΢τͰղܾ ໰୊3:ଟॏ஫จ ஫จ׬ྃϝʔϧ஗ԆͷӨڹͰɺҰ෦ͷ͓٬༷͕ଟॏ஫จͯ͠͠·ͬͨ → ໰୊2ͱ3ͷղফʹ൐͍ղܾ ໰୊4:Χʔυܾࡁᮢ஋ ஫จ͕ࡴ౸͠ɺඵܾؒࡁ਺ͷᮢ஋Λ௒͑ͨͱ͍͏Τϥʔ͕ൃੜ → ܾࡁձࣾʹඵܾؒࡁ਺ͷ্ݶ؇࿨Λґཔ
28. ୈೋͷนɿTV์ө 2021/08/11 ࠓ໷͘Β΂ͯΈ·ͨ͠์ө Ո۩޷͖ͷ;ͳͬ͠ʔ͕TV൪૊಺ͰLOWYAѪΛޠͬͨ ࣄલ४උ LOWYAͷ೔ͷഒͷن໛ʹΠϯϑϥ૿ڧ AWS΁ALBͷPre-Warmingਃ੥ ݁Ռ͸ʁʁʁ
29. TV์өͷ݁Ռ LOWYAͷ೔ͷഒҎ্ͷಉ࣌ΞΫηε͕ൃੜ Lambda@Edgeͷᮢ஋Λ௒͑ɺҰ࣌తʹ503ΤϥʔΛग़ͯ͠͠·ͬͨ AWSʹ্ݶ؇࿨ͯ͠໯͏ඞཁ͕͋Δ ෛՙ͕མͪண͘·ͰԿ΋͢Δ͜ͱ͕Ͱ͖ͣɺչ͍݁͠Ռͱͳͬͨ Ҏޙɺࣾ಺Ͱ͸ “ࠓ͘Β๒/;ͳͬ͠ʔ๒” ͳͲͱݺ͹ΕɺڪΕΒΕ͍ͯΔ
30. ࠓ͘Β๒/;ͳͬ͠ʔ๒Ͱൃੜͨ͠໰୊ͱରࡦ ໰୊1:Lambda@Edgeͷ্ݶ໰୊ ը૾ϦαΠζ΍ηΩϡϦςΟܥϔομͷ෇༩Ͱར༻͍ͯͨ͠L@Eͷᮢ஋ Λ௒͑ͯ͠·ͬͨ → AWSʹ্ݶ؇࿨ਃ੥Λґཔ 1 ඵ͋ͨΓͷϦΫΤετ 10,000 -> 100,000 ಉ࣮࣌ߦ਺ 1,000 -> 10,000 ΞϥʔτઃఆΛ௥Ճ(LambdaͷThrottle౳)
31. ࠓ͘Β๒/;ͳͬ͠ʔ๒Ͱൃੜͨ͠໰୊ͱରࡦ ໰୊2:࣮͸ීஈ΋ى͖͍ͯͨࣄ͕ൃ֮ ը૾͖ͭPush഑৴࣌ɺThrottle͕ൃੜ͍ͯͨ͠ࣄ͕൑໌ Push഑৴͸ɺૹͬͨλΠϛϯάͰը૾ʹҰ੪ΞΫηε͕ൃੜ͢ΔͨΊɺL@Eͷ ىಈ͕௥͍͔ͭͣίʔϧυελʔτ͕ൃੜ=Throttle͕ى͖ͨ L@Eͷϔομ൑ఆॲཧΛCloudFront Functionsʹ੾Γग़͢ࣄͰ߃ٱରԠ L@EͰ͸Provisioned Concurrency͕ઃఆෆՄ CF2͸੍໿΋ଟ͍͕ɺPre−WarmingෆཁͰඵؒ਺ඦສΞΫηεʹ΋଱͑Δࣄ͕ Ͱ͖Δ༻ʹͳͬͨ
32. ࠓޙͷෛՙରࡦ Կ͔؆୯͔ͭඈ༂తʹվળ͢Δख͸ͳ͍͔ʁʁ ಉ͡಺༰ͷϦΫΤετΛຖճॲཧͨ͘͠ͳ͍ Ͱ͖Ε͹͋·Γ࣮૷͸ม͑ͨ͘ͳ͍ ͤ΍ʂCDNΛ͔·ͯ͠ಉ͡಺༰ͷϦΫΤετ͸ΩϟογϡʹԠ౴ͤ͞Α͏ʂ GraphQL Cachingͩʂ
33. GrahQL Caching Good ίετ࡟ݮ ຖճϖʔδΛදࣔ͢Δ౓ʹݺͼग़͞Ε͍ͯͨ΋ͷ͕ Ωϟογϡظؒ෼ͷ1ճ ʹݮΔ ϦΫΤετ਺ͷݮগ → APIλεΫͷεέʔϧΠϯ → ίετ࡟ݮ ϨΠςϯγ࡟ݮ ωοτϫʔΫతʹ͍ۙΤοδ͔ΒΦϦδϯʹॲཧͤ͞Δ͜ͱͳ͘Ϩεϙϯε͕ฦͤ Δ(਺ඦmsec -> ਺ेmsec) Ωϟογϡ؅ཧָ͕ CDNଆͰTTL, Invalidation͕Ұݩ؅ཧͰ͖Δ
34. GrahQL Caching Bad GraphQL͸શͯͷϦΫΤετ͕POST͔ͭ1ͭͷύεʹରͯ͠དྷΔҝɺΩϟογϡ͠ਏ͍ ύε͕1͔ͭͩΒΩϟογϡͷ෦෼తͳ࡟আ͕Ͱ͖ͳ͍ ๫࿐ରࡦʹ஫ҙ͕ඞཁ ৘ใ͕গͳ͍ɿAkamai, Cloud fl are, GraphCDN, Fastly Cloud fl are WorkersͰGraphQLϦΫΤετΛΩϟογϡͯ͠30msͰฦ͢Α͏ʹͨ͠࿩ Cloud fl are Workers(Lambda@Edgeతͳ΋ͷ)+KVSͰ࣮ݱͨ͠ͱ͍͏ࣄྫ Good > Bad க໋తBadϙΠϯτ͸ແ͠ɻ࣮ݱʹ޲͚ຊ֨తͳݕ౼Λ։࢝
35. GraphQL Caching AWS ୲౰SA͞Μʹ΋૬ஊ લʑ͔ΒCloudFrontͰGraphQLΛΩϟογϡ͍ͨ͠ͱ૬ஊ͍ͯͨ͠ re:Invent2021Ͱ΋CloudFront GraphQLରԠͷൃද͸ͳ͔ͬͨ ଞͷCDNͰ࣮ݱ͠Α͏ͱࢥ͍ͬͯΔͱਖ਼௚ʹ࿩ͨ͠ ηΩϡϦςΟ౳΋શ෦ͻͬ͘ΔΊͯҠߦݕ౼Λ͢͢Ί͍ͯΔͱ AWSͷιϦϡʔγϣϯͰ࣮ݱͰ͖ͳ͍͔ݕ౼ͤͯ͞Լ͍͞ͱͷࣄ ਺࣌ؒޙɺ”ϓϩτλΠϐϯάϓϩάϥϜ͸͝ଘ஌Ͱ͔͢ʁ"ͱ
36. ϓϩτλΠϐϯάϓϩάϥϜͱ͸ʁ AWS͕Ϣʔβͷ୅ΘΓʹϓϩτλΠϓΛ։ൃ͠ɺఏڙͯ͘͠ΕΔಛผͳϓϩάϥϜʢͳΜͱແঈͰʂʣ ੋඇ͓ئ͍͠·͢ʂͱଈ౴ ͦΕ͔ΒεϐʔσΟʹ࿩Λ͢͢Ίແࣄʹೲ඼ AWS͕EdgeεϖγϟϦετSAͱ΋૬ஊ͠ɺઃܭͨ͠GraphQL CachingͷΞʔΩςΫνϟͱ͸ʁʁ
37. GrahQL Caching GitHubͰެ։͞Ε͓ͯΓɺͲͳͨͰ΋ར༻ՄೳͰ͢ aws-samples / amazon-cloudfront-cache-graphql ݱࡏɺ࣍ճLOWYAͷ೔·Ͱͷಋೖʹ޲͚ઈࢍςετதʂ
38. ෛՙରࡦɿ·ͱΊ ҙ֎ͳͱ͜Ζʹ໡఺͕͋Δ ීஈ͔ΒෛՙΛؾʹ͍ͯ͠ΔՕॴ͸͋·Γ໰୊ͳ͍ ͦ͏͡Όͳ͍ॴʹ஍ཕ͕͋Δʢᮢ஋౳ʣ Observerbility͕ॏཁ Կ͔͋ͬͨ࣌ʹ͙͢ݪҼಛఆͰ͖Δঢ়ଶʹ͓ͯ͘͠ APIΩϟογϡΛݕ౼ ୭͕Έͯ΋ಉ͡Ԡ౴Λฦ͢API͸ΩϟογϡʹԠ౴ͤ͞Δ ͖ͬͱେ͖ͳޮՌΛੜΉ͸ͣ
39. SLO Review
40. SLO Review SLOͷݟ௚͠ New RelicͰଌఆ
41. SLOͷܾΊํɺݟ௚͠ํʁʁ ·ͣSLOΛܾΊͯɺঃʑʹݟ௚͢ ྫ͑͹ɺ֘౰γεςϜͷΰʔϧσϯγάφϧΛNewRelicͰर͏ ฏۉAPIԠ౴͇࣌ؒඵҎ಺, ϖʔδදࣔ଎౓͈ඵҎ಺, Τϥʔ཰͉%Ҏ಺, Քಇ཰ … etc SLOΛͲ͏΍ͬͯݟ௚ͤ͹ྑ͍͔Θ͔Βͳ͘ͳΔ શͯͷฏۉ஋ͩͱɺॏཁͳࢦඪ/Τϥʔ͕ຒ΋Εͯ͠·͏ ͦ΋ͦ΋શͯͷฏۉͰݟΔ͜ͱʹҙຯ͸͋Δͷ͔ʁ Ͱ͸Ͳ͏͢Ε͹ྑ͍͔ʁ CUJ(Critical User Journey)ͷ؍఺Ͱࠜຊ͔Βݟ௚͢ʂ
42. CUJ؍఺ͰͷSLO Review CUJ(Critical User Journey)ͱ͸ʁ ͦͷγεςϜͰಛʹॏཁࢹ͢ΔϢʔβମݧͷ͜ͱ ·ͣୈҰʹCUJΛܾΊΔ ͦͷγεςϜͷϢʔβ͸୭͔ʁͦͷϢʔβʹͱͬͯॏཁͳϢʔβମݧ͸Կ͔ʁ ྫɿECͷ৔߹(঎඼ݕࡧɺΧʔτɺߪೖͳͲ) CUJͷ؍఺ͰSLOΛߟ͑Δ CUJ͕Τϥʔ΋஗Ԇ΋ͳ͘εϜʔζʹ࢖͑Δ͜ͱ ϢʔβΛΠϥοͱͤ͞ͳ͍ඵ਺͸Կඵ͔ʁͱ͔ ͜ΕΛSLOʹ͢΂͖ʂ
43. SLOӡ༻ϑϩʔ 1. CUJΛܾΊΔ(Dev&SRE) 2. SLOΛܾΊΔ(Dev&SRE) DevνʔϜओମͰߟܾ͑ͯΊͯ΋Β͏ SLO=SRE͕ܾΊͨ໘౗ͳ΍ͭͱࢥΘΕͳ͍Α͏ɺSRE͸αϙʔτʹప͢Δ SRE͸Observerbilityͷఏڙʹ੹೚Λ΋ͪͭͭɺSLO౳SREจԽͷਁಁΛαϙʔτ ObserverbilityͷಋೖͱɺSLOؔ࿈υΩϡϝϯτͷ੔උ΍ϑΝγϦςʔγϣϯ 3. ࣄۀଆͱ߹ҙΛऔΔ(Dev) DevνʔϜvsࣄۀ Ͱަবͯ͠ɺόδΣοτΛউͪͱͬͯ΋Β͏ 4. ఆظతʹݟ௚͢(SRE&Dev ܁Γฦ͠) ௚ۙͷΞϥʔτ΍ϝτϦΫε౳ͷ৘ใΛݩʹఆظతͳݟ௚͠Λߦ͏
44. New RelicʹΑΔCUJ؍఺ͷSLOଌఆ Backend APMͰର৅ͷCUJͰ࣮ߦ͞ΕΔTransactionΛಛఆ͠ɺApdex/ϨΠςϯγ/Τϥʔ཰ ౳ΛݟΔ REST API : Key Transaction / GraphQL : NRQLͰߜΔ Frontend BrowserͰCUJͰݺͼग़͞ΕΔύεͷCWV΍Τϥʔ཰ ౳ΛݟΔ Back/Frontڞ௨ CUJʹӨڹ͠ͳ͍ΤϥʔΛແࢹ͢Δ(ॏཁ) Triage > Erros Inbox ΍ TransactionErrorΠϕϯτ ΛΈͯ൑அʢྫɿϢʔβىҼͷΫϨΧܾࡁΤϥʔ౳ʣ Քಇ཰ SyntheticsͰCUJͷҰ࿈ͷಈ͖ΛscriptͰఆٛ ϨΠςϯγ΍εςʔλεΛݟΔ Infrastructure ͋·Γؾʹ͢Δඞཁ͸ͳ͍ʢSLOʹӨڹ͕ͳ͚Ε͹OK ͜ΕΒͷSLIΛ Alert/SLOͱͯ͠ઃఆ͢Δ
45. New Relic μογϡϘʔυͷվળ ࠓ·Ͱ શαʔϏεͷSLOΛ·ͱΊͨSLOαϚϦʔμο γϡϘʔυΛख࡞Γ D2CͳͷͰࣾ಺αʔϏε͕ଟ͘ද͕ࣔॏ͍ ϝϯςφϯείετ͕͔͔Δ ͜Ε͔Β ख࡞Γ͠ͳ͍ Workload views ͱ Service Level ManagementΛ ࢖͏
46. New Relic ৽μογϡϘʔυ Workloard views ͸͍͍ͧʂ Create Workload > ؔ࿈͢Δ entities Λશ෦ϒνࠐΉʂ > ऴΘΓ উखʹ͍͍ײ͡ʹμογϡϘʔυԽͯ͘͠ΕΔ ଍Γͳ͍෦෼͚ͩݸผʹμογϡϘʔυΛ࡞ͬͯWorkloadʹ௥Ճ͢Ε͹ϦϯΫͯ͘͠ΕΔ τϥϒϧγϡʔςΟϯά΋εϜʔζ SLO΋Service Level ManagementΛ࢖ͬͯ࠶ఆٛ ͍ܰʂݟ΍͍͢ʂ
47. SLO Reviewɿ·ͱΊ CUJ؍఺ͰSLO ReviewΛ࣮ࢪ ઌʹCUJΛܾΊɺCUJΛݩʹߟ͍͑ͯ͘ CUJʹؔ࿈͠ͳ͍Τϥʔ͸ແࢹ SRE͕SLOΛܾΊͯ͠·Θͳ͍ SLOΛଞਓࣄͰ͸ͳࣗ͘෼ࣄͱͯ͠औΓ૊ΜͰ΋Β͏ҝ DevνʔϜʹܾΊͯ΋Β͍ɺSRE͸ܭଌͱܾఆΛαϙʔτ͢Δ Workload views͸͍͍ͧ ؆୯ͳͷͰੋඇ͓ࢼ͍ͩ͘͠͞ ࠓޙ New RelicΛ࢖ͬͯ΍Γ͍ͨ͜ͱɿϏδωεμογϡϘʔυͷ੔උ ϑΝωϧ෼ੳ/ώετάϥϜ ౳Λ࢖ͬͯSLO Reviewʹ໾ཱ͍ͯͨʢ໨ඪΛԿඵʹ͢Δ͔౳ʁ ച্/஫จ਺ʢΤϥʔόδΣοτΛఀࢭ࣌ؒ͡Όͳͯ͘ଛֹࣦʹ͍ͨ͠