月間動画再生数2億回を支える TVerのオブザーバビリティ

2022/03/11
Observability Conference 2022

イベントURL :
https://event.cloudnativedays.jp/o11y2022

Transcript

1. ݄ؒಈը࠶ੜ਺2ԯճΛࢧ͑Δ
 TVerͷΦϒβʔόϏϦςΟ גࣜձࣾ TVer / Ճզ وࢤ 2022/03/11 Observability Conference 2022
2. ͜ͷηογϣϯʹ͍ͭͯ ຊ೔͓࿩͢Δ͜ͱ • TVerʹ͓͚ΔΦϒβʔόϏϦςΟ࣮ݱϓϩηε • New Relic Oneͷ׆༻ࣄྫ
3. ͜ͷηογϣϯʹ͍ͭͯ ओͳλʔήοτ • ͜Ε͔ΒΦϒβʔόϏϦςΟΛ࣮ݱ͍ͨ͠ • πʔϧ͸ಋೖ͚ͨ͠Ͳ׆༻Ͱ೰ΜͰ͍Δ • New Relic Oneͷ࢖͍ํʹڵຯ͕͋Δ डߨऀϨϕϧ • ΦϒβʔόϏϦςΟॳڃऀ🔰
4. ΞδΣϯμ • TVerͷ঺հ • αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ • New Relic OneಋೖʹΑΔվળͷτϥΠ • ΦϒβʔόϏϦςΟ࠶ઃܭ • New Relic Oneͷ׆༻ࣄྫ • ·ͱΊ
5. ΞδΣϯμ • TVerͷ঺հ • αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ • New Relic OneಋೖʹΑΔվળͷτϥΠ • ΦϒβʔόϏϦςΟ࠶ઃܭ • New Relic Oneͷ׆༻ࣄྫ • ·ͱΊ
6. TVerͷ঺հ
7. TVerͷ঺հ
8. TVerͷ঺հ [TVer] ྦྷܭΞϓϦμ΢ϯϩʔυ਺͕4,000ສಥഁʂ ϨΪϡϥʔͷ഑৴൪૊਺͸400൪૊ʹ
 https://tver.co.jp/news/20210825-1.html
9. TVerͷ঺հ [TVer] 2021೥10݄ͷ݄ؒಈը࠶ੜ਺͕ॳͷ2ԯճΛಥഁʂʙࡢ೥ಉ݄ൺ̎ഒʹɺίωΫςουTVࢹௌ৳௕͕ཁҼʙ
 https://tver.co.jp/news/20211112-1.html
10. TVerͷओཁͳٕज़ελοΫ
11. TVerͷΠϯϑϥετϥΫνϟ
12. TVer (WebαʔϏε) ͷΠϯϑϥετϥΫνϟ
13. ΞδΣϯμ • TVerͷ঺հ • αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ • New Relic OneಋೖʹΑΔվળͷτϥΠ • ΦϒβʔόϏϦςΟ࠶ઃܭ • New Relic Oneͷ׆༻ࣄྫ • ·ͱΊ
14. αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊
15. αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊
16. αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊
17. αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊
18. αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ TVerͷར༻ऀ͕૿Ճ (Ϣʔβʔ / ޿ࠂओ) ↓ ࣾձతͳӨڹ౓͕ߴ͍ϓϥοτϑΥʔϜ΁੒௕ ↓ ϞχλϦϯάपΓͷվળ͕՝୊
19. αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ ϞχλϦϯάपΓͷ՝୊ • Ϣʔβʔମݧͷ೺Ѳ • Մ༻ੑ΍ύϑΥʔϚϯεͷՄࢹԽ • ໰୊ൃੜ࣌ͷਝ଎ͳղܾ • ϓϩΞΫςΟϒͳϞχλϦϯά • SLI / SLOʹΑΔ৴པੑͷՄࢹԽ
20. αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ γεςϜͷ؍ଌൣғΛ ޿͛Δඞཁ͕͋Δ
21. ΞδΣϯμ • TVerͷ঺հ • αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ • New Relic OneಋೖʹΑΔվળͷτϥΠ • ΦϒβʔόϏϦςΟ࠶ઃܭ • New Relic Oneͷ׆༻ࣄྫ • ·ͱΊ
22. New Relic OneಋೖʹΑΔվળͷτϥΠ [࠶ܝ] ϞχλϦϯάपΓͷ՝୊ • Ϣʔβʔମݧͷ೺Ѳ • Մ༻ੑ΍ύϑΥʔϚϯεͷՄࢹԽ • ໰୊ൃੜ࣌ͷਝ଎ͳղܾ • ϓϩΞΫςΟϒͳϞχλϦϯά • SLI / SLOʹΑΔ৴པੑͷՄࢹԽ γεςϜͷ؍ଌൣғΛ޿͛Δඞཁ͕͋Δ
23. New Relic OneಋೖʹΑΔվળͷτϥΠ
24. New Relic OneಋೖʹΑΔվળͷτϥΠ Why New Relic One • ڧྗͳϑϩϯτΤϯυϞχλϦϯά • ΦϒβʔόϏϦςΟϓϥοτϑΥʔϜ • શํҐͰͷϞχλϦϯά͕Մೳ
25. New Relic OneಋೖʹΑΔվળͷτϥΠ ಋೖͷྲྀΕ • αʔόαΠυΤϯδχΞ͕ಋೖΛݗҾ • New Relicࣾ΋ੵۃతʹಋೖΛαϙʔτ
26. New Relic OneಋೖʹΑΔվળͷτϥΠ NRU101 New Relic One ೖ໳
 https://newrelic.com/jp/resources/presentations/nru101_20211027
27. New Relic OneಋೖʹΑΔվળͷτϥΠ NRU101 New Relic One ೖ໳
 https://newrelic.com/jp/resources/presentations/nru101_20211027
28. New Relic OneಋೖʹΑΔվળͷτϥΠ ɹ“ಈը഑৴ࢢ৔ͷ֦େʹ൐ͬͯߴ·Γଓ͚ΔϢʔβʔɺ
 ɹ޿ࠂओ૒ํ͔ΒͷधཁʹԠ͑ΔͨΊʹ͸ɺαʔϏεͷ
 ɹՔಇঢ়گ΍ෛՙঢ়گɺϢʔβʔͷࢹௌମݧΛৗʹ೺Ѳ͠ɺ
 ɹҟৗ஋ͷൃݟͱݪҼͷಛఆɾղܾΛਝ଎͔ͭޮ཰తʹ
 ɹߦ͑Δ؀ڥΛ੔උ͢Δඞཁ͕͋Γ·ͨ͠ɻ” TVerɺΦϒβʔόϏϦςΟʢՄ؍ଌੑʣϓϥοτϑΥʔϜʮNew Relic OneʯΛಋೖ
 https://newrelic.com/jp/press-release/20210302
29. New Relic OneಋೖʹΑΔվળͷτϥΠ New Relic Oneͷಋೖঢ়گ (2021೥12݄) • ΠϯςάϨʔγϣϯ • ΠϯϑϥετϥΫνϟʔϞχλϦϯά • ϒϥ΢βϞχλϦϯά • ϞόΠϧϞχλϦϯά • ֎ܗ؂ࢹ
30. New Relic OneಋೖʹΑΔվળͷτϥΠ ΦϒβʔόϏϦςΟΛ ࣮ݱ͢ΔͨΊʹ͸ ԿΛ͢Ε͹͍͍ͩΖ͏ ͔
31. ΞδΣϯμ • TVerͷ঺հ • αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ • New Relic OneಋೖʹΑΔվળͷτϥΠ • ΦϒβʔόϏϦςΟ࠶ઃܭ • New Relic Oneͷ׆༻ࣄྫ • ·ͱΊ
32. 1. New Relicͷࢥ૝͔Β ΦϒβʔόϏϦςΟΛ ֶͿ
33. ΦϒβʔόϏϦςΟ࠶ઃܭ New Relicͷߟ͑ΔΦϒβʔόϏϦςΟ(1) “؂ࢹ͸ࣄલʹఆٛ͞Εͨҟৗ͕ى͖ͨͱ͖ʹ୯ʹ௨஌͢Δ͚ͩ 
 Ͱ͕͢ɺΦϒβʔόϏϦςΟͰ͸ͳͥى͖͔ͨ΋೺Ѳ͢Δॿ͚ʹ 
 ͳΓ·͢ɻͦΕʹΑΓνʔϜ͸ɺۓٸࣄଶͰ΋ਝ଎͔ͭ༗ޮʹରԠ 
 Ͱ͖ɺ௕ظతͳΞϓϦέʔγϣϯύϑΥʔϚϯεͷվળʹऔΓ૊Ή 
 ͜ͱ͕Ͱ͖·͢ɻ” ϞμϯͳՄ؍ଌੑʢΦϒβʔόϏϦςΟʣͱ͸ͳʹ͔
 https://newrelic.com/jp/blog/best-practices/what-is-modern-observability
34. ΦϒβʔόϏϦςΟ࠶ઃܭ New Relicͷߟ͑ΔΦϒβʔόϏϦςΟ(2) “New Relic ͸ϝτϦΫεɺΠϕϯτɺϩάɺ͓ΑͼτϨʔε 
 ʢMELT : Metrics, Events, Logs, TracesʣΛՄ؍ଌੑ࣮ݱͷ 
 جຊతͳσʔλλΠϓͩͱߟ͍͑ͯ·͢ɻ 
 ͢΂ͯΛܭଌ͠ɺMELTΛ࢖༻ͯ͠γεςϜ಺ͷؔ܎ͱґଘؔ܎ɺ 
 ͦͯͦ͠ͷৄࡉͳύϑΥʔϚϯεͱਖ਼ৗੑΛҡ࣋͢Δ͜ͱ͕ 
 Մ؍ଌੑΛ࣮ݱ͢ΔͨΊʹॏཁͰ͢ɻ” Metrics, Events, Logs, Traces ͬͯͳΜͩʁ
 https://newrelic.com/jp/blog/how-to-relic/metrics-events-logs-and-traces
35. 2. Google͔Β ΦϒβʔόϏϦςΟΛ ֶͿ
36. ΦϒβʔόϏϦςΟ࠶ઃܭ Googleͷߟ͑ΔΦϒβʔόϏϦςΟ(1)
 “ϞχλϦϯά͸ɺνʔϜ͕γεςϜͷঢ়ଶΛ؂ࢹͯ͠೺ѲͰ͖ΔΑ͏ʹ͢Δ πʔϧ΍ٕज़తͳιϦϡʔγϣϯͰ͢ɻϞχλϦϯάͰ͸ɺࣄલʹఆٛͨ͠ࢦ ඪ΍ϩάͷऩूΛߦ͍·͢ɻ ΦϒβʔόϏϦςΟ͸ɺνʔϜ͕γεςϜͷσόοάΛੵۃతʹߦ͑ΔΑ͏ʹ ͢Δπʔϧ΍ٕज़తͳιϦϡʔγϣϯͰ͢ɻΦϒβʔόϏϦςΟͰ͸ɺࣄલʹ ఆٛ͞Ε͍ͯͳ͍ϓϩύςΟͱύλʔϯͷௐࠪΛߦ͍·͢ɻ” DevOps ଌఆ: ϞχλϦϯάͱΦϒβʔόϏϦςΟ
 https://cloud.google.com/architecture/devops/devops-measurement-monitoring-and-observability
37. ΦϒβʔόϏϦςΟ࠶ઃܭ Googleͷߟ͑ΔΦϒβʔόϏϦςΟ(2)
 “ϗϫΠτϘοΫε ϞχλϦϯά ϞχλϦϯάͱΦϒβʔόϏϦςΟ͸ɺϫʔΫϩʔυ͔ΒϞχλϦϯά γεςϜ ʹૹ৴͞ΕΔγάφϧʹґଘ͠·͢ɻ࠷΋Ұൠతͳཁૉͱͯ͠͸ɺࢦඪɺϩάɺ τϨʔεͷ 3 ͕ͭ͋Γ·͢ɻҰ෦ͷϞχλϦϯά γεςϜͰ͸ΠϕϯτΛ௥੻͠ ͯใࠂ͠·͢ɻΠϕϯτ͸ɺγεςϜͰͷϢʔβʔͷૢ࡞΍γεςϜࣗମͷঢ়ଶ ͷมԽΛද͠·͢ɻ” DevOps ଌఆ: ϞχλϦϯάͱΦϒβʔόϏϦςΟ
 https://cloud.google.com/architecture/devops/devops-measurement-monitoring-and-observability
38. ΦϒβʔόϏϦςΟ ׬શʹཧղͨ͠
39. ΦϒβʔόϏϦςΟ࠶ઃܭ [ํ਑] શͯͷγεςϜͰMELTΛܭଌ͢Δ • ☑ ΠϯςάϨʔγϣϯ (֦ॆ) • ☑ ΠϯϑϥετϥΫνϟʔϞχλϦϯά • ☑ ϒϥ΢βϞχλϦϯά • ☑ ϞόΠϧϞχλϦϯά • ☑ ֎ܗ؂ࢹ • ☐ APM (௥Ճ) • ☐ Log Management (௥Ճ)
40. ΦϒβʔόϏϦςΟ࠶ઃܭ [มߋ఺] AWS Integrationͷվળ
 ɹɾར༻͍ͯ͠ΔશͯͷAWS
 ɹɹαʔϏεͷϝτϦΫεऔಘ New Relic Go Agentͷ௥Ճ
 ɹɾAPM௥Ճ
 ɹɾLogs in context௥Ճ
41. ΦϒβʔόϏϦςΟ࠶ઃܭ ͔͠͠ɾɾɾ • Logs in context -> อཹ →ΞϓϦέʔγϣϯͷϩΪϯάपΓͷઃܭ͕
 ɹݻ·ͬͨஈ֊ͰվΊͯਖ਼ࣜಋೖ
 ɹ(Fargate -> CloudWatch LogsͰ୅༻)
42. ΦϒβʔόϏϦςΟ࠶ઃܭ before ɹɹMetrics ɹɹEvents ɹɹLogs ɹɹTraces ɹafter ɹɹɹMetrics ɹɹɹEvents ɹɹɹLogs ɹɹɹTraces
43. ΦϒβʔόϏϦςΟ࠶ઃܭ [before]
 ෦෼తʹMELT͕
 ຬͨ͞Ε͍ͯΔঢ়ଶ 
 ɾAWS Integration
 ɹMetrics & Events ɾBrowser(Mobile)Agent
 ɹMetrics & Events ɾInfrastructure Agent
 ɹMetrics & Events
44. ΦϒβʔόϏϦςΟ࠶ઃܭ [after]
 MELT͕શͯ
 ຬͨ͞Ε͍ͯΔঢ়ଶ 
 ɾAWS Integration
 ɹMetrics & Events ɾCloudWatch Logs
 ɹto New Relic One
 ɹLogs ɾBrowser(Mobile)Agent
 ɹMetrics & Events ɾGo Agent
 ɹMetrics & Traces ɾInfrastructure Agent
 ɹMetrics & Events
45. ΞδΣϯμ • TVerͷ঺հ • αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ • New Relic OneಋೖʹΑΔվળͷτϥΠ • ΦϒβʔόϏϦςΟ࠶ઃܭ • New Relic Oneͷ׆༻ࣄྫ • ·ͱΊ
46. New Relic Oneͷ׆༻ࣄྫ New Relic One Platform
 https://newrelic.com/jp/platform
47. ΞϓϦέʔγϣϯ
 ϞχλϦϯά
 (APM)
48. ΞϓϦέʔγϣϯϞχλϦϯά (APM) ΞϓϦέʔγϣϯϞχλϦϯά (APM) ͱ͸ • ϦΫΤετʙϨεϙϯεͷҰ࿈ͷॲཧΛՄࢹԽ • ΞϓϦέʔγϣϯͷύϑΥʔϚϯεΛՄࢹԽ ओͳ༻్ • ΞϓϦέʔγϣϯΤϥʔͷݪҼௐࠪ • APIΤϯυϙΠϯτͷύϑΥʔϚϯεܭଌ
49. ΞϓϦέʔγϣϯϞχλϦϯά (APM) import ( "github.com/newrelic/go-agent/v3/newrelic" "github.com/newrelic/go-agent/v3/integrations/nrecho-v3" ) func main() { app, err := newrelic.NewApplication( newrelic.ConfigAppName("my test app"), newrelic.ConfigLicense("__YOUR_NEW_RELIC_LICENSE_KEY__"), ) } GoΞϓϦέʔγϣϯ΁ͷಋೖ
50. ΞϓϦέʔγϣϯϞχλϦϯά (APM) ༨ஊ : Instant Observability (༷ʑͳIntegration)
51. ΞϓϦέʔγϣϯϞχλϦϯά (APM) ಋೖ࣌ͷۤ࿑࿩ • New Relic Go Agentͷಋೖ͕͠ΜͲ͍ ◦ ਖ਼֬ͳτϨʔε৘ใΛٻΊΔ৔߹ɺ
 ෳ਺ͷfunctionʹίʔυΛૠೖ͢Δඞཁ͕͋Δ ◦ ΫϦʔϯͳಋೖํ๏͕ग़ͨ৔߹ɺ
 ૠೖͨ͠ίʔυΛফ͢ඞཁ͕͋ΔͷͰ͸ʁ ◦ pprofΛ׆༻Ͱ͖ͳ͍͔ʁ nrseg (budougumi0617)
 https://github.com/budougumi0617/nrseg
52. ΞϓϦέʔγϣϯϞχλϦϯά (APM) ղܾ • New Relic Go Agentͷಋೖ͕͠ΜͲ͍ ◦ ࣮͸func main()ʹಋೖ͢Δ͚ͩͰ
 ͋Δఔ౓ͷσʔλ͕ಘΒΕΔࣄ͕൑໌ ◦ DBपΓͷτϨʔε͸ޙ೔ରԠʹͨ͠
 (ContextपΓͰ௥Ճͷ࣮૷͕ඞཁͳͨΊ)
53. APMͰݟΒΕΔ৘ใ (αϚϦʔ)
54. APMͰݟΒΕΔ৘ใ (Transaction)
55. APMͰݟΒΕΔ৘ใ (Go runtime)
56. APMͰݟΒΕΔ৘ใ (Errors)
57. APMͰݟΒΕΔ৘ใ (Errors)
58. ΞϓϦέʔγϣϯϞχλϦϯά (APM) ಋೖͰಘΒΕͨޮՌ • APIͷύϑΥʔϚϯεվળʹܨ͕ͬͨ ◦ ஗͍APIͷϨΠςϯγ͕ՄࢹԽ͞Εͨ ◦ Ωϟογϡར༻౳Ͱվળ • ༏ઌతʹվળ͢΂͖ର৅͕໌֬ʹͳͬͨ ◦ APIผͷݺͼग़͠ճ਺ͱ࣮ߦ͕࣌ؒՄࢹԽ͞Εͨ • ΞϓϦέʔγϣϯΤϥʔͷௐ͕ࠪਝ଎ʹͳͬͨ ◦ ࠷௿ݶͷτϦΞʔδ͕Ͱ͖ΔΑ͏ʹͳͬͨ
59. ϒϥ΢β ϞχλϦϯά
60. ϒϥ΢βϞχλϦϯά ϒϥ΢βϞχλϦϯάͱ͸ • ϒϥ΢βܦ༝ͰͷΤϯυϢʔβʔϞχλϦϯά • RUM (Real User Monitoring) ओͳ༻్ • ΤϥʔͷݪҼௐࠪ • Ϣʔβʔମݧͷ೺Ѳ
61. ϒϥ΢βϞχλϦϯά ಋೖ࣌ͷۤ࿑࿩ • ίωΫςουTV΁ͷಋೖ͕ͭΒ͔ͬͨ ◦ PageViewͰΧελϜΞτϦϏϡʔτ͕औಘͰ͖ͳ͍ ◦ ϖʔδϩʔυͷλΠϛϯά͕೉͍͠ ◦ ϑϩϯτΤϯυԿ΋Θ͔Βͳ͍ ϖʔδϩʔυλΠϛϯάͷϓϩηε
 https://docs.newrelic.com/jp/docs/browser/new-relic-browser/page-load-timing-resources/page-load-timing-process/
62. ϒϥ΢βϞχλϦϯά ղܾ • ίωΫςουTV΁ͷಋೖ͕ͭΒ͔ͬͨ ◦ νʔϜϝϯόʔʹTVerͷSDKपΓͷରԠΛґཔ ◦ ࢲͷํͰNew Relicͷ࢓༷֬ೝͱಈ࡞νΣοΫ ◦ PageViewͰ͸ͳ͘PageViewTimingΛݟΔํ਑΁
63. ϒϥ΢βϞχλϦϯάͰݟΒΕΔ৘ใ (αϚϦʔ)
64. ϒϥ΢βϞχλϦϯάͰݟΒΕΔ৘ใ (Session traces)
65. ϒϥ΢βϞχλϦϯά ಋೖͰಘΒΕͨޮՌ • Ϣʔβʔମݧͷ೺Ѳʹܨ͛ΒΕͨ ◦ ࣮ࡍͷϢʔβʔʹ͍ۙϝτϦΫεΛݟΒΕΔ ◦ ϨΠςϯγͷมԽ΍Core web vitalsͷνΣοΫ • ΞϓϦέʔγϣϯΤϥʔͷௐ͕ࠪਝ଎ʹͳͬͨ ◦ ࠷௿ݶͷτϦΞʔδ͕Ͱ͖ΔΑ͏ʹͳͬͨ
66. ϞόΠϧ ϞχλϦϯά
67. ϞόΠϧϞχλϦϯά ϞόΠϧϞχλϦϯάͱ͸ • ΞϓϦܦ༝ͰͷΤϯυϢʔβʔϞχλϦϯά • RUM (Real User Monitoring) ओͳ༻్ • ύϑΥʔϚϯε෼ੳ • ΫϥογϡͷτϥϒϧγϡʔςΟϯά • Ϣʔβʔମݧͷ೺Ѳ
68. ϞόΠϧϞχλϦϯά ಋೖ࣌ͷۤ࿑࿩ • ಈըϓϨΠϠʔͷϞχλϦϯάಋೖʹ೉ߤ ◦ New Relic Video Agentͷಋೖ ◦ ࠷৽όΠφϦͰ౎౓σʔλΛ֬ೝ͍ͯͨ͠
69. ϞόΠϧϞχλϦϯά ղܾ • ಈըϓϨΠϠʔͷϞχλϦϯάಋೖʹ೉ߤ ◦ σʔλνΣοΫ༻ͷμογϡϘʔυΛ࡞੒ɾڞ༗͠ɺ
 ਝ଎ʹνΣοΫͰ͖ΔΑ͏੔උ
70. ϞόΠϧϞχλϦϯάͰݟΒΕΔ৘ใ (αϚϦʔ)
71. ϞόΠϧϞχλϦϯάͰݟΒΕΔ৘ใ (Video Agent)
72. ϞόΠϧϞχλϦϯά ಋೖͰಘΒΕͨޮՌ • ಈըࢹௌपΓͷϢʔβʔମݧ͕ՄࢹԽ͞Εͨ ◦ ࣗ෼͕ͨͪλονͰ͖ͳ͍഑৴SaaSपΓ ◦ ίϯςϯπଆͷ໰୊Ͱ࠶ੜͰ͖ͳ͍ಈը • ΞϓϦέʔγϣϯͷΤϥʔௐ͕ࠪՄೳʹͳͬͨ ◦ ϝλ৘ใͱΫϥογϡঢ়گͷ࿈ܞ ◦ ࣗ෼ͨͪͰ؆୯ʹঢ়گΛ෼ੳ
73. ΞδΣϯμ • TVerͷ঺հ • αʔϏεͷ੒௕ͱݟ͖͑ͯͨ՝୊ • New Relic OneಋೖʹΑΔվળͷτϥΠ • ΦϒβʔόϏϦςΟ࠶ઃܭ • New Relic Oneͷ׆༻ࣄྫ • ·ͱΊ
74. TVerʹ͓͚Δ ΦϒβʔόϏϦςΟ
75. ·ͱΊ TVerʹ͓͚ΔΦϒβʔόϏϦςΟ࣮ݱ·ͰͷಓͷΓ • ࣮ݱͷ伴͸ςϨϝτϦʔσʔλͰ͋Δͱཧղ • ςϨϝτϦʔσʔλͷऔಘํ๏Λ੔ཧ • New Relic OneͰςϨϝτϦʔσʔλΛऩू • ऩूͨ͠ςϨϝτϦʔσʔλΛ੔ཧɾ෼ੳ ·ͣ͸σʔλΛऩू͠؍ଌͰ͖ΔΑ͏ʹ͢Δ
76. before ☐ Ϣʔβʔମݧͷ೺Ѳ ☐ Մ༻ੑ΍ύϑΥʔϚϯεͷՄࢹԽ ☐ ໰୊ൃੜ࣌ͷਝ଎ͳղܾ ☐ ϓϩΞΫςΟϒͳϞχλϦϯά ☐ SLI / SLOʹΑΔ৴པੑͷՄࢹԽ ·ͱΊ (ϞχλϦϯάपΓͷ՝୊) after ☑ Ϣʔβʔମݧͷ೺Ѳ ☑ Մ༻ੑ΍ύϑΥʔϚϯεͷՄࢹԽ ☑ ໰୊ൃੜ࣌ͷਝ଎ͳղܾ ☐ ϓϩΞΫςΟϒͳϞχλϦϯά ☐ SLI / SLOʹΑΔ৴པੑͷՄࢹԽ
77. ·ͱΊ to be continued…
78. ࣗݾ঺հ ɾՃզ وࢤ (@TAKA_0411) ɾגࣜձࣾTVer
 ɹࣄۀຊ෦ ٕज़։ൃ෦ (2022/1ʙ) ɾझຯ͸α΢φͱΧϝϥͱήʔϜ ɾ޷͖ͳςϨϝτϦʔσʔλ͸Trace