Upgrade to Pro — share decks privately, control downloads, hide ads and more …

たまに起きる外部サービスの障害に備えたり備えなかったりする話

Avatar for Sohei Iwahori Sohei Iwahori
December 18, 2025
Technology
910
1

 たまに起きる外部サービスの障害に備えたり備えなかったりする話

Avatar for Sohei Iwahori

Sohei Iwahori

December 18, 2025

More Decks by Sohei Iwahori

See All by Sohei Iwahori
eBPF Can Do It! A 5-Minute Tour of 5 Real-World PHP Issues Solved with eBPF
Avatar for Sohei Iwahori egmc
1
1.2k
本番環境でPHPコードに触れずに「使われていないコード」を調べるにはどうしたらよいか？
Avatar for Sohei Iwahori egmc
3
1.2k
SREのためのeBPF活用ステップアップガイド
Avatar for Sohei Iwahori egmc
3
6k
eBPFと周辺技術を利用してPHPアプリケーションコードを変更しない可視化をやってみる
Avatar for Sohei Iwahori egmc
1
100
PHPアプリケーションにおけるeBPFの使い所
Avatar for Sohei Iwahori egmc
1
1.6k
Building Dashboards as a Hobby
Avatar for Sohei Iwahori egmc
0
1k
Runbookに何を書き、どのようにアラートを振り分けるか？
Avatar for Sohei Iwahori egmc
2
5.1k
プロダクション環境の信頼性を損ねず観測する技術
Avatar for Sohei Iwahori egmc
9
9.8k
practices-for-making-alerts-actionable.pdf
Avatar for Sohei Iwahori egmc
3
8.7k

Other Decks in Technology

See All in Technology
AI時代のアウトプット――変わったこと、変わらないこと / Devsumi 2026 Kansai #devsumi
Avatar for Junichi Ito jnchito
0
330
Genie Codeハンズオン応用編
Avatar for Takaaki Yayoi taka_aki
0
130
【GCC2026】大規模言語モデルを活用した内製検索サービスの社内展開や業務活用
Avatar for Bandai Namco Studios Inc. bandainamcostudios
PRO
0
350
Kiro Crew入門 - 常駐エージェントの仕組みと使いどころ / Intro to Kiro Crew
Avatar for Kazuki Adachi k_adachi_01
1
630
Eight Engineering Unit 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
3
8.2k
Android skills に学ぶ
Avatar for kokiko kokiko
0
130
AI・HPC開発を支えるGPU環境の新しい選択肢 液冷GPUシステム「AquSys」の取り組み
Avatar for GPU UNITE gpuunite_official
0
160
属人化を叩き割れ！「制作加速」と「安定化」の矛盾を打破する：8年目プロダクトが辿り着いた「ミスが起こり得ない」アセット制作フローの全貌
Avatar for gree_tech gree_tech
PRO
0
120
What's new in Go 1.27?
Avatar for Koya IWAMURA ciarana
0
280
tamachi.go 誕生の裏側
Avatar for ryoji miyamoto rymiyamoto
1
190
Adding Right-to-Left support to your web
application with CSS logical properties — Lessons from Redmine
Avatar for MAEDA Go vividtone
0
160
Head First モブプログラミング / Head First Mobprogramming
Avatar for TAKAKING22 takaking22
10
12k

Featured

See All Featured
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
270
14k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
10k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
31
2.9k
It's Worth the Effort
Avatar for 3n 3n
188
29k
sira's awesome portfolio website redesign presentation
Avatar for ElsiraPls elsirapls
0
330
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
Avatar for Aleyda Solis aleyda
1
2.1k
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
Avatar for Umar Saidu Auna auna
0
210
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
75
12k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
41
2.7k
Darren the Foodie - Storyboard
Avatar for Kevinho.art khoart
PRO
3
3.7k
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
21
1.6k
Between Models and Reality
Avatar for mayunak mayunak
4
400

Transcript

  1. ͨ·ʹى͖Δ֎෦αʔϏεͷো֐ʹ උ͑ͨΓඋ͑ͳ͔ͬͨΓ͢Δ࿩ 2025/12/12 ΏΔSREษڧձ #14 Sohei Iwahori (GREE, Inc.)

  2. who? » Sohei Iwahori (@egmc) » גࣜձࣾάϦʔ ΠϯϑϥετϥΫνϟ෦ γχΞϦʔυΤϯδχΞ »

    Πϯϑϥͱ؂ࢹγεςϜ » SRE NEXT 2025 Co-ChairʢͰͨ͠ʣ » eBPF Japan MeetupӡӦ

  3. Q:ͨ·ʹى͖Δ֎෦αʔϏεͷো֐ is Կ A:PagerDuty͕μ΢ϯͨ͠ɺͱ͔ͦ͏͍͏΍ͭͰ͢

  4. ͜ͷτʔΫͰಘΒΕΔ͔΋͠Εͳ͍͜ͱ » ֎෦ͷαʔϏεͷো֐ʹରͯ͠Ͳͷఔ౓ͲͷΑ͏ʹඋ͑Δͷ͔ͷώϯτ » كʹݟམͱ͕ͪ͠ͳܦ࿏ʹ͍ͭͯߟ͑Δ » օ͞ΜͲͷఔ౓Ͳ͏ͯ͠·͢ʁͱ͍͏ͷΛฉ͘ʢࢲ͕ʣ » ʢ֎෦ͷαʔϏε͕μ΢ϯͯ͠΋׬ᘳʹγεςϜΛकΓ·͠ΐ͏ɺͰ͸ͳ ͍ʣ

  5. ΞδΣϯμ » ࣄྫΛ࿩͢ » 2021/10 Grafana Cloud » 2025/08 PagerDuty

    » 2025/11 Cloudflare » ͦͷଞͷώϯτʹ͍ͭͯ࿩͢ » ϩέʔγϣϯΛόϥ͢ઓུ » ೝূج൫ͷαʔϏε͕ར༻ෆՄʹͳͬͨΒʁ » ϝʔϧαʔόΛΦϯϓϨ͔ΒΫϥ΢υ΁Ҡߦͨ࣌͠ͷձ࿩ » ·ͱΊ

  6. ࣄྫΛ࿩͢

  7. 2021/10 Grafana Cloud » Grafana Cloudͷ2࣌ؒͷμ΢ϯ » ΦϯϓϨଆͷγεςϜଆͰো֐ʹͳͬͨ » SRE

    NEXT 2022Ͱ࿩ͯ͠·͢1 » ͜Ε͸උ͍͑ͯͳ͔ͬͨέʔε 1 ϓϩμΫγϣϯ؀ڥͷ৴པੑΛଛͶͣ؍ଌ͢Δٕज़ https://sre-next.dev/2022/schedule/#jp32

  8. Ͳ͏͢Ε͹Α͔͔ͬͨ » ՄೳͳݶΓࣄલʹྫ֎ܥ΋ಈ͔͓͚ͯ͠ΔͱΑ͍ » ΤʔδΣϯτࣗମͷMonitoring΋Մೳ͕ͩ͜Ε͸͜ΕͰେม » ͳΜΒ͔ผܦ࿏Ͱҟৗݕ஌͕Ͱ͖͍ͯΔͱΑ͍

  9. 2025/08 PagerDuty » PagerDutyͷো֐ʹΑΔΞϥʔτ഑ૹ஗Ԇ » 24/365ͷҰ࣍ରԠνʔϜ͕͍ΔͷͰͦͪ ΒͰٵऩ » جຊతʹ͸૝ఆࡁͳͷͰͦͷΑ͏ʹରԠ ͞Εͨ

  10. Ͳ͏͍ͯ͠Δ͔ » ಺੡ͷΞϥʔτ؂ࢹγεςϜʢAWSͰ৑௕ߏ੒ͰՔಇʣ͔ΒSlack/ PagerDuty/ͦͷଞͷνϟϯωϧ΁ͷ௨஌ΛAPIܦ༝Ͱߦ͍ͬͯΔ » ΫϦςΟΧϧͳΞϥʔτ௨஌͸2ܥ౷ͷܦ࿏Λ༻ҙ͢ΔΑ͏ʹ͍ͯ͠Δ » ྺ࢙తഎܠͱͯ͠͸ΦϯϓϨͷ࣌୅͔Β24/365ӡ༻νʔϜ͕͍ΔͨΊɺͦͷ ӡ༻Λ૝ఆΛ͍ͯ͠Δ

  11. 2025/11 Cloudflare » Cloudflareͷμ΢ϯ » CDNͱͯ͠͸ར༻͍ͯ͠ͳ͍͕Ұ෦ͷίϯςφΠϝʔ δͷऔಘͳͲͰӨڹ » ༧૝ͯ͠ͳ͔ͬͨͱ͜Ζͱͯ͠Grafana CloudͷҰ෦

    ͷελοΫ͕ӾཡෆՄʹͳͬͨ

  12. Ͳ͏͢Δ΂͖͔ » Πϝʔδܥ͸جຊతʹϓϧεϧʔΩϟογϡಋೖͳͲʢେମ΍ͬͯ͸͍ͨ » SaaS͕࢖ͬͯΔCDN·Ͱ͸ਖ਼௚ҙࣝ͠ͳͯ͘ྑ͍ͱࢥ͏ » ͜Ε͸ϩέʔγϣϯઓུͷํͰ

  13. ͦͷଞͷώϯτʹ͍ͭͯ࿩͢

  14. ϩέʔγϣϯΛόϥ͢ઓུ » αʔϏεʹΑͬͯ͸ελοΫ͝ͱʹϩέʔγϣϯ΍Ϋϥ΢υϓϩόΠμΛબ ΂Δ » ࣗࣾͷαʔϏεͱಉ͡Ϋϥ΢υϓϩόΠμ΍ϩέʔγϣϯʢϦʔδϣϯʣΛ બ୒͢Δ͜ͱͰPrivateLink͕࢖͑ͨΓసૹྔΛ཈͑ΒΕͨΓ͢ΔͷͰτϨʔ υΦϑ͸͋Δ » ݸਓతʹ͸શ໓͸ਏ͍ͷͰɺڧ͍ཧ༝͕ͳ͚Ε͹ద౓ʹόϥ͢ઓུΛਪͯ͠

    ͍Δ

  15. ೝূج൫ͷαʔϏε͕ར༻ෆՄʹͳͬͨΒʁ » EntraIDͳͲɺSSOͷج൫͕μ΢ϯ͢Δͱ࡞ۀͦͷ΋ͷ͕Ͱ͖ͳ͘ͳΓେมͭΒ͍ » େࣄͳαʔϏεʹ͸ඇৗޱΛ༻ҙ͓ͯ͘͠ » AWSͰ͋Ε͹MFAઃఆͯ͠ผΞΧ΢ϯτʹඇৗ༻ϢʔβʔΛ࡞͓ͬͯ͘ͱ͔ » αʔϏεʹΑͬͯ͸SAMLͰͷϩάΠϯͷྫ֎ͱͯ͠IDύεϫʔυೝূΛҰ෦ ϢʔβʔʹڐՄ͢ΔɺΈ͍ͨͳ΋ͷ΋͋Δ

    » ج൫ͷμ΢ϯ͡Όͳͯ͘΋ূ໌ॻͷظݶ੾Ε΍ΦϖϛεʹΑΓೖΕͳ͘ͳΔέʔ ε΋͋Δ

  16. ϝʔϧαʔόΛΦϯϓϨ͔ΒΫϥ΢υ΁Ҡߦͨ͠ ࣌ͷձ࿩ » ʮΦϯϓϨͱΫϥ΢υͷμΠϨΫτίωΫτͷ઀ଓ؂ࢹ͸ΦϯϓϨଆͷαʔ όͰ΍ͬͯ·͢ΑͶʯ » ʮͦ͏Ͱ͢Ͷɺ઀ଓஅΛݕ஌ͨ͠৔߹͸ϝʔϧͰ௨஌͍ͯ͠·͢ʯ » ʮϝʔϧαʔό͕Ϋϥ΢υଆʹҠߦ͢ΔͱμΠϨΫτίωΫτ͕੾ΕͨΒϝʔ ϧ͕ಧ͔ͳ͘ͳΔͷͰ͸ʁʯ

  17. ·ͱΊ » ֎෦αʔϏε͸جຊతʹΞϯίϯτϩʔϥϒϧͰ͕͢ద౓ʹඋ͑ΒΕΔ͜ͱ΋͋Δ » ࣗࣾͷཁ݅ʹԠͯ͡උ͑·͠ΐ͏ʢ΍Γ͗͢͸ې෺ʣ » උ͑ͷώϯτ » ඞཁʹԠͯ͡ผܦ࿏Λ༻ҙ͢Δ »

    ՄೳͰ͋Ε͹μ΢ϯ࣌ͷڍಈΛγϛϡϨʔτ͓ͯ͘͠ » Έͳ͞ΜͲ͏͞Εͯ·͔͢ʁ

  18. Thank you for listening

  19. None