Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Alert Handling with Datadog Incident Management

93c80c388fe9d8f9df7d030549a0ff0b?s=47 Takeshi Kondo
August 25, 2020
Technology
0
760

Alert Handling with Datadog Incident Management

JDDUG meetup#1
https://datadog-jp.connpass.com/event/185920/

93c80c388fe9d8f9df7d030549a0ff0b?s=128

Takeshi Kondo

August 25, 2020
Tweet

More Decks by Takeshi Kondo

See All by Takeshi Kondo
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
1
100
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
6
1.5k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
3
1.7k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
2
880
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
3
2.7k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
8
3.7k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
5
13k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
4
1.4k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
5
1.7k

Other Decks in Technology

See All in Technology
380bcd2ab751f5838abd8219df53e5fe?s=48 tomoki10
0
1k
0d29d155ce5c5a93ed46363626da3ea7?s=48 ocise
0
150
14f2b7db383dec76a490bae09596e96c?s=48 last9
0
220
Be0f86176276318b4b9775d795278f7e?s=48 yushiku
4
1.1k
966e29b84ae7dbde170f66b0bc75b7a6?s=48 ishiayaya
PRO
1
210
79fc33e55cacc42beef647541de24d58?s=48 yasuakiomokawa
1
590
164fd510e92a1912155b869b2c333c1e?s=48 tutuz
5
3k
D8e79ab09f15e69d600c00131bf7d2a9?s=48 yfutamura
0
400
5b47136bedcba2799edf4fcd27ea66d7?s=48 yaegashi
0
110
54bcc1069d75636cc735e72877dd30ec?s=48 taichinakamura
0
790
D5e41f085758da619761b10b6c54e6af?s=48 chikuta
0
240
2cf373725ded741824c50fd571eda6e1?s=48 udzura
1
290

Featured

See All Featured
C51b39fa3c79ccb99dcb8a076bc98287?s=48 brianwarren
82
4.8k
245cee81a9c424266e5e401d844ea881?s=48 lara
590
61k
E6c6e133e74c3b83f04d2861deaa1c20?s=48 searls
204
37k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
498
130k
44b54d2ffcb7857004071cc6795dde11?s=48 cassininazir
348
20k
Bfd6b681ec6e8c9bef82ff0521c364f7?s=48 kastner
54
2k
F57e2136eb9895eb95ff5dc8a1c02677?s=48 zakiwarfel
88
3.4k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
294
39k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
267
17k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
683
180k
91cefdf141106fa10674aae74ce05890?s=48 yeseniaperezcruz
302
32k
Dafc4723e9a1c067796c0fec6f509774?s=48 lemiorhan
629
48k

Transcript

  1. Alert Handling with Datadog Incident Management Takeshi Kondo / @chaspy

    2020/08/25 JDDUG meetup#1

  2. Datadog Incident Management

  3. Datadog Incident Management https://www.datadoghq.com/blog/incident-response-with-datadog/

  4. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/

  5. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/ Cool

  6. Who am I chaspy chaspy_ Lead Software Engineer Site Reliability

    Engineering at Quipper Takeshi Kondo

  7. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  8. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  9. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned https://www.varonis.com/blog/incident-response-plan/

  10. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned -> Postmortem https://www.varonis.com/blog/incident-response-plan/ Incident Management

  11. Datadog Incident Management • Overview • Timeline • Remediation

  12. Datadog Incident Management • Overview • Timeline • Remediation

  13. Datadog Incident Management: Overview

  14. Severity Levels: Smart default and configurable

  15. Status Levels and Properties Fields

  16. Datadog Incident Management: Overview

  17. Datadog Incident Management • Overview • Timeline • Remediation

  18. Datadog Incident Management: Timeline

  19. Datadog Incident Management • Overview • Timeline • Remediation

  20. Datadog Incident Management: Remediation

  21. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  22. See “Alerting Strategy for Self-Contained Team” https://speakerdeck.com/chaspy/alerting-strategy-for-self-contained-team

  23. Review alerts Daily

  24. Review alerts at Daily Standup

  25. Review alerts at Daily Standup

  26. Thank You! chaspy chaspy_ Lead Software Engineer at Quipper Takeshi

    Kondo