Alert Handling with Datadog Incident Management

93c80c388fe9d8f9df7d030549a0ff0b?s=47 Takeshi Kondo
August 25, 2020
Technology
0
440

Alert Handling with Datadog Incident Management

JDDUG meetup#1
https://datadog-jp.connpass.com/event/185920/

93c80c388fe9d8f9df7d030549a0ff0b?s=128

Takeshi Kondo

August 25, 2020
Tweet

More Decks by Takeshi Kondo

See All by Takeshi Kondo
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
3
1.1k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
8
3.3k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
5
12k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
4
1.3k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
4
1.5k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
0
28
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
0
83
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
0
26
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
2
400

Other Decks in Technology

See All in Technology
2102a6b8760bd6f57f672805723dd83a?s=48 line_developers_tw
0
1.3k
3623c11f38517055d9040073ed81913b?s=48 endoumari
3
570
Cd931bc05e7cee46b9a950a63e47ba4c?s=48 you
0
130
53850955f15249a1a9dc49df6113e400?s=48 line_developers
2
240
0ced4f52ccc9e9b2644b4dd7f475e545?s=48 kkojima
1
200
53850955f15249a1a9dc49df6113e400?s=48 line_developers
0
350
9df0566fad9c9ca3bf669917848878fe?s=48 i35_267
6
1.4k
2564c99f616f1ecfc0f617a6fe87e2a9?s=48 penguin045
0
250
A2cd163fd3cfca5204b0d8f0c17eea29?s=48 yujif
2
130
7602f2751868682b296171f58589c851?s=48 lyrixx
3
1k
9a22d09f92d50fa3d2a16766d0ba52f8?s=48 fabpot
4
1.7k
0634fb56ef638ebc7814afc716fbc0a1?s=48 iampuky
0
110

Featured

See All Featured
F29327647a9cff5c69618bae420792ea?s=48 tenderlove
49
3.2k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
23
1.6k
Dad095ea7038f89f760419ce475d5d14?s=48 michaelherold
224
8.3k
A9704266587836f7e784235e5073b93e?s=48 jmmastey
2
240
168ccec72eee0530b818d44f3fedaacf?s=48 shlominoach
175
7.2k
C4de88ea47538e4594750e3861a341c8?s=48 brettharned
91
2.8k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
51
3.9k
5f50f94346fbcb23706f0707169317a4?s=48 aarron
254
36k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
1348
190k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
293
39k
56c4053438af8e8b90d6f53cbb7573be?s=48 jakevdp
769
190k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
267
16k

Transcript

  1. Alert Handling with Datadog Incident Management Takeshi Kondo / @chaspy

    2020/08/25 JDDUG meetup#1

  2. Datadog Incident Management

  3. Datadog Incident Management https://www.datadoghq.com/blog/incident-response-with-datadog/

  4. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/

  5. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/ Cool

  6. Who am I chaspy chaspy_ Lead Software Engineer Site Reliability

    Engineering at Quipper Takeshi Kondo

  7. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  8. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  9. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned https://www.varonis.com/blog/incident-response-plan/

  10. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned -> Postmortem https://www.varonis.com/blog/incident-response-plan/ Incident Management

  11. Datadog Incident Management • Overview • Timeline • Remediation

  12. Datadog Incident Management • Overview • Timeline • Remediation

  13. Datadog Incident Management: Overview

  14. Severity Levels: Smart default and configurable

  15. Status Levels and Properties Fields

  16. Datadog Incident Management: Overview

  17. Datadog Incident Management • Overview • Timeline • Remediation

  18. Datadog Incident Management: Timeline

  19. Datadog Incident Management • Overview • Timeline • Remediation

  20. Datadog Incident Management: Remediation

  21. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  22. See “Alerting Strategy for Self-Contained Team” https://speakerdeck.com/chaspy/alerting-strategy-for-self-contained-team

  23. Review alerts Daily

  24. Review alerts at Daily Standup

  25. Review alerts at Daily Standup

  26. Thank You! chaspy chaspy_ Lead Software Engineer at Quipper Takeshi

    Kondo