Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Alert Handling with Datadog Incident Management

93c80c388fe9d8f9df7d030549a0ff0b?s=47 Takeshi Kondo
August 25, 2020
Technology
0
690

Alert Handling with Datadog Incident Management

JDDUG meetup#1
https://datadog-jp.connpass.com/event/185920/

93c80c388fe9d8f9df7d030549a0ff0b?s=128

Takeshi Kondo

August 25, 2020
Tweet

More Decks by Takeshi Kondo

See All by Takeshi Kondo
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
0
8
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
6
1.3k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
3
1.5k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
2
680
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
3
1.2k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
8
3.6k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
5
13k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
4
1.4k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
5
1.6k

Other Decks in Technology

See All in Technology
2cf373725ded741824c50fd571eda6e1?s=48 udzura
2
260
Db4af41c084fb66f56725d0b3b40fb09?s=48 go5paopao
4
510
9a883e4b99553b96d3ecf5a47aa6f233?s=48 khrd
1
640
D9e65f4b0af059ae9ba243c8c2265e4f?s=48 pohjus
0
3.3k
569f10721398d92f5033097ac6d9132c?s=48 thockin
3
940
8a84268593355816432ceaf78777d585?s=48 dena_tech
1
110
9cdd446fb259ec93e52d4388f60197f8?s=48 karamem0
1
770
Ddac93a4fdff089ff3c641b7c1d02255?s=48 imdigitallab
0
490
B1dca90d4b3ffd2ccd918774e1ba170d?s=48 hmatsu47
5
700
02e11e1c79e926b59d011839bb10ab04?s=48 minma
0
190
8a84268593355816432ceaf78777d585?s=48 dena_tech
11
3.1k
499b0680d59a0a04c24d8f525df8a678?s=48 ayanadesu
0
400

Featured

See All Featured
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
311
21k
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
84
7.9k
282d599b414022eba5096510f675b6e2?s=48 chrislema
231
16k
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
221
15k
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
222
47k
761be20b5ebd271008bcee1244fc5b52?s=48 matthewcrist
73
7.5k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
494
110k
A16eb159db895e3b01d3dc95767ad595?s=48 jonyablonski
19
1.2k
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
359
62k
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
272
16k
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
86
8.6k
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
192
8.8k

Transcript

  1. Alert Handling with Datadog Incident Management Takeshi Kondo / @chaspy

    2020/08/25 JDDUG meetup#1

  2. Datadog Incident Management

  3. Datadog Incident Management https://www.datadoghq.com/blog/incident-response-with-datadog/

  4. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/

  5. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/ Cool

  6. Who am I chaspy chaspy_ Lead Software Engineer Site Reliability

    Engineering at Quipper Takeshi Kondo

  7. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  8. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  9. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned https://www.varonis.com/blog/incident-response-plan/

  10. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned -> Postmortem https://www.varonis.com/blog/incident-response-plan/ Incident Management

  11. Datadog Incident Management • Overview • Timeline • Remediation

  12. Datadog Incident Management • Overview • Timeline • Remediation

  13. Datadog Incident Management: Overview

  14. Severity Levels: Smart default and configurable

  15. Status Levels and Properties Fields

  16. Datadog Incident Management: Overview

  17. Datadog Incident Management • Overview • Timeline • Remediation

  18. Datadog Incident Management: Timeline

  19. Datadog Incident Management • Overview • Timeline • Remediation

  20. Datadog Incident Management: Remediation

  21. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  22. See “Alerting Strategy for Self-Contained Team” https://speakerdeck.com/chaspy/alerting-strategy-for-self-contained-team

  23. Review alerts Daily

  24. Review alerts at Daily Standup

  25. Review alerts at Daily Standup

  26. Thank You! chaspy chaspy_ Lead Software Engineer at Quipper Takeshi

    Kondo