Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Alert Handling with Datadog Incident Management

93c80c388fe9d8f9df7d030549a0ff0b?s=47 Takeshi Kondo
August 25, 2020
Technology
0
850

Alert Handling with Datadog Incident Management

JDDUG meetup#1
https://datadog-jp.connpass.com/event/185920/

93c80c388fe9d8f9df7d030549a0ff0b?s=128

Takeshi Kondo

August 25, 2020
Tweet

More Decks by Takeshi Kondo

See All by Takeshi Kondo
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
0
180
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
1
140
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
6
2.4k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
3
1.9k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
2
1.1k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
3
2.9k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
8
3.9k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
5
14k
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
4
1.4k

Other Decks in Technology

See All in Technology
95aaab3d693889550fd2e7ae02f2f789?s=48 takaking22
1
1.5k
Ec2568783e5ea4ecd0d68e1f22291eb8?s=48 takahashikazutaro
1
540
Fb69af32a1d6d3ea3bc002b7718a7166?s=48 tomotaka_yamasaki
1
890
932329c79bc511fdfed22abbd5ec92d2?s=48 rnakamuramartiny
0
220
79b0777f41898e4c9d75d9839d4cb476?s=48 1stship
2
190
Eeac2f3b51b69b3cd6fb14ed348f0c6e?s=48 limes2018
0
120
Ea29e2b19d11b48f867ae71d6a6de5df?s=48 opelab
5
630
7cd783377515bdf8207062840b7b2f4e?s=48 soracom
PRO
0
140
7cd783377515bdf8207062840b7b2f4e?s=48 soracom
PRO
0
220
4b2f3a64637b51e81813accbe8a98083?s=48 miura55
0
150
A84b3c763c9c543069b7c02551e2720e?s=48 yuyamada
6
1.6k
380bcd2ab751f5838abd8219df53e5fe?s=48 tomoki10
5
3.1k

Featured

See All Featured
F68cb25ae3e5c2106997454b13b7737d?s=48 brad_frost
161
6.7k
5f50f94346fbcb23706f0707169317a4?s=48 aarron
261
36k
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
189
14k
A9179349dd2bdc67f377719f56d85656?s=48 garrettdimon
291
110k
Eb8975af8e49e19e3dd6b6b84a542e26?s=48 qrush
287
19k
170b760e0147792d0140e59ec78e9893?s=48 eitanlees
118
10k
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
224
15k
4394ceb8b277f35ee3da7030384efb5d?s=48 davidbonilla
75
3.7k
B47b288784fda77a94aeb234ca743c24?s=48 keavy
110
15k
C44e1f7e22c3f23cff7bc130871047ef?s=48 eileencodes
117
26k
462dad0dd24c568a32dcdb0ae895ae1b?s=48 rasmusluckow
318
19k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
224
15k

Transcript

  1. Alert Handling with Datadog Incident Management Takeshi Kondo / @chaspy

    2020/08/25 JDDUG meetup#1

  2. Datadog Incident Management

  3. Datadog Incident Management https://www.datadoghq.com/blog/incident-response-with-datadog/

  4. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/

  5. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/ Cool

  6. Who am I chaspy chaspy_ Lead Software Engineer Site Reliability

    Engineering at Quipper Takeshi Kondo

  7. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  8. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  9. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned https://www.varonis.com/blog/incident-response-plan/

  10. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned -> Postmortem https://www.varonis.com/blog/incident-response-plan/ Incident Management

  11. Datadog Incident Management • Overview • Timeline • Remediation

  12. Datadog Incident Management • Overview • Timeline • Remediation

  13. Datadog Incident Management: Overview

  14. Severity Levels: Smart default and configurable

  15. Status Levels and Properties Fields

  16. Datadog Incident Management: Overview

  17. Datadog Incident Management • Overview • Timeline • Remediation

  18. Datadog Incident Management: Timeline

  19. Datadog Incident Management • Overview • Timeline • Remediation

  20. Datadog Incident Management: Remediation

  21. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  22. See “Alerting Strategy for Self-Contained Team” https://speakerdeck.com/chaspy/alerting-strategy-for-self-contained-team

  23. Review alerts Daily

  24. Review alerts at Daily Standup

  25. Review alerts at Daily Standup

  26. Thank You! chaspy chaspy_ Lead Software Engineer at Quipper Takeshi

    Kondo