Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Alert Handling with Datadog Incident Management

Avatar for Takeshi Kondo Takeshi Kondo
August 25, 2020
Technology
1.7k
0

Alert Handling with Datadog Incident Management

JDDUG meetup#1
https://datadog-jp.connpass.com/event/185920/

Avatar for Takeshi Kondo

Takeshi Kondo

August 25, 2020

More Decks by Takeshi Kondo

See All by Takeshi Kondo
SREの知識地図 - 第2章の紹介 - / Knowledge Map of SRE – Introduction to Chapter 2 –
Avatar for Takeshi Kondo chaspy
0
85
SRE NEXT CfP チームが語る 聞きたくなるプロポーザルとは / Proposals by the SRE NEXT CfP Team that are sure to be accepted
Avatar for Takeshi Kondo chaspy
2
1.7k
Slack Platform(Deno) での RAG 実装 - LangChain(js) を使ってみた / rag-implementation-on-slack-platform-deno-experimenting-with-langchain-js
Avatar for Takeshi Kondo chaspy
0
290
SRE の考えをマネジメントに活かす / applying SRE ideas to management
Avatar for Takeshi Kondo chaspy
7
8.3k
RAGの簡易評価によるフィードバックサイクル実践 / Feedback cycle practice through simplified assessment of RAGs
Avatar for Takeshi Kondo chaspy
2
6k
定量データと定性評価を用いた技術戦略の組織的実践 / Systematic implementation of technology strategies using quantitative data and qualitative evaluation
Avatar for Takeshi Kondo chaspy
9
2.3k
エンジニアブランディングチームの KPI / KPI's of engineer branding team
Avatar for Takeshi Kondo chaspy
2
2.5k
「SLO Review」今やるならこうする / If I had to do the "SLO Review" again
Avatar for Takeshi Kondo chaspy
3
2.3k
開発者とともに作る Site Reliability Engineering / SREing with Developers
Avatar for Takeshi Kondo chaspy
10
9k

Other Decks in Technology

See All in Technology
社内RAGの導入で気を付けたポイント
Avatar for やくも yakumo
1
130
ラズパイ & Picoで入門：Zephyr(RTOS)の環境構築からビルドまでの紹介
Avatar for misoji engineer iotengineer22
0
140
AIのために、AIを使った、Effect-TSからの脱却 〜テストを活用した安全なリファクタリングの進め方〜
Avatar for 株式会社ビットキー / Bitkey Inc. bitkey
PRO
0
160
可視化から活用へ — Mesh化・Segmentation・アライメントの研究動向
Avatar for GPU UNITE gpuunite_official
0
230
[続・営業向け 誰でも話せるOCI セールストーク] セールストーク総集編(2026年5月15日開催)
Avatar for oracle4engineer oracle4engineer
PRO
1
100
いつの間にかデータエンジニア以外の業務も増えていたけど、意外と経験が役に立ってる
Avatar for ZOZO Developers zozotech
PRO
0
730
RedmineをAIで効率的に使う検証
Avatar for Takayuki Yoshioka yoshiokacb
0
160
O'Reilly Infrastructure & Ops Superstream: Platform Engineering for Developers, Architects & the Rest of Us
Avatar for Syntasso syntasso
0
320
障害対応のRunbookは作った、でも本当に動くの？ AWS FIS で EKS の AZ 障害を再現してみた
Avatar for Hiroki Takatsuka tk3fftk
0
120
サイボウズ、プラットフォームエンジニアリング始めるってよ ― プラットフォームチームの事業貢献と組織アラインメントの強化
Avatar for Shin'ya Ueoka ueokande
0
120
[みん強]AIの価値を最大化するデータ基盤戦略：Self-Service型Data Meshへの転換とAgentic AI Meshに向けた取り組み with Snowflake他
Avatar for Matsubara y_matsubara
1
160
コーディングエージェントはTypeScriptの 型エラーをどう自己修正しているのか
Avatar for Melonps melonps
2
230

Featured

See All Featured
Measuring Dark Social's Impact On Conversion and Attribution
Avatar for Stephen Akadiri stephenakadiri
2
200
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
55k
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
790
HDC tutorial
Avatar for Michiel Stock michielstock
2
660
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
45
9k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
231
23k
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
330
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
61
9.8k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
304
21k
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
200
Exploring anti-patterns in Rails
Avatar for Elle Meredith aemeredith
3
360
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
340

Transcript

  1. Alert Handling with Datadog Incident Management Takeshi Kondo / @chaspy

    2020/08/25 JDDUG meetup#1

  2. Datadog Incident Management

  3. Datadog Incident Management https://www.datadoghq.com/blog/incident-response-with-datadog/

  4. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/

  5. Datadog Incident Management https://docs.datadoghq.com/monitors/incident_management/ Cool

  6. Who am I chaspy chaspy_ Lead Software Engineer Site Reliability

    Engineering at Quipper Takeshi Kondo

  7. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  8. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  9. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned https://www.varonis.com/blog/incident-response-plan/

  10. Incident Response 6-Step Plan 1. Preparation 2. Identification 3. Containment

    4. Eradication 5. Recovery 6. Review lessons learned -> Postmortem https://www.varonis.com/blog/incident-response-plan/ Incident Management

  11. Datadog Incident Management • Overview • Timeline • Remediation

  12. Datadog Incident Management • Overview • Timeline • Remediation

  13. Datadog Incident Management: Overview

  14. Severity Levels: Smart default and configurable

  15. Status Levels and Properties Fields

  16. Datadog Incident Management: Overview

  17. Datadog Incident Management • Overview • Timeline • Remediation

  18. Datadog Incident Management: Timeline

  19. Datadog Incident Management • Overview • Timeline • Remediation

  20. Datadog Incident Management: Remediation

  21. Agenda • Introduction of Datadog Incident Management • Alert Handling

    in Quipper

  22. See “Alerting Strategy for Self-Contained Team” https://speakerdeck.com/chaspy/alerting-strategy-for-self-contained-team

  23. Review alerts Daily

  24. Review alerts at Daily Standup

  25. Review alerts at Daily Standup

  26. Thank You! chaspy chaspy_ Lead Software Engineer at Quipper Takeshi

    Kondo