Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platform-monitoring
Search
Daiki Matsui
January 20, 2017
Technology
2
15k
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platform-monitoring
【freee × プレイド】Tech Meetup 〜インフラ監視編〜
Daiki Matsui
January 20, 2017
Tweet
Share
More Decks by Daiki Matsui
See All by Daiki Matsui
The Fourth Age of SRE
ikemonn
0
190
マルチクラウドな大規模サービスKARTEを支えるDatadog/multi-cloud monitoring with Datadog
ikemonn
0
1.9k
Multicloud deploy with Spinnaker / builderscon tokyo 2018
ikemonn
2
4.2k
Node Apps Performance Tuning
ikemonn
0
130
Other Decks in Technology
See All in Technology
LangSmith入門―トレース/評価/プロンプト管理などを担うLLMアプリ開発プラットフォーム
os1ma
4
480
MLOpsの「壁」を乗り越える、LINEヤフーの Data Quality as Code
lycorptech_jp
PRO
6
560
[新卒向け研修資料] テスト文字列に「うんこ」と入れるな(2024年版)
infiniteloop_inc
4
16k
LayerXにおけるLLMプロダクト開発の今までとこれから
layerx
PRO
2
470
LLM開発・活用の舞台裏@2024.04.25
yushin_n
3
930
Java EE/Jakarta EEの現状と将来―クラウドネイティブ時代にJava EEは対応できるのか?―
takakiyo
1
170
Grafana x PagerDuty Better Together
jacopen
1
170
Building a RAG-poweredAI chat appwith Python and VS Code
pamelafox
0
120
AOAI をきっかけに 社内の Azure 管理を見直した話
recruitengineers
PRO
1
380
アクセシビリティを考慮したUI/CSSフレームワーク・ライブラリ選定
yajihum
2
1k
Android Target SDK 35 (Android 15) 対応の概要
akkie76
0
120
20240418_Google ColabにLLMが搭載されたようなのでPython x データ分析の勉強方法を考えてみる
doradora09
0
150
Featured
See All Featured
The Language of Interfaces
destraynor
151
23k
How to Ace a Technical Interview
jacobian
272
22k
The Straight Up "How To Draw Better" Workshop
denniskardys
227
130k
Agile that works and the tools we love
rasmusluckow
325
20k
GitHub's CSS Performance
jonrohan
1025
450k
How GitHub (no longer) Works
holman
304
140k
BBQ
matthewcrist
80
8.8k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
125
32k
Bash Introduction
62gerente
604
210k
Making Projects Easy
brettharned
108
5.5k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
9
8.3k
How to train your dragon (web standard)
notwaldorf
73
5.2k
Transcript
KARTEΛࢧ͑Δ ϚϧνϓϥοτϑΥʔϜΠϯϑϥࢹ @ikemonn
@ikemonn ΠϯϑϥΤϯδχΞ 201511݄ʹjoin
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
ΠϯϑϥΤϯδχΞ2ਓ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ʮશһͰյ͠ͳ͕ΒਐΉʯ ͱ͍͏จԽΛࢧ͑Δ
Startup։ൃεϐʔυ͕ॏཁ
৽͍͠αʔϏεɺݴޠΛੵۃతʹ ಋೖͰ͖ΔΑ͏ʹ
ރΕٕͨज़Ͱͳ͍ͷͰɺ ใ͕͋·Γݟ͔ͭΒͳ͍
ଟগͷࣦഊڐ༰ & ࣦഊͨ࣌͠ʹ͙͢ؾ͚Δ
ʮશһͰյ͠ͳ͕ΒਐΉʯจԽΛ ࢧ͑ΔͨΊʹࢹͷڧԽ !
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ϚϧνϓϥοτϑΥʔϜ ৽͍͠αʔϏεͷੵۃར༻
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ࢹํ๏
ผϓϥοτϑΥʔϜͷΠϯελϯε ಉ࢜ͷϝτϦοΫൺֱ͍ͨ͠ ֤ϓϥοτϑΥʔϜʹґଘͨ͠ϝτ ϦοΫૹ৴ͷίʔυΛॻ͖ͨ͘ͳ͍ ▪Πϯϑϥଆͷ՝ ▪ΞϓϦଆͷ՝
CloudWatch ৭ʑͳཧը໘Λݟͨ͘ͳ͍ http://www.irasutoya.com/2016/06/blog-post_147.html https://support.draw.io/pages/viewpage.action?pageId=1671326 https://en.wikipedia.org/wiki/File:Google_Stackdriver_logo.svg https://www.runscope.com/
جຊతʹDatadogͰҰݩཧ
ԿΛࢹ͢Δͷ͔ʁ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent https://www.datadoghq.com/ https://nz.pinterest.com/pin/296393219208794919/
https://bugsnag.com/ https://logdna.com/ https://www.pagerduty.com/resources/logo/
Πϯϑϥͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• CPU • Memory • Load Average • Disk Usage
• Disk I/O • Network I/O CloudWatch Datadog Agent
CloudWatch
None
ΞϓϦέʔγϣϯͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• ղੳͨ͠Πϕϯτ(ࠓɺࡢɺҰिؒલɺ Ұϲ݄લ) • Ͳͷ͓٬༷͔ΒͷΠϕϯτ͕ଟ͍͔ • ղੳ༻ʹཷ·͍ͬͯΔΩϡʔͷ • λΠϜΞτͷׂ߹ •
֤ॲཧʹ͔͔͍ͬͯΔ࣌ؒ • ϨεϙϯελΠϜ • ΞϓϦέʔγϣϯͷόά • Τϥʔϩά
var dogstatsd = require('libs-dogstatsd') const stats = dogstatsd.start(); // some
method stats.tick(‘test’, 1, 1, [pid:1234]); libs-dogstatsd (A wrapper library of node-dogstatsd) ࣮ߦ࣌ؒॲཧճΛDatadogʹૹ৴Ͱ͖Δϥούʔ https://github.com/makinoy/libs-dogstatsd/
Ͳ͏ͬͯࢹ͍ͯ͠Δͷ͔ʁ
LayerΛ͚ͯDashboardΛ࡞
• Layer1: KARTE͕ੜ͖͍ͯΔ͔ • Layer2: ॏཁͳϝτϦοΫ • Layer3: ֤roleͷৄࡉϝτϦοΫ •
(Layer4: ΠϯελϯεຖͷϝτϦοΫ)
None
None
None
None
Ұݩཧ͢Δ͜ͱ υϦϧμϯͯ͠Λ͍͚ͬͯΔ͜ͱ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
جຊతʹΞϥʔτ DatadogͰҰݩཧ͢Δ
ϝτϦοΫ τϦΨʔ ௨ઌ MCM ᮢ ҟৗ ▪Πϯϑϥ
ϝτϦοΫ τϦΨʔ ௨ઌ ᮢ ҟৗ ▪ΞϓϦέʔγϣϯ ᮢ
ҟৗݕग़͕ศར
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1.ϞχλϦϯάπʔϧͷྉ͔͔ۚΓ͗͢
ɾΠϯελϯεͷىಈGCPʹൺ͍ͯ ɾASΛ͏ͱҰʹىಈ/ऴྃ͢ΔΛઃఆͰ͖Δ ɾΠϯελϯεͷىಈAWSʹൺͯૣ͍ ɾASͰىಈ/ऴྃ͢Δͪ͜ΒͰઃఆͰ͖ͳ͍ ɾͨ͠ϗετ͋ͨΓ$18/ ɾΛ͑Δͱ1͋ͨΓ$0.03/hr
AutoScaler͕ҰؾʹΠϯελϯεΛ૿ͯ͠ɺҰ ؾʹΠϯελϯεΛݮΒ͢ͱ͍͏ڍಈΛྑ͘͢Δ Datadog Agent͕ىಈͨ͠Πϯελϯε͕ܹ૿ GCPΛ͍࢝Ί͔ͯΒલ݄ͷྉۚͷ2ഒΛ͑Δྉ ͕ۚٻ͞ΕΔ "# αϙʔτʹ૬ஊͯ͠࠷దͳ՝ۚମܥΛఏҊͯ͠Β ͍ɺ$1000Ҏ্҆͘ͳͬͨ $
ΠϯελϯεͷಛੑͱࢹαʔϏεͷ՝ۚମܥ Λ͔ͬ͠ΓѲ͓ͯ͘͠ʂ
2. ϝτϦοΫૹ৴λΠϛϯά͕ఆͱҧ͏
Քಇ͍ͯ͠ΔΠϯελϯεͷ͕ ຖૹΒΕ͍ͯΔΑ͏ʹݟ͑Δ%
೦5ຖͰͨ͠ʂ& ΞϥʔτΛֻ͚ͯؾͮ͘ͷ͕5ޙ'
ϝτϦοΫͷૹ৴සΛѲ͓ͯ͘͠ʂ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1. σʔλΞϥʔτҰݩཧ͢Δ 2. υϦϧμϯͯ͠Λ͍͚ͬͯΔΑ͏ʹ͢Δ 3. ֤ϓϥοτϑΥʔϜͷಛੑͱɺࢹπʔϧͷ՝ۚ ମܥΛѲ͢Δ 4. ΠϯςάϨʔγϣϯϝτϦοΫͷૹ৴සΛѲ ͢Δ
ࠓޙ
1. DatadogʹΞϥʔτΛ·ͱΊΔ 2. Datadog͕SPOFʹͳ͍ͬͯΔ݅Λ࠶ݕ౼͢Δ 3. ࢹઃఆͷexportΛ͍ͨ͠
ΤϯδχΞืूதͰ͢ʂ