Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platfo...
Search
Daiki Matsui
January 20, 2017
Technology
2
16k
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platform-monitoring
【freee × プレイド】Tech Meetup 〜インフラ監視編〜
Daiki Matsui
January 20, 2017
Tweet
Share
More Decks by Daiki Matsui
See All by Daiki Matsui
The Fourth Age of SRE
ikemonn
0
530
マルチクラウドな大規模サービスKARTEを支えるDatadog/multi-cloud monitoring with Datadog
ikemonn
0
2.5k
Multicloud deploy with Spinnaker / builderscon tokyo 2018
ikemonn
2
4.6k
Node Apps Performance Tuning
ikemonn
0
140
Other Decks in Technology
See All in Technology
[ JAWS-UG千葉支部 x 彩の国埼玉支部 ]ムダ遣い卒業!FinOpsで始めるAWSコスト最適化の第一歩
sh_fk2
2
150
2025-07-06 QGIS初級ハンズオン「はじめてのQGIS」
kou_kita
0
180
OpenTelemetryセマンティック規約の恩恵とMackerel APMにおける活用例 / SRE NEXT 2025
mackerelio
2
1.3k
ABEMAの本番環境負荷試験への挑戦
mk2taiga
5
630
AWS CDK 開発を成功に導くトラブルシューティングガイド
wandora58
3
150
マルチプロダクト環境におけるSREの役割 / SRE NEXT 2025 lunch session
sugamasao
1
230
Copilot coding agentにベットしたいCTOが開発組織で取り組んだこと / GitHub Copilot coding agent in Team
tnir
0
120
ビジネス職が分析も担う事業部制組織でのデータ活用の仕組みづくり / Enabling Data Analytics in Business-Led Divisional Organizations
zaimy
1
290
cdk initで生成されるあのファイル達は何なのか/cdk-init-generated-files
tomoki10
1
440
60以上のプロダクトを持つ組織における開発者体験向上への取り組み - チームAPIとBackstageで構築する組織の可視化基盤 - / sre next 2025 Efforts to Improve Developer Experience in an Organization with Over 60 Products
vtryo
2
640
Delegating the chores of authenticating users to Keycloak
ahus1
0
170
PO初心者が考えた ”POらしさ”
nb_rady
0
230
Featured
See All Featured
Build The Right Thing And Hit Your Dates
maggiecrowley
36
2.8k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
8
700
Code Review Best Practice
trishagee
69
19k
Imperfection Machines: The Place of Print at Facebook
scottboms
267
13k
The Power of CSS Pseudo Elements
geoffreycrofte
77
5.9k
We Have a Design System, Now What?
morganepeng
53
7.7k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
130
19k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
31
1.3k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.9k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.4k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Transcript
KARTEΛࢧ͑Δ ϚϧνϓϥοτϑΥʔϜΠϯϑϥࢹ @ikemonn
@ikemonn ΠϯϑϥΤϯδχΞ 201511݄ʹjoin
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
ΠϯϑϥΤϯδχΞ2ਓ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ʮશһͰյ͠ͳ͕ΒਐΉʯ ͱ͍͏จԽΛࢧ͑Δ
Startup։ൃεϐʔυ͕ॏཁ
৽͍͠αʔϏεɺݴޠΛੵۃతʹ ಋೖͰ͖ΔΑ͏ʹ
ރΕٕͨज़Ͱͳ͍ͷͰɺ ใ͕͋·Γݟ͔ͭΒͳ͍
ଟগͷࣦഊڐ༰ & ࣦഊͨ࣌͠ʹ͙͢ؾ͚Δ
ʮશһͰյ͠ͳ͕ΒਐΉʯจԽΛ ࢧ͑ΔͨΊʹࢹͷڧԽ !
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ϚϧνϓϥοτϑΥʔϜ ৽͍͠αʔϏεͷੵۃར༻
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ࢹํ๏
ผϓϥοτϑΥʔϜͷΠϯελϯε ಉ࢜ͷϝτϦοΫൺֱ͍ͨ͠ ֤ϓϥοτϑΥʔϜʹґଘͨ͠ϝτ ϦοΫૹ৴ͷίʔυΛॻ͖ͨ͘ͳ͍ ▪Πϯϑϥଆͷ՝ ▪ΞϓϦଆͷ՝
CloudWatch ৭ʑͳཧը໘Λݟͨ͘ͳ͍ http://www.irasutoya.com/2016/06/blog-post_147.html https://support.draw.io/pages/viewpage.action?pageId=1671326 https://en.wikipedia.org/wiki/File:Google_Stackdriver_logo.svg https://www.runscope.com/
جຊతʹDatadogͰҰݩཧ
ԿΛࢹ͢Δͷ͔ʁ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent https://www.datadoghq.com/ https://nz.pinterest.com/pin/296393219208794919/
https://bugsnag.com/ https://logdna.com/ https://www.pagerduty.com/resources/logo/
Πϯϑϥͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• CPU • Memory • Load Average • Disk Usage
• Disk I/O • Network I/O CloudWatch Datadog Agent
CloudWatch
None
ΞϓϦέʔγϣϯͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• ղੳͨ͠Πϕϯτ(ࠓɺࡢɺҰिؒલɺ Ұϲ݄લ) • Ͳͷ͓٬༷͔ΒͷΠϕϯτ͕ଟ͍͔ • ղੳ༻ʹཷ·͍ͬͯΔΩϡʔͷ • λΠϜΞτͷׂ߹ •
֤ॲཧʹ͔͔͍ͬͯΔ࣌ؒ • ϨεϙϯελΠϜ • ΞϓϦέʔγϣϯͷόά • Τϥʔϩά
var dogstatsd = require('libs-dogstatsd') const stats = dogstatsd.start(); // some
method stats.tick(‘test’, 1, 1, [pid:1234]); libs-dogstatsd (A wrapper library of node-dogstatsd) ࣮ߦ࣌ؒॲཧճΛDatadogʹૹ৴Ͱ͖Δϥούʔ https://github.com/makinoy/libs-dogstatsd/
Ͳ͏ͬͯࢹ͍ͯ͠Δͷ͔ʁ
LayerΛ͚ͯDashboardΛ࡞
• Layer1: KARTE͕ੜ͖͍ͯΔ͔ • Layer2: ॏཁͳϝτϦοΫ • Layer3: ֤roleͷৄࡉϝτϦοΫ •
(Layer4: ΠϯελϯεຖͷϝτϦοΫ)
None
None
None
None
Ұݩཧ͢Δ͜ͱ υϦϧμϯͯ͠Λ͍͚ͬͯΔ͜ͱ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
جຊతʹΞϥʔτ DatadogͰҰݩཧ͢Δ
ϝτϦοΫ τϦΨʔ ௨ઌ MCM ᮢ ҟৗ ▪Πϯϑϥ
ϝτϦοΫ τϦΨʔ ௨ઌ ᮢ ҟৗ ▪ΞϓϦέʔγϣϯ ᮢ
ҟৗݕग़͕ศར
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1.ϞχλϦϯάπʔϧͷྉ͔͔ۚΓ͗͢
ɾΠϯελϯεͷىಈGCPʹൺ͍ͯ ɾASΛ͏ͱҰʹىಈ/ऴྃ͢ΔΛઃఆͰ͖Δ ɾΠϯελϯεͷىಈAWSʹൺͯૣ͍ ɾASͰىಈ/ऴྃ͢Δͪ͜ΒͰઃఆͰ͖ͳ͍ ɾͨ͠ϗετ͋ͨΓ$18/ ɾΛ͑Δͱ1͋ͨΓ$0.03/hr
AutoScaler͕ҰؾʹΠϯελϯεΛ૿ͯ͠ɺҰ ؾʹΠϯελϯεΛݮΒ͢ͱ͍͏ڍಈΛྑ͘͢Δ Datadog Agent͕ىಈͨ͠Πϯελϯε͕ܹ૿ GCPΛ͍࢝Ί͔ͯΒલ݄ͷྉۚͷ2ഒΛ͑Δྉ ͕ۚٻ͞ΕΔ "# αϙʔτʹ૬ஊͯ͠࠷దͳ՝ۚମܥΛఏҊͯ͠Β ͍ɺ$1000Ҏ্҆͘ͳͬͨ $
ΠϯελϯεͷಛੑͱࢹαʔϏεͷ՝ۚମܥ Λ͔ͬ͠ΓѲ͓ͯ͘͠ʂ
2. ϝτϦοΫૹ৴λΠϛϯά͕ఆͱҧ͏
Քಇ͍ͯ͠ΔΠϯελϯεͷ͕ ຖૹΒΕ͍ͯΔΑ͏ʹݟ͑Δ%
೦5ຖͰͨ͠ʂ& ΞϥʔτΛֻ͚ͯؾͮ͘ͷ͕5ޙ'
ϝτϦοΫͷૹ৴සΛѲ͓ͯ͘͠ʂ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1. σʔλΞϥʔτҰݩཧ͢Δ 2. υϦϧμϯͯ͠Λ͍͚ͬͯΔΑ͏ʹ͢Δ 3. ֤ϓϥοτϑΥʔϜͷಛੑͱɺࢹπʔϧͷ՝ۚ ମܥΛѲ͢Δ 4. ΠϯςάϨʔγϣϯϝτϦοΫͷૹ৴සΛѲ ͢Δ
ࠓޙ
1. DatadogʹΞϥʔτΛ·ͱΊΔ 2. Datadog͕SPOFʹͳ͍ͬͯΔ݅Λ࠶ݕ౼͢Δ 3. ࢹઃఆͷexportΛ͍ͨ͠
ΤϯδχΞืूதͰ͢ʂ