Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platfo...
Search
Daiki Matsui
January 20, 2017
Technology
2
15k
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platform-monitoring
【freee × プレイド】Tech Meetup 〜インフラ監視編〜
Daiki Matsui
January 20, 2017
Tweet
Share
More Decks by Daiki Matsui
See All by Daiki Matsui
The Fourth Age of SRE
ikemonn
0
210
マルチクラウドな大規模サービスKARTEを支えるDatadog/multi-cloud monitoring with Datadog
ikemonn
0
2.3k
Multicloud deploy with Spinnaker / builderscon tokyo 2018
ikemonn
2
4.4k
Node Apps Performance Tuning
ikemonn
0
130
Other Decks in Technology
See All in Technology
ISUCONに強くなるかもしれない日々の過ごしかた/Findy ISUCON 2024-11-14
fujiwara3
8
870
AGIについてChatGPTに聞いてみた
blueb
0
130
VideoMamba: State Space Model for Efficient Video Understanding
chou500
0
190
AWS Lambda のトラブルシュートをしていて思うこと
kazzpapa3
2
170
Amazon Personalizeのレコメンドシステム構築、実際何するの?〜大体10分で具体的なイメージをつかむ〜
kniino
1
100
インフラとバックエンドとフロントエンドをくまなく調べて遅いアプリを早くした件
tubone24
1
430
Shopifyアプリ開発における Shopifyの機能活用
sonatard
4
250
信頼性に挑む中で拡張できる・得られる1人のスキルセットとは?
ken5scal
2
530
Amazon CloudWatch Network Monitor のススメ
yuki_ink
1
200
Taming you application's environments
salaboy
0
180
適材適所の技術選定 〜GraphQL・REST API・tRPC〜 / Optimal Technology Selection
kakehashi
1
170
Evangelismo técnico: ¿qué, cómo y por qué?
trishagee
0
360
Featured
See All Featured
Java REST API Framework Comparison - PWX 2021
mraible
PRO
28
8.2k
Facilitating Awesome Meetings
lara
50
6.1k
The MySQL Ecosystem @ GitHub 2015
samlambert
250
12k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
10
720
Fireside Chat
paigeccino
34
3k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
131
33k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Why Our Code Smells
bkeepers
PRO
334
57k
Unsuck your backbone
ammeep
668
57k
How To Stay Up To Date on Web Technology
chriscoyier
788
250k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
232
17k
Building a Scalable Design System with Sketch
lauravandoore
459
33k
Transcript
KARTEΛࢧ͑Δ ϚϧνϓϥοτϑΥʔϜΠϯϑϥࢹ @ikemonn
@ikemonn ΠϯϑϥΤϯδχΞ 201511݄ʹjoin
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
ΠϯϑϥΤϯδχΞ2ਓ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ʮશһͰյ͠ͳ͕ΒਐΉʯ ͱ͍͏จԽΛࢧ͑Δ
Startup։ൃεϐʔυ͕ॏཁ
৽͍͠αʔϏεɺݴޠΛੵۃతʹ ಋೖͰ͖ΔΑ͏ʹ
ރΕٕͨज़Ͱͳ͍ͷͰɺ ใ͕͋·Γݟ͔ͭΒͳ͍
ଟগͷࣦഊڐ༰ & ࣦഊͨ࣌͠ʹ͙͢ؾ͚Δ
ʮશһͰյ͠ͳ͕ΒਐΉʯจԽΛ ࢧ͑ΔͨΊʹࢹͷڧԽ !
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ϚϧνϓϥοτϑΥʔϜ ৽͍͠αʔϏεͷੵۃར༻
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ࢹํ๏
ผϓϥοτϑΥʔϜͷΠϯελϯε ಉ࢜ͷϝτϦοΫൺֱ͍ͨ͠ ֤ϓϥοτϑΥʔϜʹґଘͨ͠ϝτ ϦοΫૹ৴ͷίʔυΛॻ͖ͨ͘ͳ͍ ▪Πϯϑϥଆͷ՝ ▪ΞϓϦଆͷ՝
CloudWatch ৭ʑͳཧը໘Λݟͨ͘ͳ͍ http://www.irasutoya.com/2016/06/blog-post_147.html https://support.draw.io/pages/viewpage.action?pageId=1671326 https://en.wikipedia.org/wiki/File:Google_Stackdriver_logo.svg https://www.runscope.com/
جຊతʹDatadogͰҰݩཧ
ԿΛࢹ͢Δͷ͔ʁ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent https://www.datadoghq.com/ https://nz.pinterest.com/pin/296393219208794919/
https://bugsnag.com/ https://logdna.com/ https://www.pagerduty.com/resources/logo/
Πϯϑϥͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• CPU • Memory • Load Average • Disk Usage
• Disk I/O • Network I/O CloudWatch Datadog Agent
CloudWatch
None
ΞϓϦέʔγϣϯͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• ղੳͨ͠Πϕϯτ(ࠓɺࡢɺҰिؒલɺ Ұϲ݄લ) • Ͳͷ͓٬༷͔ΒͷΠϕϯτ͕ଟ͍͔ • ղੳ༻ʹཷ·͍ͬͯΔΩϡʔͷ • λΠϜΞτͷׂ߹ •
֤ॲཧʹ͔͔͍ͬͯΔ࣌ؒ • ϨεϙϯελΠϜ • ΞϓϦέʔγϣϯͷόά • Τϥʔϩά
var dogstatsd = require('libs-dogstatsd') const stats = dogstatsd.start(); // some
method stats.tick(‘test’, 1, 1, [pid:1234]); libs-dogstatsd (A wrapper library of node-dogstatsd) ࣮ߦ࣌ؒॲཧճΛDatadogʹૹ৴Ͱ͖Δϥούʔ https://github.com/makinoy/libs-dogstatsd/
Ͳ͏ͬͯࢹ͍ͯ͠Δͷ͔ʁ
LayerΛ͚ͯDashboardΛ࡞
• Layer1: KARTE͕ੜ͖͍ͯΔ͔ • Layer2: ॏཁͳϝτϦοΫ • Layer3: ֤roleͷৄࡉϝτϦοΫ •
(Layer4: ΠϯελϯεຖͷϝτϦοΫ)
None
None
None
None
Ұݩཧ͢Δ͜ͱ υϦϧμϯͯ͠Λ͍͚ͬͯΔ͜ͱ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
جຊతʹΞϥʔτ DatadogͰҰݩཧ͢Δ
ϝτϦοΫ τϦΨʔ ௨ઌ MCM ᮢ ҟৗ ▪Πϯϑϥ
ϝτϦοΫ τϦΨʔ ௨ઌ ᮢ ҟৗ ▪ΞϓϦέʔγϣϯ ᮢ
ҟৗݕग़͕ศར
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1.ϞχλϦϯάπʔϧͷྉ͔͔ۚΓ͗͢
ɾΠϯελϯεͷىಈGCPʹൺ͍ͯ ɾASΛ͏ͱҰʹىಈ/ऴྃ͢ΔΛઃఆͰ͖Δ ɾΠϯελϯεͷىಈAWSʹൺͯૣ͍ ɾASͰىಈ/ऴྃ͢Δͪ͜ΒͰઃఆͰ͖ͳ͍ ɾͨ͠ϗετ͋ͨΓ$18/ ɾΛ͑Δͱ1͋ͨΓ$0.03/hr
AutoScaler͕ҰؾʹΠϯελϯεΛ૿ͯ͠ɺҰ ؾʹΠϯελϯεΛݮΒ͢ͱ͍͏ڍಈΛྑ͘͢Δ Datadog Agent͕ىಈͨ͠Πϯελϯε͕ܹ૿ GCPΛ͍࢝Ί͔ͯΒલ݄ͷྉۚͷ2ഒΛ͑Δྉ ͕ۚٻ͞ΕΔ "# αϙʔτʹ૬ஊͯ͠࠷దͳ՝ۚମܥΛఏҊͯ͠Β ͍ɺ$1000Ҏ্҆͘ͳͬͨ $
ΠϯελϯεͷಛੑͱࢹαʔϏεͷ՝ۚମܥ Λ͔ͬ͠ΓѲ͓ͯ͘͠ʂ
2. ϝτϦοΫૹ৴λΠϛϯά͕ఆͱҧ͏
Քಇ͍ͯ͠ΔΠϯελϯεͷ͕ ຖૹΒΕ͍ͯΔΑ͏ʹݟ͑Δ%
೦5ຖͰͨ͠ʂ& ΞϥʔτΛֻ͚ͯؾͮ͘ͷ͕5ޙ'
ϝτϦοΫͷૹ৴සΛѲ͓ͯ͘͠ʂ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1. σʔλΞϥʔτҰݩཧ͢Δ 2. υϦϧμϯͯ͠Λ͍͚ͬͯΔΑ͏ʹ͢Δ 3. ֤ϓϥοτϑΥʔϜͷಛੑͱɺࢹπʔϧͷ՝ۚ ମܥΛѲ͢Δ 4. ΠϯςάϨʔγϣϯϝτϦοΫͷૹ৴සΛѲ ͢Δ
ࠓޙ
1. DatadogʹΞϥʔτΛ·ͱΊΔ 2. Datadog͕SPOFʹͳ͍ͬͯΔ݅Λ࠶ݕ౼͢Δ 3. ࢹઃఆͷexportΛ͍ͨ͠
ΤϯδχΞืूதͰ͢ʂ