Upgrade to PRO for Only $50/Year—Limited-Time Offer! 🔥
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platfo...
Search
Daiki Matsui
January 20, 2017
Technology
2
15k
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platform-monitoring
【freee × プレイド】Tech Meetup 〜インフラ監視編〜
Daiki Matsui
January 20, 2017
Tweet
Share
More Decks by Daiki Matsui
See All by Daiki Matsui
The Fourth Age of SRE
ikemonn
0
210
マルチクラウドな大規模サービスKARTEを支えるDatadog/multi-cloud monitoring with Datadog
ikemonn
0
2.3k
Multicloud deploy with Spinnaker / builderscon tokyo 2018
ikemonn
2
4.4k
Node Apps Performance Tuning
ikemonn
0
130
Other Decks in Technology
See All in Technology
スパイクアクセス対策としての pitchfork 導入
riseshia
0
110
データ基盤の負債解消のためのリプレイス
livesense
PRO
0
150
Oracle Cloud Infrastructure:2024年11月度サービス・アップデート
oracle4engineer
PRO
0
180
Will multimodal language processing change the world?
keio_smilab
PRO
2
280
「品質とスピードはトレード・オンできる」に向き合い続けた2年半を振り返る / Quality and speed can be traded on.
mii3king
0
550
検証と資産化を形にするプロダクト組織へ/tapple_pmconf2024
corin8823
1
7k
ゆるSRE勉強会 #8 組織的にSREが始まる中で意識したこと
abnoumaru
2
970
プロダクトマネージャーは 事業責任者の夢をみるのか pmconf2024
gimupop
1
6.5k
GDGoC開発体験談 - Gemini生成AI活用ハッカソン / GASとFirebaseで挑むパン屋のフードロス解決 -
hotekagi
1
640
Raspberry Pi 秋の新製品をチェックしてみよう / 20231202-rpi-jam-tokyo
akkiesoft
0
320
2024/11/29_失敗談から学ぶ! エンジニア向けre:Invent攻略アンチパターン集
hiashisan
0
390
LangChainとSupabaseを活用して、RAGを実装してみた
atsushii
0
130
Featured
See All Featured
Reflections from 52 weeks, 52 projects
jeffersonlam
346
20k
Six Lessons from altMBA
skipperchong
27
3.5k
KATA
mclloyd
29
14k
Build The Right Thing And Hit Your Dates
maggiecrowley
33
2.4k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
A Modern Web Designer's Workflow
chriscoyier
693
190k
4 Signs Your Business is Dying
shpigford
181
21k
5 minutes of I Can Smell Your CMS
philhawksworth
202
19k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
6
480
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
45
2.2k
Fireside Chat
paigeccino
34
3.1k
Transcript
KARTEΛࢧ͑Δ ϚϧνϓϥοτϑΥʔϜΠϯϑϥࢹ @ikemonn
@ikemonn ΠϯϑϥΤϯδχΞ 201511݄ʹjoin
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
ΠϯϑϥΤϯδχΞ2ਓ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ʮશһͰյ͠ͳ͕ΒਐΉʯ ͱ͍͏จԽΛࢧ͑Δ
Startup։ൃεϐʔυ͕ॏཁ
৽͍͠αʔϏεɺݴޠΛੵۃతʹ ಋೖͰ͖ΔΑ͏ʹ
ރΕٕͨज़Ͱͳ͍ͷͰɺ ใ͕͋·Γݟ͔ͭΒͳ͍
ଟগͷࣦഊڐ༰ & ࣦഊͨ࣌͠ʹ͙͢ؾ͚Δ
ʮશһͰյ͠ͳ͕ΒਐΉʯจԽΛ ࢧ͑ΔͨΊʹࢹͷڧԽ !
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ϚϧνϓϥοτϑΥʔϜ ৽͍͠αʔϏεͷੵۃར༻
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ࢹํ๏
ผϓϥοτϑΥʔϜͷΠϯελϯε ಉ࢜ͷϝτϦοΫൺֱ͍ͨ͠ ֤ϓϥοτϑΥʔϜʹґଘͨ͠ϝτ ϦοΫૹ৴ͷίʔυΛॻ͖ͨ͘ͳ͍ ▪Πϯϑϥଆͷ՝ ▪ΞϓϦଆͷ՝
CloudWatch ৭ʑͳཧը໘Λݟͨ͘ͳ͍ http://www.irasutoya.com/2016/06/blog-post_147.html https://support.draw.io/pages/viewpage.action?pageId=1671326 https://en.wikipedia.org/wiki/File:Google_Stackdriver_logo.svg https://www.runscope.com/
جຊతʹDatadogͰҰݩཧ
ԿΛࢹ͢Δͷ͔ʁ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent https://www.datadoghq.com/ https://nz.pinterest.com/pin/296393219208794919/
https://bugsnag.com/ https://logdna.com/ https://www.pagerduty.com/resources/logo/
Πϯϑϥͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• CPU • Memory • Load Average • Disk Usage
• Disk I/O • Network I/O CloudWatch Datadog Agent
CloudWatch
None
ΞϓϦέʔγϣϯͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• ղੳͨ͠Πϕϯτ(ࠓɺࡢɺҰिؒલɺ Ұϲ݄લ) • Ͳͷ͓٬༷͔ΒͷΠϕϯτ͕ଟ͍͔ • ղੳ༻ʹཷ·͍ͬͯΔΩϡʔͷ • λΠϜΞτͷׂ߹ •
֤ॲཧʹ͔͔͍ͬͯΔ࣌ؒ • ϨεϙϯελΠϜ • ΞϓϦέʔγϣϯͷόά • Τϥʔϩά
var dogstatsd = require('libs-dogstatsd') const stats = dogstatsd.start(); // some
method stats.tick(‘test’, 1, 1, [pid:1234]); libs-dogstatsd (A wrapper library of node-dogstatsd) ࣮ߦ࣌ؒॲཧճΛDatadogʹૹ৴Ͱ͖Δϥούʔ https://github.com/makinoy/libs-dogstatsd/
Ͳ͏ͬͯࢹ͍ͯ͠Δͷ͔ʁ
LayerΛ͚ͯDashboardΛ࡞
• Layer1: KARTE͕ੜ͖͍ͯΔ͔ • Layer2: ॏཁͳϝτϦοΫ • Layer3: ֤roleͷৄࡉϝτϦοΫ •
(Layer4: ΠϯελϯεຖͷϝτϦοΫ)
None
None
None
None
Ұݩཧ͢Δ͜ͱ υϦϧμϯͯ͠Λ͍͚ͬͯΔ͜ͱ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
جຊతʹΞϥʔτ DatadogͰҰݩཧ͢Δ
ϝτϦοΫ τϦΨʔ ௨ઌ MCM ᮢ ҟৗ ▪Πϯϑϥ
ϝτϦοΫ τϦΨʔ ௨ઌ ᮢ ҟৗ ▪ΞϓϦέʔγϣϯ ᮢ
ҟৗݕग़͕ศར
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1.ϞχλϦϯάπʔϧͷྉ͔͔ۚΓ͗͢
ɾΠϯελϯεͷىಈGCPʹൺ͍ͯ ɾASΛ͏ͱҰʹىಈ/ऴྃ͢ΔΛઃఆͰ͖Δ ɾΠϯελϯεͷىಈAWSʹൺͯૣ͍ ɾASͰىಈ/ऴྃ͢Δͪ͜ΒͰઃఆͰ͖ͳ͍ ɾͨ͠ϗετ͋ͨΓ$18/ ɾΛ͑Δͱ1͋ͨΓ$0.03/hr
AutoScaler͕ҰؾʹΠϯελϯεΛ૿ͯ͠ɺҰ ؾʹΠϯελϯεΛݮΒ͢ͱ͍͏ڍಈΛྑ͘͢Δ Datadog Agent͕ىಈͨ͠Πϯελϯε͕ܹ૿ GCPΛ͍࢝Ί͔ͯΒલ݄ͷྉۚͷ2ഒΛ͑Δྉ ͕ۚٻ͞ΕΔ "# αϙʔτʹ૬ஊͯ͠࠷దͳ՝ۚମܥΛఏҊͯ͠Β ͍ɺ$1000Ҏ্҆͘ͳͬͨ $
ΠϯελϯεͷಛੑͱࢹαʔϏεͷ՝ۚମܥ Λ͔ͬ͠ΓѲ͓ͯ͘͠ʂ
2. ϝτϦοΫૹ৴λΠϛϯά͕ఆͱҧ͏
Քಇ͍ͯ͠ΔΠϯελϯεͷ͕ ຖૹΒΕ͍ͯΔΑ͏ʹݟ͑Δ%
೦5ຖͰͨ͠ʂ& ΞϥʔτΛֻ͚ͯؾͮ͘ͷ͕5ޙ'
ϝτϦοΫͷૹ৴සΛѲ͓ͯ͘͠ʂ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1. σʔλΞϥʔτҰݩཧ͢Δ 2. υϦϧμϯͯ͠Λ͍͚ͬͯΔΑ͏ʹ͢Δ 3. ֤ϓϥοτϑΥʔϜͷಛੑͱɺࢹπʔϧͷ՝ۚ ମܥΛѲ͢Δ 4. ΠϯςάϨʔγϣϯϝτϦοΫͷૹ৴සΛѲ ͢Δ
ࠓޙ
1. DatadogʹΞϥʔτΛ·ͱΊΔ 2. Datadog͕SPOFʹͳ͍ͬͯΔ݅Λ࠶ݕ౼͢Δ 3. ࢹઃఆͷexportΛ͍ͨ͠
ΤϯδχΞืूதͰ͢ʂ