Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platfo...
Search
Daiki Matsui
January 20, 2017
Technology
2
15k
KARTE を支えるマルチプラットフォームインフラ監視 /karte-multi-platform-monitoring
【freee × プレイド】Tech Meetup 〜インフラ監視編〜
Daiki Matsui
January 20, 2017
Tweet
Share
More Decks by Daiki Matsui
See All by Daiki Matsui
The Fourth Age of SRE
ikemonn
0
210
マルチクラウドな大規模サービスKARTEを支えるDatadog/multi-cloud monitoring with Datadog
ikemonn
0
2.3k
Multicloud deploy with Spinnaker / builderscon tokyo 2018
ikemonn
2
4.4k
Node Apps Performance Tuning
ikemonn
0
130
Other Decks in Technology
See All in Technology
CAMERA-Suite: 広告文生成のための評価スイート / ai-camera-suite
cyberagentdevelopers
PRO
3
260
フルカイテン株式会社 採用資料
fullkaiten
0
36k
なんで、私がAWS Heroに!? 〜社外の広い世界に一歩踏み出そう〜
minorun365
PRO
6
1.1k
いまならこう作りたい AWSコンテナ[本格]入門ハンズオン 〜2024年版 ハンズオンの構想〜
horsewin
9
2k
Vueで Webコンポーネントを作って Reactで使う / 20241030-cloudsign-vuefes_after_night
bengo4com
4
2.5k
初心者に Vue.js を 教えるには
tsukuha
5
380
GitHub Universe: Evaluating RAG apps in GitHub Actions
pamelafox
0
170
【若手エンジニア応援LT会】AWSで繋がり、共に成長! ~コミュニティ活動と新人教育への挑戦~
kazushi_ohata
0
170
ネット広告に未来はあるか?「3rd Party Cookie廃止とPrivacy Sandboxの効果検証の裏側」 / third-party-cookie-privacy
cyberagentdevelopers
PRO
1
120
Oracle Base Database Service 技術詳細
oracle4engineer
PRO
5
49k
visionOSでの空間表現実装とImmersive Video表示について / ai-immersive-visionos
cyberagentdevelopers
PRO
1
100
カメラを用いた店内計測におけるオプトインの仕組みの実現 / ai-optin-camera
cyberagentdevelopers
PRO
1
120
Featured
See All Featured
Rails Girls Zürich Keynote
gr2m
93
13k
Fireside Chat
paigeccino
32
3k
Building a Scalable Design System with Sketch
lauravandoore
459
33k
Done Done
chrislema
181
16k
How STYLIGHT went responsive
nonsquared
95
5.2k
GraphQLの誤解/rethinking-graphql
sonatard
66
9.9k
Building Better People: How to give real-time feedback that sticks.
wjessup
363
19k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
159
15k
Build The Right Thing And Hit Your Dates
maggiecrowley
32
2.4k
Product Roadmaps are Hard
iamctodd
PRO
48
10k
Designing for humans not robots
tammielis
249
25k
No one is an island. Learnings from fostering a developers community.
thoeni
19
3k
Transcript
KARTEΛࢧ͑Δ ϚϧνϓϥοτϑΥʔϜΠϯϑϥࢹ @ikemonn
@ikemonn ΠϯϑϥΤϯδχΞ 201511݄ʹjoin
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
Σϒ٬ϓϥοτϑΥʔϜ KARTEΛ։ൃ͍ͯ͠·͢
ΠϯϑϥΤϯδχΞ2ਓ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ʮશһͰյ͠ͳ͕ΒਐΉʯ ͱ͍͏จԽΛࢧ͑Δ
Startup։ൃεϐʔυ͕ॏཁ
৽͍͠αʔϏεɺݴޠΛੵۃతʹ ಋೖͰ͖ΔΑ͏ʹ
ރΕٕͨज़Ͱͳ͍ͷͰɺ ใ͕͋·Γݟ͔ͭΒͳ͍
ଟগͷࣦഊڐ༰ & ࣦഊͨ࣌͠ʹ͙͢ؾ͚Δ
ʮશһͰյ͠ͳ͕ΒਐΉʯจԽΛ ࢧ͑ΔͨΊʹࢹͷڧԽ !
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ϚϧνϓϥοτϑΥʔϜ ৽͍͠αʔϏεͷੵۃར༻
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
ࢹํ๏
ผϓϥοτϑΥʔϜͷΠϯελϯε ಉ࢜ͷϝτϦοΫൺֱ͍ͨ͠ ֤ϓϥοτϑΥʔϜʹґଘͨ͠ϝτ ϦοΫૹ৴ͷίʔυΛॻ͖ͨ͘ͳ͍ ▪Πϯϑϥଆͷ՝ ▪ΞϓϦଆͷ՝
CloudWatch ৭ʑͳཧը໘Λݟͨ͘ͳ͍ http://www.irasutoya.com/2016/06/blog-post_147.html https://support.draw.io/pages/viewpage.action?pageId=1671326 https://en.wikipedia.org/wiki/File:Google_Stackdriver_logo.svg https://www.runscope.com/
جຊతʹDatadogͰҰݩཧ
ԿΛࢹ͢Δͷ͔ʁ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent https://www.datadoghq.com/ https://nz.pinterest.com/pin/296393219208794919/
https://bugsnag.com/ https://logdna.com/ https://www.pagerduty.com/resources/logo/
Πϯϑϥͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• CPU • Memory • Load Average • Disk Usage
• Disk I/O • Network I/O CloudWatch Datadog Agent
CloudWatch
None
ΞϓϦέʔγϣϯͷࢹ
σʔλͷૹ৴ݩ σʔλͷૹ৴ઌ ௨ઌ CloudWatch Datadog Agent library agent
• ղੳͨ͠Πϕϯτ(ࠓɺࡢɺҰिؒલɺ Ұϲ݄લ) • Ͳͷ͓٬༷͔ΒͷΠϕϯτ͕ଟ͍͔ • ղੳ༻ʹཷ·͍ͬͯΔΩϡʔͷ • λΠϜΞτͷׂ߹ •
֤ॲཧʹ͔͔͍ͬͯΔ࣌ؒ • ϨεϙϯελΠϜ • ΞϓϦέʔγϣϯͷόά • Τϥʔϩά
var dogstatsd = require('libs-dogstatsd') const stats = dogstatsd.start(); // some
method stats.tick(‘test’, 1, 1, [pid:1234]); libs-dogstatsd (A wrapper library of node-dogstatsd) ࣮ߦ࣌ؒॲཧճΛDatadogʹૹ৴Ͱ͖Δϥούʔ https://github.com/makinoy/libs-dogstatsd/
Ͳ͏ͬͯࢹ͍ͯ͠Δͷ͔ʁ
LayerΛ͚ͯDashboardΛ࡞
• Layer1: KARTE͕ੜ͖͍ͯΔ͔ • Layer2: ॏཁͳϝτϦοΫ • Layer3: ֤roleͷৄࡉϝτϦοΫ •
(Layer4: ΠϯελϯεຖͷϝτϦοΫ)
None
None
None
None
Ұݩཧ͢Δ͜ͱ υϦϧμϯͯ͠Λ͍͚ͬͯΔ͜ͱ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
جຊతʹΞϥʔτ DatadogͰҰݩཧ͢Δ
ϝτϦοΫ τϦΨʔ ௨ઌ MCM ᮢ ҟৗ ▪Πϯϑϥ
ϝτϦοΫ τϦΨʔ ௨ઌ ᮢ ҟৗ ▪ΞϓϦέʔγϣϯ ᮢ
ҟৗݕग़͕ศར
None
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1.ϞχλϦϯάπʔϧͷྉ͔͔ۚΓ͗͢
ɾΠϯελϯεͷىಈGCPʹൺ͍ͯ ɾASΛ͏ͱҰʹىಈ/ऴྃ͢ΔΛઃఆͰ͖Δ ɾΠϯελϯεͷىಈAWSʹൺͯૣ͍ ɾASͰىಈ/ऴྃ͢Δͪ͜ΒͰઃఆͰ͖ͳ͍ ɾͨ͠ϗετ͋ͨΓ$18/ ɾΛ͑Δͱ1͋ͨΓ$0.03/hr
AutoScaler͕ҰؾʹΠϯελϯεΛ૿ͯ͠ɺҰ ؾʹΠϯελϯεΛݮΒ͢ͱ͍͏ڍಈΛྑ͘͢Δ Datadog Agent͕ىಈͨ͠Πϯελϯε͕ܹ૿ GCPΛ͍࢝Ί͔ͯΒલ݄ͷྉۚͷ2ഒΛ͑Δྉ ͕ۚٻ͞ΕΔ "# αϙʔτʹ૬ஊͯ͠࠷దͳ՝ۚମܥΛఏҊͯ͠Β ͍ɺ$1000Ҏ্҆͘ͳͬͨ $
ΠϯελϯεͷಛੑͱࢹαʔϏεͷ՝ۚମܥ Λ͔ͬ͠ΓѲ͓ͯ͘͠ʂ
2. ϝτϦοΫૹ৴λΠϛϯά͕ఆͱҧ͏
Քಇ͍ͯ͠ΔΠϯελϯεͷ͕ ຖૹΒΕ͍ͯΔΑ͏ʹݟ͑Δ%
೦5ຖͰͨ͠ʂ& ΞϥʔτΛֻ͚ͯؾͮ͘ͷ͕5ޙ'
ϝτϦοΫͷૹ৴සΛѲ͓ͯ͘͠ʂ
࣍ 1. αʔϏεͷհ 2. ࢹͷత 3. Πϯϑϥߏ 4. ࢹͷํ๏ 5.
Ξϥʔτ 6. ϋϚͬͨ͜ͱ 7. ·ͱΊ
1. σʔλΞϥʔτҰݩཧ͢Δ 2. υϦϧμϯͯ͠Λ͍͚ͬͯΔΑ͏ʹ͢Δ 3. ֤ϓϥοτϑΥʔϜͷಛੑͱɺࢹπʔϧͷ՝ۚ ମܥΛѲ͢Δ 4. ΠϯςάϨʔγϣϯϝτϦοΫͷૹ৴සΛѲ ͢Δ
ࠓޙ
1. DatadogʹΞϥʔτΛ·ͱΊΔ 2. Datadog͕SPOFʹͳ͍ͬͯΔ݅Λ࠶ݕ౼͢Δ 3. ࢹઃఆͷexportΛ͍ͨ͠
ΤϯδχΞืूதͰ͢ʂ