Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Instrumenting Application Stack in Dynamically ...
Search
Sponsored
·
SiteGround - Reliable hosting with speed, security, and support you can count on.
→
Mike Fiedler
November 15, 2013
Technology
75
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Instrumenting Application Stack in Dynamically Scaling Environment
DMG212 AWS re:Invent 2013
Mike Fiedler
November 15, 2013
Transcript
27 slides
Instrumenting your Application Stack in a Dynamically Scaling Environment Mike
Fiedler, Datadog November 15, 2013
The Past • Server uptime • Intertwined applications • SPOFs
The Present • SOA • Scale or Fail • Data-driven
decisions
Modern application stack User LB Web Data
Failure is inevitable
Design to tolerate failure
Things that produce metrics business/service Services • applicatio n •
OS • instances API-based • S3, S*S • RDS, RedShift • etc Users • RUM
The Desire
CPU comparison (hypervisor)
CPU comparison (Agent)
My Stack • HAProxy • Apache HTTP • Bottle.py –
Custom python webapp • MongoDB • EC2 • Chef • Datadog • Users
Tracking Database operations
Moving up the stack…
Even higher…
Using metadata for more flavor
Replace an instance, keep the metrics
Enter…
Aggregating numbers
Comparing numbers
My App from bottle import route import pymongo import json
db = pymongo.Connection('mongodb://localhost').test @route('/insert/:name') def insert(name): doc = {'name': name} db.words.update(doc, {"$inc":{"count": 1}}, upsert=True) return json.dumps(doc, default=default)
Add 2 lines and you win! from bottle import route
import pymongo import json from statsd import statsd db = pymongo.Connection('mongodb://localhost').test @route('/insert/:name') @statsd.increment('fullstack.insert') def insert(name): doc = {'name': name} db.words.update(doc, {"$inc":{"count": 1}}, upsert=True) return json.dumps(doc, default=default)
Profit!
Correlation
Don’t be caught unaware
None
Questions Time!
We are sincerely eager to hear your feedback on this
presentation and on re:Invent. Please fill out an evaluation form when you have a chance.
More Decks by Mike Fiedler
See All by Mike Fiedler
Fixing AWS with AWS
miketheman
1
150
HOW DO YOU KNOW iT'S WORKiNG
miketheman
0
130
Giving (and Taking) Back
miketheman
0
70
Where Do We Go From Here?
miketheman
0
180
What's In This Cookbook?
miketheman
0
63
Treating Your Infrastructure Like Garbage
miketheman
2
1.7k
MongoDB - Operations Best Practices
miketheman
1
140
MongoDB in the Cloud - Amazon Web Services
miketheman
3
130
Other Decks in Technology
See All in Technology
LLM 基盤と kagent v0 を全部 k8s に入れてみた / Deploy both LLM and kagent v0 in k8s
kota2and3kan
0
240
高品質と高スピードを支える品質のシフトレフトのアプローチ
goyoki
4
1.6k
文書画像からの情報抽出を行うエージェントを、軌跡の正解データ無しで作れるか
sansantech
PRO
2
200
速くなるほど、深く考える AI時代のQAに学ぶ
kobayashiyorimitsu
0
260
Agent Harnessはどう作る?事例から学ぶAI Agentの設計思想
sergicalsix
0
350
契約書SaaSにAIエージェントを組み込む
sansantech
PRO
0
190
目を覚ませ!僕らの認証情報が何者かに侵略されてるぞ
tkito
2
460
OpenTelemetryで変わった 新時代のCloudWatchメトリクス監視
tsukuboshi
0
440
Linuxネットワークスタック進化の軌跡: 過去10年の歩みと最新トレンド
orimanabu
4
750
設計手法を「道具」として使いこなすために
a_suenami
4
740
思考過程から秘密が漏れる:Amazon Bedrock上のKimi K3を5つの方法で攻めたら、25回中22回漏洩した話
yama3133
1
170
Gov-JAWS#9 統合監視機能のマネージドサービス化+AIによる障害時自動調査
fj_yoshimura_kosuke
0
210
Featured
See All Featured
Highjacked: Video Game Concept Design
rkendrick25
PRO
2
580
Become a Pro
speakerdeck
PRO
31
6.4k
Site-Speed That Sticks
csswizardry
13
1.6k
Building Better People: How to give real-time feedback that sticks.
wjessup
371
20k
Why You Should Never Use an ORM
jnunemaker
PRO
61
10k
WCS-LA-2024
lcolladotor
0
1k
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
inesmontani
PRO
3
3.8k
Building AI with AI
inesmontani
PRO
1
1.4k
Darren the Foodie - Storyboard
khoart
PRO
5
4.1k
We Have a Design System, Now What?
morganepeng
55
8.4k
Between Models and Reality
mayunak
4
590
Principles of Awesome APIs and How to Build Them.
keavy
128
18k