Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Map & Territory: A story of visibility
Search
Pierre-Yves Ritschard
April 19, 2013
Technology
1
1.2k
Map & Territory: A story of visibility
Pierre-Yves Ritschard
April 19, 2013
Tweet
Share
More Decks by Pierre-Yves Ritschard
See All by Pierre-Yves Ritschard
Meetup Camptocamp: Exoscale SKS
pyr
0
330
The (long) road to Kubernetes
pyr
0
270
From vertical to horizontal: The challenges of scalability in the cloud
pyr
0
53
Change Management at Scale
pyr
0
83
5 years of Clojure
pyr
2
970
Taming Jenkins
pyr
0
28
Init: then and now
pyr
1
160
Billing the Cloud
pyr
0
270
From Vertical to Horizontal
pyr
2
130
Other Decks in Technology
See All in Technology
クラウド利用者の「責任」をどう果たす?AWSセキュリティ対策のススメ #AWSSummit
hiashisan
0
280
ゆめみのアクセシビリティの現在地と今後
ryokatsuse
3
290
開発生産性をむしろ向上させる セキュリティパートナーの作り方 / Dev Productivity Con 2024
flatt_security
0
380
データベース研修 DB基礎【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
210
累計ダウンロード数1億8000万を超えるアプリケーションプラットフォームのレガシーシステム脱却とモダン化への道
kmitsuhashi
0
120
[I/O Extended Android 2024] What`s new in Android 2024
kyeongwan
0
220
Docker互換のセキュアなコンテナ実行環境「Podman」超入門
devops_vtj
6
3.2k
ペパボのオブザーバビリティ研修2024 説明資料
kesompochy
0
1.1k
大規模ドラレコデータ収集・機械学習基盤を支える AWS CDK 〜導入・運用事例紹介〜
pemugi
0
110
[NIKKEI Tech Talk] KDDI/KAG Scrum & Community for Engineering Training
curanosuke
2
220
AIアシスタントの活用で品質の向上と開発ワークフローのスピードアップ
nagix
1
210
頼られるのが大好きな 皆さんへ - 支援相手との期待の合わせ方、突き放し方 -/For_people_who_like_to_be_relied_on
naitosatoshi
1
290
Featured
See All Featured
Rebuilding a faster, lazier Slack
samanthasiow
78
8.5k
Designing for Performance
lara
604
67k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
36
9.1k
How GitHub (no longer) Works
holman
305
140k
Why You Should Never Use an ORM
jnunemaker
PRO
51
8.9k
For a Future-Friendly Web
brad_frost
173
9.2k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
18
1.2k
Building a Scalable Design System with Sketch
lauravandoore
458
32k
The MySQL Ecosystem @ GitHub 2015
samlambert
248
12k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
228
16k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
44
4.7k
Product Roadmaps are Hard
iamctodd
PRO
48
10k
Transcript
Map & Territory a story of visibility
Pierre-Yves @pyr https://github.com/pyr
https://exoscale.ch
Visibility
How do we work ?
None
How do we improve?
Avoid Shortcuts!
None
We want lower defect rates
We want to make informed decisions
Design Build Live
Visibility
Extracting meaningful state data from heterogeneous event sources, over time
Meaningful (relates to business value)
State Data (structured payload)
Heterogeneous (everyone is involved)
Over time (tracking)
How does it help my system's lifecycle ?
Map =/= Territory
Break out of our mental model
"I'll push this minor change, it cannot do any harm"
None
"I'll just add this static route"
None
Better lifecycle Informed decisions Better maps
Systems are (increasingly) complex
Web Infrastructure circa 00 (2 servers)
Visibility Circa '00
Web Infrastructure circa '12 (27 nodes)
None
Visibility Circa '12
Q: how is business doing today ? A:
Q: how is business doing today ? A: based on
these key metrics we're looking good
Figure out those key metrics
We need appropriate tooling
events across: system, components, software
The event stream approach
Plenty of small producers Few big consumers
Production: Anything that happens or moves (logs too!): Normalize &
Stream
Consumption: Aggregate Correlate Decide
Aggregation compute compound metrics (ratios, sums)
Correlation
Decision track, alert, ignore, scale
Implementing on premise, saas or in between ?
SaaS loggly, papertrail, librato, datadog, ...
On Premise collectd, logstash, graphite, statsd, riemann
The path to visibility: Find key metrics Find the right
tools Rely on an event stream Involve everyone Challenge your mental model Hopefully, improve quality and lower defect rates in the process!
Questions ?