Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Map & Territory: A story of visibility
Search
Pierre-Yves Ritschard
April 19, 2013
Technology
1
1.2k
Map & Territory: A story of visibility
Pierre-Yves Ritschard
April 19, 2013
Tweet
Share
More Decks by Pierre-Yves Ritschard
See All by Pierre-Yves Ritschard
Meetup Camptocamp: Exoscale SKS
pyr
0
290
The (long) road to Kubernetes
pyr
0
260
From vertical to horizontal: The challenges of scalability in the cloud
pyr
0
51
Change Management at Scale
pyr
0
77
5 years of Clojure
pyr
2
950
Taming Jenkins
pyr
0
24
Init: then and now
pyr
1
160
Billing the Cloud
pyr
0
270
From Vertical to Horizontal
pyr
2
130
Other Decks in Technology
See All in Technology
プロダクト開発ゼロイチの分類とロジックス事業がイチに至るまで
niwatakeru
0
100
スクラムマスター不在でスクラムをやるのは(とても辛いので)やめておけ! #scrumfukuoka
nulabinc
PRO
4
910
App Runnerでパラメーターストアの値を使ってみた
miura55
0
230
ECS on FargateへのSeekable OCI導入レポート
iwamot
0
260
GitHub composite actions
hkusu
1
120
「わたしたちのコード」を安定させるためにフレームワークとの距離を保つ / phperkaigi2024
blue_goheimochi
5
810
【OpsJAWS】EC2 のセキュリティの運用と監視について考えてみた件
hssh2_bin
4
600
[2024년 3월 세미나] 다른 회사는 퍼널 분석 어떻게 하고 있을까?
datarian
1
1.6k
How to Build a Strong Engineering Culture
alperhankendi
0
120
進化する事業とデータ構造 ~Cloudbaseの場合~
tockn
2
230
出張! #DevelopersIO IT技術ブログの中の人が語る勉強会 「【速報】AWSの生成AIサービスであるAmazon Bedrock がリリースされたので朝イチで触ってみた」について語る
oshanqq
0
290
庁舎DX推進事例集
senryakuka
0
1.7k
Featured
See All Featured
GitHub's CSS Performance
jonrohan
1023
450k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
28
5.9k
Building a Modern Day E-commerce SEO Strategy
aleyda
15
6.3k
Learning to Love Humans: Emotional Interface Design
aarron
266
39k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
19
1.6k
Building Effective Engineering Teams - LeadDev
addyosmani
25
1.6k
Documentation Writing (for coders)
carmenintech
59
3.7k
Creatively Recalculating Your Daily Design Routine
revolveconf
209
11k
Done Done
chrislema
178
15k
10 Git Anti Patterns You Should be Aware of
lemiorhan
644
57k
Unsuck your backbone
ammeep
660
56k
YesSQL, Process and Tooling at Scale
rocio
160
13k
Transcript
Map & Territory a story of visibility
Pierre-Yves @pyr https://github.com/pyr
https://exoscale.ch
Visibility
How do we work ?
None
How do we improve?
Avoid Shortcuts!
None
We want lower defect rates
We want to make informed decisions
Design Build Live
Visibility
Extracting meaningful state data from heterogeneous event sources, over time
Meaningful (relates to business value)
State Data (structured payload)
Heterogeneous (everyone is involved)
Over time (tracking)
How does it help my system's lifecycle ?
Map =/= Territory
Break out of our mental model
"I'll push this minor change, it cannot do any harm"
None
"I'll just add this static route"
None
Better lifecycle Informed decisions Better maps
Systems are (increasingly) complex
Web Infrastructure circa 00 (2 servers)
Visibility Circa '00
Web Infrastructure circa '12 (27 nodes)
None
Visibility Circa '12
Q: how is business doing today ? A:
Q: how is business doing today ? A: based on
these key metrics we're looking good
Figure out those key metrics
We need appropriate tooling
events across: system, components, software
The event stream approach
Plenty of small producers Few big consumers
Production: Anything that happens or moves (logs too!): Normalize &
Stream
Consumption: Aggregate Correlate Decide
Aggregation compute compound metrics (ratios, sums)
Correlation
Decision track, alert, ignore, scale
Implementing on premise, saas or in between ?
SaaS loggly, papertrail, librato, datadog, ...
On Premise collectd, logstash, graphite, statsd, riemann
The path to visibility: Find key metrics Find the right
tools Rely on an event stream Involve everyone Challenge your mental model Hopefully, improve quality and lower defect rates in the process!
Questions ?