Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Map & Territory: A story of visibility
Search
Pierre-Yves Ritschard
April 19, 2013
Technology
1
1.2k
Map & Territory: A story of visibility
Pierre-Yves Ritschard
April 19, 2013
Tweet
Share
More Decks by Pierre-Yves Ritschard
See All by Pierre-Yves Ritschard
Meetup Camptocamp: Exoscale SKS
pyr
0
300
The (long) road to Kubernetes
pyr
0
260
From vertical to horizontal: The challenges of scalability in the cloud
pyr
0
51
Change Management at Scale
pyr
0
80
5 years of Clojure
pyr
2
960
Taming Jenkins
pyr
0
24
Init: then and now
pyr
1
160
Billing the Cloud
pyr
0
270
From Vertical to Horizontal
pyr
2
130
Other Decks in Technology
See All in Technology
Cloud Native Java with Spring Boot (CNCF Aarhus, April 2024)
thomasvitale
1
170
SIEMを用いて、セキュリティログ分析の可視化と分析を実現し、PDCAサイクルを回してみた
coconala_engineer
0
320
Vertex AI を中心に 生成AIのアップデートを共有します
kaz1437
0
310
ゼロから始めるVue.jsコミュニティ貢献 / first-vuejs-community-contribution-link-and-motivation
lmi
1
130
Janus
bkuhlmann
1
490
On Your Data を超えていく!
hirotomotaguchi
2
690
ExaDB-D dbaascli で出来ること
oracle4engineer
PRO
0
2.1k
Meta Quest 3 で動く桜マシマシ WebXR アプリを IBM Cloud Code Engine と Babylon.js で作った話
1ftseabass
PRO
0
120
障害対応をちょっとずつよくしていくための 演習の作りかた
heleeen
0
220
ChatGPT for IT Service Management (IT Pro)
dahatake
7
1.6k
一生覚えておきたい「システム開発=コミュニケーション」〜初めての実務案件振り返りLT〜
maimyyym
0
140
IaCジェネレーターとBedrockで詳細設計書を生成してみた
tsukasa_ishimaru
1
230
Featured
See All Featured
5 minutes of I Can Smell Your CMS
philhawksworth
199
19k
Mobile First: as difficult as doing things right
swwweet
216
8.6k
What’s in a name? Adding method to the madness
productmarketing
PRO
16
2.6k
Documentation Writing (for coders)
carmenintech
60
3.9k
A Tale of Four Properties
chriscoyier
151
22k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
14
1.5k
Clear Off the Table
cherdarchuk
84
310k
Debugging Ruby Performance
tmm1
70
11k
Reflections from 52 weeks, 52 projects
jeffersonlam
345
19k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
116
18k
The Mythical Team-Month
searls
216
42k
GraphQLの誤解/rethinking-graphql
sonatard
50
9.2k
Transcript
Map & Territory a story of visibility
Pierre-Yves @pyr https://github.com/pyr
https://exoscale.ch
Visibility
How do we work ?
None
How do we improve?
Avoid Shortcuts!
None
We want lower defect rates
We want to make informed decisions
Design Build Live
Visibility
Extracting meaningful state data from heterogeneous event sources, over time
Meaningful (relates to business value)
State Data (structured payload)
Heterogeneous (everyone is involved)
Over time (tracking)
How does it help my system's lifecycle ?
Map =/= Territory
Break out of our mental model
"I'll push this minor change, it cannot do any harm"
None
"I'll just add this static route"
None
Better lifecycle Informed decisions Better maps
Systems are (increasingly) complex
Web Infrastructure circa 00 (2 servers)
Visibility Circa '00
Web Infrastructure circa '12 (27 nodes)
None
Visibility Circa '12
Q: how is business doing today ? A:
Q: how is business doing today ? A: based on
these key metrics we're looking good
Figure out those key metrics
We need appropriate tooling
events across: system, components, software
The event stream approach
Plenty of small producers Few big consumers
Production: Anything that happens or moves (logs too!): Normalize &
Stream
Consumption: Aggregate Correlate Decide
Aggregation compute compound metrics (ratios, sums)
Correlation
Decision track, alert, ignore, scale
Implementing on premise, saas or in between ?
SaaS loggly, papertrail, librato, datadog, ...
On Premise collectd, logstash, graphite, statsd, riemann
The path to visibility: Find key metrics Find the right
tools Rely on an event stream Involve everyone Challenge your mental model Hopefully, improve quality and lower defect rates in the process!
Questions ?