Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Map & Territory: A story of visibility

2fcc875f98607b3007909fe4be99160d?s=47 Pierre-Yves Ritschard
April 19, 2013
Technology
1
1.1k

Map & Territory: A story of visibility

2fcc875f98607b3007909fe4be99160d?s=128

Pierre-Yves Ritschard

April 19, 2013
Tweet

More Decks by Pierre-Yves Ritschard

See All by Pierre-Yves Ritschard
2fcc875f98607b3007909fe4be99160d?s=48 pyr
0
220
2fcc875f98607b3007909fe4be99160d?s=48 pyr
0
30
2fcc875f98607b3007909fe4be99160d?s=48 pyr
0
55
2fcc875f98607b3007909fe4be99160d?s=48 pyr
2
910
2fcc875f98607b3007909fe4be99160d?s=48 pyr
0
9
2fcc875f98607b3007909fe4be99160d?s=48 pyr
1
140
2fcc875f98607b3007909fe4be99160d?s=48 pyr
0
240
2fcc875f98607b3007909fe4be99160d?s=48 pyr
2
110
2fcc875f98607b3007909fe4be99160d?s=48 pyr
7
1.7k

Other Decks in Technology

See All in Technology
Fb025419ed38f98df595eb2eafc859f4?s=48 ihcomega56
1
600
0e8fbeb3dc2da3e502483edea80be7d6?s=48 htomine
0
170
Ad2155c75c67c0100dd008ad10858de5?s=48 legalforce
PRO
4
320
9e014a8c38462fcaf2c136e65837b348?s=48 free_world21
0
110
6b6fab5155ec52293778ed7b64ab377f?s=48 kkosukeee
0
170
23f4d5d797a91b6d17d627b90b5a42d9?s=48 kentaro
1
680
24312cfba087ce175856b94b0829a3a9?s=48 uzabase_saas_product
0
100
E97091ac0d2c69ce9f9e8a8d0a2ea066?s=48 torisoup
11
6.2k
F73ac5e3ccf3d4dbfffff61b14d2335c?s=48 pakio
0
140
8a84268593355816432ceaf78777d585?s=48 dena_tech
15
3.4k
2795514d0184c363832fd7591caaf3f5?s=48 armaniacs
0
250
7ff130a0c1a4966472a4bdfaaf05e791?s=48 chandi
0
150

Featured

See All Featured
651dcfe41723207fbb0aa044a4f7c07f?s=48 dotmariusz
94
5.5k
7653c7c449918ff6542880a8c284f5e7?s=48 jponch
103
5.1k
Aebc2d07a50011e2a30d38435fde564a?s=48 jrom
116
7.2k
B83d5b590577969ee79a5ad845411a7d?s=48 ammeep
656
54k
1b75d89772b7eea1f6c89fbf362607d9?s=48 moore
125
21k
9375a9529679f1b42b567a640d775e7d?s=48 schacon
145
6.6k
C1daf20e5c49ff910745198ef9869ac2?s=48 hatefulcrawdad
257
17k
E76911cbe088e5b850d966de3fc7435b?s=48 robhawkes
52
2.8k
44b54d2ffcb7857004071cc6795dde11?s=48 cassininazir
347
20k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
31
3.4k
5f50f94346fbcb23706f0707169317a4?s=48 aarron
257
36k
F716e5f737fcfb03f2cf8d1a184f1dbe?s=48 nonsquared
81
3.4k

Transcript

  1. Map & Territory a story of visibility

  2. Pierre-Yves @pyr https://github.com/pyr

  3. https://exoscale.ch

  4. Visibility

  5. How do we work ?

  6. None

  7. How do we improve?

  8. Avoid Shortcuts!

  9. None

  10. We want lower defect rates

  11. We want to make informed decisions

  12. Design Build Live

  13. Visibility

  14. Extracting meaningful state data from heterogeneous event sources, over time

  15. Meaningful (relates to business value)

  16. State Data (structured payload)

  17. Heterogeneous (everyone is involved)

  18. Over time (tracking)

  19. How does it help my system's lifecycle ?

  20. Map =/= Territory

  21. Break out of our mental model

  22. "I'll push this minor change, it cannot do any harm"

  23. None

  24. "I'll just add this static route"

  25. None

  26. Better lifecycle Informed decisions Better maps

  27. Systems are (increasingly) complex

  28. Web Infrastructure circa 00 (2 servers)

  29. Visibility Circa '00

  30. Web Infrastructure circa '12 (27 nodes)

  31. None

  32. Visibility Circa '12

  33. Q: how is business doing today ? A:

  34. Q: how is business doing today ? A: based on

    these key metrics we're looking good

  35. Figure out those key metrics

  36. We need appropriate tooling

  37. events across: system, components, software

  38. The event stream approach

  39. Plenty of small producers Few big consumers

  40. Production: Anything that happens or moves (logs too!): Normalize &

    Stream

  41. Consumption: Aggregate Correlate Decide

  42. Aggregation compute compound metrics (ratios, sums)

  43. Correlation

  44. Decision track, alert, ignore, scale

  45. Implementing on premise, saas or in between ?

  46. SaaS loggly, papertrail, librato, datadog, ...

  47. On Premise collectd, logstash, graphite, statsd, riemann

  48. The path to visibility: Find key metrics Find the right

    tools Rely on an event stream Involve everyone Challenge your mental model Hopefully, improve quality and lower defect rates in the process!

  49. Questions ?