Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Tech Exeter Conference: Monitoring in a scalabl...

Avatar for Jacob Tomlinson Jacob Tomlinson
October 08, 2016
Technology
0
15

Tech Exeter Conference: Monitoring in a scalable world

Slides from the TechExeter Conference, 8th October 2016.

Avatar for Jacob Tomlinson

Jacob Tomlinson

October 08, 2016
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
EffVer - Version your code by the effort required to upgrade
Avatar for Jacob Tomlinson jacobtomlinson
0
5
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
27
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
36
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
50
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
0
46
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
60
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
56
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
32
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
38

Other Decks in Technology

See All in Technology
開発と脆弱性と脆弱性診断についての話
Avatar for su3158 su3158
1
1.1k
RAID6 を楔形文字で組んで現代人を怖がらせましょう（実装編）
Avatar for mimifuwacc mimifuwa
0
290
Autonomous Database Serverless 技術詳細 / adb-s_technical_detail_jp
Avatar for oracle4engineer oracle4engineer
PRO
18
52k
マイクロモビリティシェアサービスを支える プラットフォームアーキテクチャ
Avatar for gr1m0h grimoh
1
180
第64回コンピュータビジョン勉強会@関東(後編)
Avatar for TSUKAMOTO Kenji tsukamotokenji
0
220
現場が抱える様々な問題は “組織設計上” の問題によって生じていることがある / Team-oriented Organization Design 20250827
Avatar for mtx2s mtx2s
1
200
PFEM Online Feature Flag @ newmo
Avatar for tobi shinyaishitobi
2
330
AIエージェント就活入門 - MCPが履歴書になる未来
Avatar for Ikko Eltociear Ashimine eltociear
0
250
datadog-distribution-of-opentelemetry-collector-intro
Avatar for tetsuya28 tetsuya28
0
240
プロジェクトマネジメントは不確実性との対話だ
Avatar for HisashiWatanabe hisashiwatanabe
0
200
2025新卒研修・Webアプリケーションセキュリティ #弁護士ドットコム
Avatar for 弁護士ドットコム bengo4com
3
10k
夏休みWebアプリパフォーマンス相談室/web-app-performance-on-radio
Avatar for Eiji Hachiya hachi_eiji
1
300

Featured

See All Featured
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
173
14k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
358
30k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
190
11k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
15
1.6k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
431
65k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
51k
KATA
Avatar for Megan Lloyd mclloyd
32
14k
The Language of Interfaces
Avatar for Des Traynor destraynor
160
25k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
248
1.3M
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
43
7.5k
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
2
580

Transcript

  1. Monitoring in a Scalable World Jacob Tomlinson Senior Solutions Engineer

  2. Agenda • The Informatics Lab (10 mins) • What makes

    a monitoring system ? (10 mins) • Overview of technologies (10 mins) • Making it scale (10 mins) • Questions (10 mins)
  3. None

  4. Demystify Buzzwords

  5. Prototypes www.informaticslab.co.uk

  6. None
  7. None
  8. None

  9. What is a monitoring system?

  10. None
  11. None
  12. None

  13. Logs vs Telemetry

  14. Twelve-Factor App XI. Logs Treat logs as event streams 12factor.net

  15. None

  16. Components

  17. Collection

  18. Storage

  19. Aggregation & Dashboards

  20. Alerting

  21. Monitoring technologies

  22. Managed services

  23. None
  24. None

  25. Telegraf cAdvisor Filebeat Telegraf cAdvisor Filebeat NGINX Grafana Kibana InfluxDB

    ElasticSearch Logstash Telegraf cAdvisor Filebeat Lab Monitoring Stack v1 Kapacitor

  26. Scaling

  27. Scalability vs Availability

  28. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  29. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  30. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Kapacitor Logstash

  31. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Logstash NGINX Grafana Kibana

  32. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash cAdvisor Filebeat Lab Monitoring

    Stack v2 Kapacitor Telegraf ELB PostgreSQL

  33. Questions Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson inlb.co/tech-exeter-2016