Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Tech Exeter Conference: Monitoring in a scalabl...

Jacob Tomlinson
October 08, 2016
Technology
0
13

Tech Exeter Conference: Monitoring in a scalable world

Slides from the TechExeter Conference, 8th October 2016.

Jacob Tomlinson

October 08, 2016
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
Who Builds the PyData Ecosystem?
jacobtomlinson
0
9
The Art of Wrangling Your GPU Python Environments
jacobtomlinson
0
9
Getting science done with accelerated Python computing platforms
jacobtomlinson
0
6
Dask on HPC in 2024 - Lightning Talk
jacobtomlinson
0
28
GPU Acceleration in the PyData community
jacobtomlinson
0
25
Dask on HPC in 2024
jacobtomlinson
0
6
GPU Acceleration in the PyData community
jacobtomlinson
0
4
When to rebuild things that already exist
jacobtomlinson
0
8
Accelerating Python on HPC with Dask and RAPIDS
jacobtomlinson
0
6

Other Decks in Technology

See All in Technology
[OpsJAWS Meetup33 AIOps] Amazon Bedrockガードレールで守る安全なAI運用
akiratameto
1
140
LayerXにおけるAI活用事例とその裏側（2025年2月） バクラクの目指す “業務の自動運転” の例 / layerx-ai-deim2025
yuya4
4
850
大規模アジャイルフレームワークから学ぶエンジニアマネジメントの本質
staka121
PRO
3
1.7k
30→150人のエンジニア組織拡大に伴うアジャイル文化を醸成する役割と取り組みの変化
nagata03
0
360
"TEAM"を導入したら最高のエンジニア"Team"を実現できた / Deploying "TEAM" and Building the Best Engineering "Team"
yuj1osm
1
240
マルチアカウント環境における組織ポリシーについて まとめてみる
nrinetcom
PRO
2
110
x86-64 Assembly Essentials
latte72
4
550
生成AI×財務経理：PoCで挑むSlack AI Bot開発と現場巻き込みのリアル
pohdccoe
1
820
株式会社Awarefy(アウェアファイ)会社説明資料 / Awarefy-Company-Deck
awarefy
3
12k
エンジニアのキャリアパスと、 その中で自分が大切にしていること
noteinc
3
370
20250307_エンジニアじゃないけどAzureはじめてみた
ponponmikankan
2
180
アジャイルな開発チームでテスト戦略の話は誰がする？ / Who Talks About Test Strategy?
ak1210
1
850

Featured

See All Featured
Understanding Cognitive Biases in Performance Measurement
bluesmoon
27
1.6k
VelocityConf: Rendering Performance Case Studies
addyosmani
328
24k
Reflections from 52 weeks, 52 projects
jeffersonlam
348
20k
What's in a price? How to price your products and services
michaelherold
244
12k
The Invisible Side of Design
smashingmag
299
50k
Bash Introduction
62gerente
611
210k
Faster Mobile Websites
deanohume
306
31k
Speed Design
sergeychernyshev
28
820
The Illustrated Children's Guide to Kubernetes
chrisshort
48
49k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
30
4.6k
Why Our Code Smells
bkeepers
PRO
336
57k
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k

Transcript

  1. Monitoring in a Scalable World Jacob Tomlinson Senior Solutions Engineer

  2. Agenda • The Informatics Lab (10 mins) • What makes

    a monitoring system ? (10 mins) • Overview of technologies (10 mins) • Making it scale (10 mins) • Questions (10 mins)
  3. None

  4. Demystify Buzzwords

  5. Prototypes www.informaticslab.co.uk

  6. None
  7. None
  8. None

  9. What is a monitoring system?

  10. None
  11. None
  12. None

  13. Logs vs Telemetry

  14. Twelve-Factor App XI. Logs Treat logs as event streams 12factor.net

  15. None

  16. Components

  17. Collection

  18. Storage

  19. Aggregation & Dashboards

  20. Alerting

  21. Monitoring technologies

  22. Managed services

  23. None
  24. None

  25. Telegraf cAdvisor Filebeat Telegraf cAdvisor Filebeat NGINX Grafana Kibana InfluxDB

    ElasticSearch Logstash Telegraf cAdvisor Filebeat Lab Monitoring Stack v1 Kapacitor

  26. Scaling

  27. Scalability vs Availability

  28. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  29. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  30. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Kapacitor Logstash

  31. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Logstash NGINX Grafana Kibana

  32. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash cAdvisor Filebeat Lab Monitoring

    Stack v2 Kapacitor Telegraf ELB PostgreSQL

  33. Questions Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson inlb.co/tech-exeter-2016