Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Tech Exeter Conference: Monitoring in a scalabl...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Jacob Tomlinson Jacob Tomlinson
October 08, 2016
Technology
24
0

Tech Exeter Conference: Monitoring in a scalable world

Slides from the TechExeter Conference, 8th October 2016.

Avatar for Jacob Tomlinson

Jacob Tomlinson

October 08, 2016

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
Documenting your open source projects for machines
Avatar for Jacob Tomlinson jacobtomlinson
0
38
EffVer - Version your code by the effort required to upgrade
Avatar for Jacob Tomlinson jacobtomlinson
0
120
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
110
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
150
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
140
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
430
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
130
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
130
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
160

Other Decks in Technology

See All in Technology
社内の7割が使うデータ基盤を、 データチーム2人で回すためにやったこと
Avatar for KOH koh_yoshi
4
1.4k
Genie Codeハンズオン基礎編
Avatar for Takaaki Yayoi taka_aki
1
120
強化学習「理論」入門
Avatar for Etsuji Nakai enakai00
3
3.6k
Goでデータパイプラインを作ろう
Avatar for SansanTech sansantech
PRO
1
470
Breaking the Seal: Static Deobfuscation of Compiled V8 JavaScript Bytecode Malware
Avatar for hasherezade hshrzd
0
810
MulticaとPi Coding Agentで、小規模OSSを30本同時運用した流れ
Avatar for eiei114 eiei114
0
130
Data Hubグループ 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
0
3.2k
サイバー捜査員研修（前半）
Avatar for Nomizo Nomizo nomizone
1
2k
AI-DLC実践録_フルサイクル開発への挑戦
Avatar for Miyuki miyuc
0
150
Bits AI を制するものは Datadog を制す / The player that controls  Bits AI, controls Datadog
Avatar for 株式会社カミナシ kaminashi
0
110
Digitization部 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
2
7.7k
MIRU 2026 チュートリアル
Avatar for Keisuke Fujii keisuke198619
0
940

Featured

See All Featured
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.7k
AI Search:
Where Are We & What Can We Do About It?
Avatar for Aleyda Solis aleyda
0
7.8k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
240
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
300
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
56k
Kristin Tynski - Automating Marketing Tasks With AI
Avatar for Tech SEO Connect techseoconnect
PRO
0
470
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
230
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
274
21k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
163
24k
Claude Code のすすめ
Avatar for schroneko schroneko
67
230k
SEO Brein meetup: CTRL+C is not how to scale international SEO
Avatar for Linda Hogenes lindahogenes
1
2.8k
Believing is Seeing
Avatar for Spiro Bolos oripsolob
1
190

Transcript

  1. Monitoring in a Scalable World Jacob Tomlinson Senior Solutions Engineer

  2. Agenda • The Informatics Lab (10 mins) • What makes

    a monitoring system ? (10 mins) • Overview of technologies (10 mins) • Making it scale (10 mins) • Questions (10 mins)
  3. None

  4. Demystify Buzzwords

  5. Prototypes www.informaticslab.co.uk

  6. None
  7. None
  8. None

  9. What is a monitoring system?

  10. None
  11. None
  12. None

  13. Logs vs Telemetry

  14. Twelve-Factor App XI. Logs Treat logs as event streams 12factor.net

  15. None

  16. Components

  17. Collection

  18. Storage

  19. Aggregation & Dashboards

  20. Alerting

  21. Monitoring technologies

  22. Managed services

  23. None
  24. None

  25. Telegraf cAdvisor Filebeat Telegraf cAdvisor Filebeat NGINX Grafana Kibana InfluxDB

    ElasticSearch Logstash Telegraf cAdvisor Filebeat Lab Monitoring Stack v1 Kapacitor

  26. Scaling

  27. Scalability vs Availability

  28. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  29. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  30. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Kapacitor Logstash

  31. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Logstash NGINX Grafana Kibana

  32. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash cAdvisor Filebeat Lab Monitoring

    Stack v2 Kapacitor Telegraf ELB PostgreSQL

  33. Questions Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson inlb.co/tech-exeter-2016