Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Tech Exeter Conference: Monitoring in a scalabl...

Avatar for Jacob Tomlinson Jacob Tomlinson
October 08, 2016
Technology
0
15

Tech Exeter Conference: Monitoring in a scalable world

Slides from the TechExeter Conference, 8th October 2016.

Avatar for Jacob Tomlinson

Jacob Tomlinson

October 08, 2016
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
17
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
29
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
43
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
0
36
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
52
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
49
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
26
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
29
When to rebuild things that already exist
Avatar for Jacob Tomlinson jacobtomlinson
0
33

Other Decks in Technology

See All in Technology
衛星運用をソフトウェアエンジニアに依頼したときにできあがるもの
Avatar for Takahiro Miyoshi sankichi92
1
130
AWS CDK 開発を成功に導くトラブルシューティングガイド
Avatar for Ryota Nakajima wandora58
2
120
関数型プログラミングで 「脳がバグる」を乗り越える
Avatar for manabeai manabeai
2
200
ABEMAの本番環境負荷試験への挑戦
Avatar for Miyazaki Taiga mk2taiga
3
240
Delta airlines Customer®️ USA Contact Numbers: Complete 2025 Support Guide
Avatar for michal deltahelp
0
880
対話型音声AIアプリケーションの信頼性向上の取り組み
Avatar for 株式会社IVRy（社員登壇資料） ivry_presentationmaterials
1
330
United Airlines Customer Service– Call 1-833-341-3142 Now!
Avatar for vivankilkenny548+imnfc airhelp
0
170
CDKコード品質UP！ナイスな自作コンストラクタを作るための便利インターフェース
Avatar for Haruka Sakihara harukasakihara
1
110
CDKTFについてざっくり理解する！！～CloudFormationからCDKTFへ変換するツールも作ってみた～
Avatar for モブエンジニア masakiokuda
1
180
クラウド開発の舞台裏とSRE文化の醸成 / SRE NEXT 2025 Lunch Session
Avatar for kazeburo kazeburo
1
270
Getting to Know Your Legacy (System) with AI-Driven Software Archeology (WeAreDevelopers World Congress 2025)
Avatar for Markus Harrer feststelltaste
1
160
IPA&AWSダブル全冠が明かす、人生を変えた勉強法のすべて
Avatar for iwamot iwamot
PRO
2
190

Featured

See All Featured
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
31
8.7k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
367
19k
Facilitating Awesome Meetings
Avatar for Lara Hogan lara
54
6.4k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.3k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
126
53k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
1.9k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
Side Projects
Avatar for Sacha Greif sachag
455
42k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
43
7.6k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
138
34k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
695
190k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
507
140k

Transcript

  1. Monitoring in a Scalable World Jacob Tomlinson Senior Solutions Engineer

  2. Agenda • The Informatics Lab (10 mins) • What makes

    a monitoring system ? (10 mins) • Overview of technologies (10 mins) • Making it scale (10 mins) • Questions (10 mins)
  3. None

  4. Demystify Buzzwords

  5. Prototypes www.informaticslab.co.uk

  6. None
  7. None
  8. None

  9. What is a monitoring system?

  10. None
  11. None
  12. None

  13. Logs vs Telemetry

  14. Twelve-Factor App XI. Logs Treat logs as event streams 12factor.net

  15. None

  16. Components

  17. Collection

  18. Storage

  19. Aggregation & Dashboards

  20. Alerting

  21. Monitoring technologies

  22. Managed services

  23. None
  24. None

  25. Telegraf cAdvisor Filebeat Telegraf cAdvisor Filebeat NGINX Grafana Kibana InfluxDB

    ElasticSearch Logstash Telegraf cAdvisor Filebeat Lab Monitoring Stack v1 Kapacitor

  26. Scaling

  27. Scalability vs Availability

  28. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  29. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  30. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Kapacitor Logstash

  31. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Logstash NGINX Grafana Kibana

  32. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash cAdvisor Filebeat Lab Monitoring

    Stack v2 Kapacitor Telegraf ELB PostgreSQL

  33. Questions Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson inlb.co/tech-exeter-2016