Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Tech Exeter Conference: Monitoring in a scalabl...

Avatar for Jacob Tomlinson Jacob Tomlinson
October 08, 2016
Technology
27
0

Tech Exeter Conference: Monitoring in a scalable world

Slides from the TechExeter Conference, 8th October 2016.

Avatar for Jacob Tomlinson

Jacob Tomlinson

October 08, 2016

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
Documenting your open source projects for machines
Avatar for Jacob Tomlinson jacobtomlinson
0
55
EffVer - Version your code by the effort required to upgrade
Avatar for Jacob Tomlinson jacobtomlinson
0
160
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
120
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
180
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
160
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
540
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
150
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
150
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
180

Other Decks in Technology

See All in Technology
しろおびから始める！ログ活用の第一歩
Avatar for Shumei Ito shumei_ito
0
960
AIにシークレットを見せない、WSL2で安全な開発環境
Avatar for yazm4 yazm
0
310
Metadata - Section 1: HTML Basics
Avatar for mohab soliman mohab1
0
120
JAWSUG TOHOKU 青森支部 「LoGoチャット」のAWS移行で 乗り越えたこと
Avatar for たけだ taketakekaho
0
350
hackers_champloo_2026_tidb
Avatar for makocchi makocchi
0
170
LambdaWebFunctionsを試してみた / exploring-lambda-web-functions
Avatar for koukihosaka koukihosaka
1
360
『SAR衛星データ解析入門』の ご紹介とその応用
Avatar for じゃらしまる syuchimu
0
120
ストレスなくAIと付き合いたい！こんなときどうしてる？
Avatar for Nami Kimura namiki64
4
620
実践！ SRE × AI - ABEMA における AIOps -
Avatar for tetsuya28 tetsuya28
8
3.1k
Code for Security プロジェクト紹介 2026年10月
Avatar for Yuki Kawabe yu23ki14
0
110
触りたくないデータに、どう触るか AI時代のRBACアクセスガバナンス
Avatar for 株式会社IVRy（社員登壇資料） ivry_presentationmaterials
0
280
スキマバイトという雇用形態は存在しないので、雇用期間1日のアルバイト契約を事業者とワーカーが結ぶ手続きを支えるのがタイミーなんです
Avatar for しが あきとし(akitoshiga) akitoshiga
0
210

Featured

See All Featured
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
220
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
75
12k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
123
22k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
7k
Claude Code どこまでも/ Claude Code Everywhere
Avatar for nwiizo nwiizo
68
59k
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
500
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
69
67k
How to Talk to Developers About Accessibility
Avatar for Jason CranfordTeague jct
2
580
A brief & incomplete history of 
UX Design for the World Wide Web: 1989–2019
Avatar for Jason CranfordTeague jct
2
540
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
56
3.5k
The Limits of Empathy - UXLibs8
Avatar for Cassini Nazir cassininazir
2
720
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
35
2.6k

Transcript

  1. Monitoring in a Scalable World Jacob Tomlinson Senior Solutions Engineer

  2. Agenda • The Informatics Lab (10 mins) • What makes

    a monitoring system ? (10 mins) • Overview of technologies (10 mins) • Making it scale (10 mins) • Questions (10 mins)
  3. None

  4. Demystify Buzzwords

  5. Prototypes www.informaticslab.co.uk

  6. None
  7. None
  8. None

  9. What is a monitoring system?

  10. None
  11. None
  12. None

  13. Logs vs Telemetry

  14. Twelve-Factor App XI. Logs Treat logs as event streams 12factor.net

  15. None

  16. Components

  17. Collection

  18. Storage

  19. Aggregation & Dashboards

  20. Alerting

  21. Monitoring technologies

  22. Managed services

  23. None
  24. None

  25. Telegraf cAdvisor Filebeat Telegraf cAdvisor Filebeat NGINX Grafana Kibana InfluxDB

    ElasticSearch Logstash Telegraf cAdvisor Filebeat Lab Monitoring Stack v1 Kapacitor

  26. Scaling

  27. Scalability vs Availability

  28. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  29. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

  30. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Kapacitor Logstash

  31. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash Telegraf cAdvisor Filebeat Kapacitor

    Telegraf cAdvisor Filebeat InfluxDB ElasticSearch Logstash NGINX Grafana Kibana

  32. NGINX Grafana Kibana InfluxDB ElasticSearch Logstash cAdvisor Filebeat Lab Monitoring

    Stack v2 Kapacitor Telegraf ELB PostgreSQL

  33. Questions Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson inlb.co/tech-exeter-2016