KubeCon EU 2020 Virtual - Introduction to Thanos

Transcript

1. @ThanosMetrics GiedriusS / stag1e metalmatze
12. @ThanosMetrics ◦ ◦ ◦ ◦
13. @ThanosMetrics ◦ ◦
14. @ThanosMetrics
15. @ThanosMetrics • • • • 1400 • • • • •
16. @ThanosMetrics
17. @ThanosMetrics
18. @ThanosMetrics
19. @ThanosMetrics
20. @ThanosMetrics
21. @ThanosMetrics
22. @ThanosMetrics /metrics # TYPE counter app_request_total 1337 # TYPE gauge app_request_in_flight 3 # TYPE histogram app_request_duration_bucket {le="0.005"} 500 app_request_duration_bucket {le="0.01"} 213
23. @ThanosMetrics Scrape Engine Rule + Alert Engine Query Engine Compactor Local Storage SVC 1 SVC 2 SVC 3 /metrics Alertmanager Grafana
24. @ThanosMetrics SVC 2 SVC 3 SVC 4 NODE 1 NODE 2 SVC 1
25. @ThanosMetrics SVC 2 SVC 3 SVC 4 NODE 1 NODE 2 SVC 1
26. @ThanosMetrics SVC 2 SVC 3 SVC 4 NODE 1 SVC 1 NODE 2
27. @ThanosMetrics NODE 1 Local Storage
28. @ThanosMetrics NODE 1 Local Storage
29. @ThanosMetrics Monitoring Cluster Cluster 1 Cluster 2 Cluster 3 /federate /federate /federate
30. @ThanosMetrics Monitoring Cluster Cluster 1 Cluster 2 Cluster 3 /federate /federate /federate
31. @ThanosMetrics Monitoring Cluster Cluster 1 Cluster 2 Cluster 3 /federate /federate /federate
32. @ThanosMetrics Monitoring Cluster /federate /federate /federate /federate ... Cluster 1 Cluster 2 Cluster 3 Cluster N
33. @ThanosMetrics
34. @ThanosMetrics Downsampling & Compaction Unlimited Retention Prometheus Compatible Global Query View
35. @ThanosMetrics Monitoring Cluster /federate /federate /federate Cluster 1 Cluster 2 Cluster 3
36. @ThanosMetrics Monitoring Cluster /query /query /query Cluster 1 Cluster 2 Cluster 3 ?
37. @ThanosMetrics Monitoring Cluster /query /query /query /query ... Cluster 1 Cluster 2 Cluster 3 Cluster N ?
38. @ThanosMetrics Monitoring Cluster Cluster 1 ... ? ? Cluster 2 ? Cluster N ? /query /query /query
39. @ThanosMetrics Monitoring Cluster Cluster 1 gRPC ... ? ? Cluster 2 gRPC ? Cluster N gRPC ?
40. @ThanosMetrics Monitoring Cluster Cluster 1 gRPC ... Cluster 2 gRPC Cluster N gRPC Query
41. @ThanosMetrics Thanos Deep Dive: Inside a Distributed Monitoring System KubeCon San Diego talk
42. @ThanosMetrics Monitoring Cluster Cluster 1 gRPC ... Cluster 2 gRPC Cluster N gRPC Query Query
43. @ThanosMetrics Monitoring Cluster Cluster 1 gRPC ... Cluster 2 Cluster N gRPC gRPC gRPC gRPC gRPC Query
44. @ThanosMetrics Monitoring Cluster Cluster 1 ... Cluster 2 Cluster N StoreAPI StoreAPI StoreAPI Query Query Query Query
45. @ThanosMetrics Monitoring Cluster Cluster 1 ... Cluster 2 Cluster N Query Query Query Query
46. @ThanosMetrics Monitoring Cluster Cluster 1 ... Cluster 2 Cluster N Object Storage Query TSDB blocks TSDB blocks Query Query Query
47. @ThanosMetrics Monitoring Cluster Cluster 1 ... Cluster 2 Cluster N Object Storage Query Store Query Query Query
48. @ThanosMetrics Monitoring Cluster Cluster 1 ... Query Cluster 2 Cluster N Object Storage Compact Store Query Query Query
49. @ThanosMetrics Monitoring Cluster Cluster 1 ... Query Cluster 2 Cluster N Object Storage Compact Store Query Query Query Object Storage Replicate
50. @ThanosMetrics Query Sidecar Store Compact Replicate
51. @ThanosMetrics Cluster 1 Cluster 2 Cluster 3 Monitoring Cluster Query ?
52. @ThanosMetrics Cluster 1 Cluster 2 Cluster 3 Monitoring Cluster Query ?
53. @ThanosMetrics Monitoring Cluster ... Cluster 1 Cluster 2 Cluster 3 Cluster N Query ?
54. @ThanosMetrics ? ? ? ? ? ?
55. @ThanosMetrics ? ? ? ? ? ?
56. @ThanosMetrics ? ? ? ? ? ? Monitoring Cluster ... Cluster 1 Cluster 2 Cluster 3 Cluster N Query
57. @ThanosMetrics ? ? ? ? ? ? ... Cluster 1 Cluster 2 Cluster 3 Cluster N Monitoring Cluster Object Storage Query Store
58. @ThanosMetrics ? ? ? ? ? ... Cluster 1 Cluster 2 Cluster 3 Cluster N Monitoring Cluster Object Storage Query Store Receive Ingesting Millions of Metrics with Thanos Receive - Lucas Today (13:00)
59. @ThanosMetrics ? ? ? ? ? ... Cluster 1 Cluster 2 Cluster 3 Cluster N Object Storage Query Store Receive Rule
60. @ThanosMetrics Query Receive Store Rule
61. @ThanosMetrics Scrape Engine Rule + Alert Engine Query Engine Compactor Local Storage Alertmanager Grafana SVC 1 SVC 2 SVC 3 /metrics
62. @ThanosMetrics Scrape Engine Rule + Alert Engine Compactor Local Storage Alertmanager SVC 1 SVC 2 SVC 3 /metrics Grafana Query
63. @ThanosMetrics Sidecar/Receive Compactor Object Storage Grafana Query SVC 1 SVC 2 SVC 3 /metrics Rule + Alert Engine Alertmanager
64. @ThanosMetrics Object Storage Compact/Store SVC 1 SVC 2 SVC 3 /metrics Sidecar/Receive Grafana Query Rule + Alert Engine Alertmanager
65. @ThanosMetrics Object Storage Compact/Store Rule Alertmanager SVC 1 SVC 2 SVC 3 /metrics Sidecar/Receive Grafana Query
66. @ThanosMetrics https://www.katacoda.com/thanos
67. @ThanosMetrics • ◦ • ◦ ◦ • • ◦
68. @ThanosMetrics • Started participating in various initiatives such as the Community Bridge mentorship program late last year • Increases diversity in open source communities and gets more open source code written and released for the benefit of all. • Lots of projects going on at the moment and some awesome stuff has been implemented already such as delayed deletions by Khyati Soneji
69. @ThanosMetrics
70. @ThanosMetrics