Upgrade to Pro — share decks privately, control downloads, hide ads and more …

KubeCon EU 2020 Virtual - Introduction to Thanos

KubeCon EU 2020 Virtual - Introduction to Thanos

915d80f0d9b6678fad4d1ab36dfc8960?s=128

Matthias Loibl

August 19, 2020
Tweet

Transcript

  1. @ThanosMetrics GiedriusS / stag1e metalmatze

  2. None
  3. None
  4. None
  5. None
  6. None
  7. None
  8. None
  9. None
  10. None
  11. None
  12. @ThanosMetrics ◦ ◦ ◦ ◦

  13. @ThanosMetrics ◦ ◦

  14. @ThanosMetrics

  15. @ThanosMetrics • • • • 1400 • • • •

  16. @ThanosMetrics

  17. @ThanosMetrics

  18. @ThanosMetrics

  19. @ThanosMetrics

  20. @ThanosMetrics

  21. @ThanosMetrics

  22. @ThanosMetrics /metrics # TYPE counter app_request_total 1337 # TYPE gauge

    app_request_in_flight 3 # TYPE histogram app_request_duration_bucket {le="0.005"} 500 app_request_duration_bucket {le="0.01"} 213
  23. @ThanosMetrics Scrape Engine Rule + Alert Engine Query Engine Compactor

    Local Storage SVC 1 SVC 2 SVC 3 /metrics Alertmanager Grafana
  24. @ThanosMetrics SVC 2 SVC 3 SVC 4 NODE 1 NODE

    2 SVC 1
  25. @ThanosMetrics SVC 2 SVC 3 SVC 4 NODE 1 NODE

    2 SVC 1
  26. @ThanosMetrics SVC 2 SVC 3 SVC 4 NODE 1 SVC

    1 NODE 2
  27. @ThanosMetrics NODE 1 Local Storage

  28. @ThanosMetrics NODE 1 Local Storage

  29. @ThanosMetrics Monitoring Cluster Cluster 1 Cluster 2 Cluster 3 /federate

    /federate /federate
  30. @ThanosMetrics Monitoring Cluster Cluster 1 Cluster 2 Cluster 3 /federate

    /federate /federate
  31. @ThanosMetrics Monitoring Cluster Cluster 1 Cluster 2 Cluster 3 /federate

    /federate /federate
  32. @ThanosMetrics Monitoring Cluster /federate /federate /federate /federate ... Cluster 1

    Cluster 2 Cluster 3 Cluster N
  33. @ThanosMetrics

  34. @ThanosMetrics Downsampling & Compaction Unlimited Retention Prometheus Compatible Global Query

    View
  35. @ThanosMetrics Monitoring Cluster /federate /federate /federate Cluster 1 Cluster 2

    Cluster 3
  36. @ThanosMetrics Monitoring Cluster /query /query /query Cluster 1 Cluster 2

    Cluster 3 ?
  37. @ThanosMetrics Monitoring Cluster /query /query /query /query ... Cluster 1

    Cluster 2 Cluster 3 Cluster N ?
  38. @ThanosMetrics Monitoring Cluster Cluster 1 ... ? ? Cluster 2

    ? Cluster N ? /query /query /query
  39. @ThanosMetrics Monitoring Cluster Cluster 1 gRPC ... ? ? Cluster

    2 gRPC ? Cluster N gRPC ?
  40. @ThanosMetrics Monitoring Cluster Cluster 1 gRPC ... Cluster 2 gRPC

    Cluster N gRPC Query
  41. @ThanosMetrics Thanos Deep Dive: Inside a Distributed Monitoring System KubeCon

    San Diego talk
  42. @ThanosMetrics Monitoring Cluster Cluster 1 gRPC ... Cluster 2 gRPC

    Cluster N gRPC Query Query
  43. @ThanosMetrics Monitoring Cluster Cluster 1 gRPC ... Cluster 2 Cluster

    N gRPC gRPC gRPC gRPC gRPC Query
  44. @ThanosMetrics Monitoring Cluster Cluster 1 ... Cluster 2 Cluster N

    StoreAPI StoreAPI StoreAPI Query Query Query Query
  45. @ThanosMetrics Monitoring Cluster Cluster 1 ... Cluster 2 Cluster N

    Query Query Query Query
  46. @ThanosMetrics Monitoring Cluster Cluster 1 ... Cluster 2 Cluster N

    Object Storage Query TSDB blocks TSDB blocks Query Query Query
  47. @ThanosMetrics Monitoring Cluster Cluster 1 ... Cluster 2 Cluster N

    Object Storage Query Store Query Query Query
  48. @ThanosMetrics Monitoring Cluster Cluster 1 ... Query Cluster 2 Cluster

    N Object Storage Compact Store Query Query Query
  49. @ThanosMetrics Monitoring Cluster Cluster 1 ... Query Cluster 2 Cluster

    N Object Storage Compact Store Query Query Query Object Storage Replicate
  50. @ThanosMetrics Query Sidecar Store Compact Replicate

  51. @ThanosMetrics Cluster 1 Cluster 2 Cluster 3 Monitoring Cluster Query

    ?
  52. @ThanosMetrics Cluster 1 Cluster 2 Cluster 3 Monitoring Cluster Query

    ?
  53. @ThanosMetrics Monitoring Cluster ... Cluster 1 Cluster 2 Cluster 3

    Cluster N Query ?
  54. @ThanosMetrics ? ? ? ? ? ?

  55. @ThanosMetrics ? ? ? ? ? ?

  56. @ThanosMetrics ? ? ? ? ? ? Monitoring Cluster ...

    Cluster 1 Cluster 2 Cluster 3 Cluster N Query
  57. @ThanosMetrics ? ? ? ? ? ? ... Cluster 1

    Cluster 2 Cluster 3 Cluster N Monitoring Cluster Object Storage Query Store
  58. @ThanosMetrics ? ? ? ? ? ... Cluster 1 Cluster

    2 Cluster 3 Cluster N Monitoring Cluster Object Storage Query Store Receive Ingesting Millions of Metrics with Thanos Receive - Lucas Today (13:00)
  59. @ThanosMetrics ? ? ? ? ? ... Cluster 1 Cluster

    2 Cluster 3 Cluster N Object Storage Query Store Receive Rule
  60. @ThanosMetrics Query Receive Store Rule

  61. @ThanosMetrics Scrape Engine Rule + Alert Engine Query Engine Compactor

    Local Storage Alertmanager Grafana SVC 1 SVC 2 SVC 3 /metrics
  62. @ThanosMetrics Scrape Engine Rule + Alert Engine Compactor Local Storage

    Alertmanager SVC 1 SVC 2 SVC 3 /metrics Grafana Query
  63. @ThanosMetrics Sidecar/Receive Compactor Object Storage Grafana Query SVC 1 SVC

    2 SVC 3 /metrics Rule + Alert Engine Alertmanager
  64. @ThanosMetrics Object Storage Compact/Store SVC 1 SVC 2 SVC 3

    /metrics Sidecar/Receive Grafana Query Rule + Alert Engine Alertmanager
  65. @ThanosMetrics Object Storage Compact/Store Rule Alertmanager SVC 1 SVC 2

    SVC 3 /metrics Sidecar/Receive Grafana Query
  66. @ThanosMetrics https://www.katacoda.com/thanos

  67. @ThanosMetrics • ◦ • ◦ ◦ • • ◦

  68. @ThanosMetrics • Started participating in various initiatives such as the

    Community Bridge mentorship program late last year • Increases diversity in open source communities and gets more open source code written and released for the benefit of all. • Lots of projects going on at the moment and some awesome stuff has been implemented already such as delayed deletions by Khyati Soneji
  69. @ThanosMetrics

  70. @ThanosMetrics