Upgrade to Pro — share decks privately, control downloads, hide ads and more …

KubeCon EU 2020 Virtual - Introduction to Thanos

KubeCon EU 2020 Virtual - Introduction to Thanos

Matthias Loibl

August 19, 2020
Tweet

More Decks by Matthias Loibl

Other Decks in Programming

Transcript

  1. @ThanosMetrics
    GiedriusS / stag1e metalmatze

    View full-size slide

  2. @ThanosMetrics




    View full-size slide

  3. @ThanosMetrics


    View full-size slide

  4. @ThanosMetrics

    View full-size slide

  5. @ThanosMetrics



    ● 1400





    View full-size slide

  6. @ThanosMetrics

    View full-size slide

  7. @ThanosMetrics

    View full-size slide

  8. @ThanosMetrics

    View full-size slide

  9. @ThanosMetrics

    View full-size slide

  10. @ThanosMetrics

    View full-size slide

  11. @ThanosMetrics

    View full-size slide

  12. @ThanosMetrics
    /metrics
    # TYPE counter
    app_request_total 1337
    # TYPE gauge
    app_request_in_flight 3
    # TYPE histogram
    app_request_duration_bucket {le="0.005"} 500
    app_request_duration_bucket {le="0.01"} 213

    View full-size slide

  13. @ThanosMetrics
    Scrape Engine
    Rule + Alert Engine Query Engine
    Compactor
    Local Storage
    SVC 1
    SVC 2
    SVC 3
    /metrics
    Alertmanager Grafana

    View full-size slide

  14. @ThanosMetrics
    SVC 2
    SVC 3
    SVC 4
    NODE 1 NODE 2
    SVC 1

    View full-size slide

  15. @ThanosMetrics
    SVC 2
    SVC 3
    SVC 4
    NODE 1 NODE 2
    SVC 1

    View full-size slide

  16. @ThanosMetrics
    SVC 2
    SVC 3
    SVC 4
    NODE 1
    SVC 1
    NODE 2

    View full-size slide

  17. @ThanosMetrics
    NODE 1
    Local Storage

    View full-size slide

  18. @ThanosMetrics
    NODE 1
    Local Storage

    View full-size slide

  19. @ThanosMetrics
    Monitoring Cluster
    Cluster 1 Cluster 2 Cluster 3
    /federate /federate /federate

    View full-size slide

  20. @ThanosMetrics
    Monitoring Cluster
    Cluster 1 Cluster 2 Cluster 3
    /federate /federate /federate

    View full-size slide

  21. @ThanosMetrics
    Monitoring Cluster
    Cluster 1 Cluster 2 Cluster 3
    /federate /federate /federate

    View full-size slide

  22. @ThanosMetrics
    Monitoring Cluster
    /federate /federate /federate /federate
    ...
    Cluster 1 Cluster 2 Cluster 3 Cluster N

    View full-size slide

  23. @ThanosMetrics

    View full-size slide

  24. @ThanosMetrics
    Downsampling & Compaction
    Unlimited Retention
    Prometheus Compatible Global Query View

    View full-size slide

  25. @ThanosMetrics
    Monitoring Cluster
    /federate /federate /federate
    Cluster 1 Cluster 2 Cluster 3

    View full-size slide

  26. @ThanosMetrics
    Monitoring Cluster
    /query /query /query
    Cluster 1 Cluster 2 Cluster 3
    ?

    View full-size slide

  27. @ThanosMetrics
    Monitoring Cluster
    /query /query /query /query
    ...
    Cluster 1 Cluster 2 Cluster 3 Cluster N
    ?

    View full-size slide

  28. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    ...
    ?
    ?
    Cluster 2
    ?
    Cluster N
    ?
    /query /query /query

    View full-size slide

  29. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    gRPC
    ...
    ?
    ?
    Cluster 2
    gRPC
    ?
    Cluster N
    gRPC
    ?

    View full-size slide

  30. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    gRPC
    ...
    Cluster 2
    gRPC
    Cluster N
    gRPC
    Query

    View full-size slide

  31. @ThanosMetrics
    Thanos Deep Dive:
    Inside a Distributed
    Monitoring System
    KubeCon San Diego talk

    View full-size slide

  32. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    gRPC
    ...
    Cluster 2
    gRPC
    Cluster N
    gRPC
    Query
    Query

    View full-size slide

  33. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    gRPC
    ...
    Cluster 2 Cluster N
    gRPC gRPC
    gRPC gRPC
    gRPC
    Query

    View full-size slide

  34. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    ...
    Cluster 2 Cluster N
    StoreAPI StoreAPI StoreAPI
    Query
    Query Query Query

    View full-size slide

  35. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    ...
    Cluster 2 Cluster N
    Query
    Query Query Query

    View full-size slide

  36. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    ...
    Cluster 2 Cluster N
    Object
    Storage
    Query
    TSDB
    blocks
    TSDB
    blocks
    Query Query Query

    View full-size slide

  37. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    ...
    Cluster 2 Cluster N
    Object
    Storage
    Query Store
    Query Query Query

    View full-size slide

  38. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    ...
    Query
    Cluster 2 Cluster N
    Object
    Storage
    Compact
    Store
    Query Query Query

    View full-size slide

  39. @ThanosMetrics
    Monitoring Cluster
    Cluster 1
    ...
    Query
    Cluster 2 Cluster N
    Object
    Storage
    Compact
    Store
    Query Query Query
    Object
    Storage
    Replicate

    View full-size slide

  40. @ThanosMetrics
    Query Sidecar Store Compact Replicate

    View full-size slide

  41. @ThanosMetrics
    Cluster 1 Cluster 2 Cluster 3
    Monitoring Cluster
    Query
    ?

    View full-size slide

  42. @ThanosMetrics
    Cluster 1 Cluster 2 Cluster 3
    Monitoring Cluster
    Query
    ?

    View full-size slide

  43. @ThanosMetrics
    Monitoring Cluster
    ...
    Cluster 1 Cluster 2 Cluster 3 Cluster N
    Query
    ?

    View full-size slide

  44. @ThanosMetrics
    ?
    ?
    ?
    ?
    ?
    ?

    View full-size slide

  45. @ThanosMetrics
    ?
    ?
    ?
    ?
    ?
    ?

    View full-size slide

  46. @ThanosMetrics
    ?
    ?
    ?
    ?
    ?
    ?
    Monitoring Cluster
    ...
    Cluster 1 Cluster 2 Cluster 3 Cluster N
    Query

    View full-size slide

  47. @ThanosMetrics
    ?
    ?
    ?
    ?
    ?
    ?
    ...
    Cluster 1 Cluster 2 Cluster 3 Cluster N
    Monitoring Cluster
    Object
    Storage
    Query Store

    View full-size slide

  48. @ThanosMetrics
    ?
    ?
    ?
    ?
    ?
    ...
    Cluster 1 Cluster 2 Cluster 3 Cluster N
    Monitoring Cluster
    Object
    Storage
    Query Store
    Receive
    Ingesting Millions of
    Metrics with Thanos
    Receive - Lucas
    Today (13:00)

    View full-size slide

  49. @ThanosMetrics
    ?
    ?
    ?
    ?
    ?
    ...
    Cluster 1 Cluster 2 Cluster 3 Cluster N
    Object
    Storage
    Query
    Store
    Receive
    Rule

    View full-size slide

  50. @ThanosMetrics
    Query Receive Store Rule

    View full-size slide

  51. @ThanosMetrics
    Scrape Engine
    Rule + Alert Engine Query Engine
    Compactor
    Local Storage
    Alertmanager Grafana
    SVC 1
    SVC 2
    SVC 3
    /metrics

    View full-size slide

  52. @ThanosMetrics
    Scrape Engine
    Rule + Alert Engine
    Compactor
    Local Storage
    Alertmanager
    SVC 1
    SVC 2
    SVC 3
    /metrics
    Grafana
    Query

    View full-size slide

  53. @ThanosMetrics
    Sidecar/Receive
    Compactor
    Object Storage
    Grafana
    Query
    SVC 1
    SVC 2
    SVC 3
    /metrics
    Rule + Alert Engine
    Alertmanager

    View full-size slide

  54. @ThanosMetrics
    Object Storage
    Compact/Store
    SVC 1
    SVC 2
    SVC 3
    /metrics
    Sidecar/Receive
    Grafana
    Query
    Rule + Alert Engine
    Alertmanager

    View full-size slide

  55. @ThanosMetrics
    Object Storage
    Compact/Store
    Rule
    Alertmanager
    SVC 1
    SVC 2
    SVC 3
    /metrics
    Sidecar/Receive
    Grafana
    Query

    View full-size slide

  56. @ThanosMetrics
    https://www.katacoda.com/thanos

    View full-size slide

  57. @ThanosMetrics








    View full-size slide

  58. @ThanosMetrics
    ● Started participating in various initiatives
    such as the Community Bridge
    mentorship program late last year
    ● Increases diversity in open source
    communities and gets more open source
    code written and released for the benefit
    of all.
    ● Lots of projects going on at the moment
    and some awesome stuff has been
    implemented already such as delayed
    deletions by Khyati Soneji

    View full-size slide

  59. @ThanosMetrics

    View full-size slide

  60. @ThanosMetrics

    View full-size slide