Upgrade to PRO for Only $50/Yearโ€”Limited-Time Offer! ๐Ÿ”ฅ

SLOs that Lie

SLOs thatย Lie

- Is uptime really the right measure of your reliability?
- What happens when that which monitors downtime has downtime?
- If upstream/downstream is down - how does it impact your numbers?
- Find answers to these questions and more.

Piyush Verma

July 09, 2020
Tweet

More Decks by Piyush Verma

Other Decks in Programming

Transcript

  1. Whatโ€™s in it for you? ๎‚ˆ How the world views

    SLOs? ๎‚ˆ How deep do they go? ๎‚ˆ How do we measure them? - What do we leave out? - How that which we donโ€™t notice botches the numbers? ๎‚ˆ What should you do about it? 3
  2. In a given week/day/month SLI X should be ___ SLO

    should be > < = ___ SLA or else โ€ฆ. 18
  3. 21 9s Per Day Per Week Per Month Per Year

    99 14.4 mins 1.7 hours 7.3 hours 3.7 days 99.9 1.4 mins 10.1 mins 43.8 mins 8.7 hours 99.99 8.6 secs 1 min 4.4 mins 52.6 mins 99.999 0.864 sec 6.1 min 26.3 secs 5.3 mins
  4. 29

  5. 30 There are 10K devices. avg 500 ms to reach

    1.4 minutes to report AND ๏ฌx
  6. โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ Status โ”‚ OK โ”‚ OK โ”‚ Unknown โ”‚

    Ok โ”‚ โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค โ”‚ Time โ”‚ 10:00:01 โ”‚ 10:00:10 โ”‚ 10:00:11 โ”‚ 10:00:21 โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 48
  7. โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ Status โ”‚ OK โ”‚ Unknown โ”‚ Down โ”‚

    Ok โ”‚ โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค โ”‚ Time โ”‚ 10:00:01 โ”‚ 10:00:10 โ”‚ 10:00:20 โ”‚ 10:00:21 โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 49
  8. There is no one true SLO Uptime of one layer

    could be error of another. 52