Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Circuit Breakers & Microservices

Avatar for Bastian Hofmann Bastian Hofmann
December 01, 2016
Programming
2
160

Circuit Breakers & Microservices

Avatar for Bastian Hofmann

Bastian Hofmann

December 01, 2016
Tweet

More Decks by Bastian Hofmann

See All by Bastian Hofmann
Monitoring in Kubernetes with Prometheus and Grafana
Avatar for Bastian Hofmann bastianhofmann
0
340
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
130
Highly available cross-region deployments with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
150
From source to Kubernetes in 30 minutes
Avatar for Bastian Hofmann bastianhofmann
0
170
Introduction to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
140
CI/CD with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
0
210
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
1
270
Deploying your first Micro-Service application to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
2
180
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
240

Other Decks in Programming

See All in Programming
LLM Observabilityによる 対話型音声AIアプリケーションの安定運用
Avatar for Hiroyuki Moriya gekko0114
2
430
AtCoder Conference 2025
Avatar for shindannin shindannin
0
1.1k
今こそ知るべき耐量子計算機暗号(PQC)入門 / PQC: What You Need to Know Now
Avatar for mackey0225 mackey0225
3
380
AI Agent の開発と運用を支える Durable Execution #AgentsInProd
Avatar for izumin5210 izumin5210
7
2.3k
Package Management Learnings from Homebrew
Avatar for Mike McQuaid mikemcquaid
0
220
なぜSQLはAIぽく見えるのか/why does SQL look AI like
Avatar for florets1 florets1
0
460
それ、本当に安全？ ファイルアップロードで見落としがちなセキュリティリスクと対策
Avatar for ikechi penpeen
7
3.9k
AIフル活用時代だからこそ学んでおきたい働き方の心得
Avatar for shinoyu shinoyu
0
130
KIKI_MBSD Cybersecurity Challenges 2025
Avatar for ikema ikema
0
1.3k
AIで開発はどれくらい加速したのか？AIエージェントによるコード生成を、現場の評価と研究開発の評価の両面からdeep diveしてみる
Avatar for どすこい daisuketakeda
1
2.5k
余白を設計しフロントエンド開発を 加速させる
Avatar for karacoro / からころ tsukuha
7
2.1k
コマンドとリード間の連携に対する脅威分析フレームワーク
Avatar for Aja9tochin pandayumi
1
450

Featured

See All Featured
What the history of the web can teach us about the future of AI
Avatar for Ines Montani inesmontani
PRO
1
430
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
122
21k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k
It's Worth the Effort
Avatar for 3n 3n
188
29k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
12k
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
Avatar for Tech SEO Connect techseoconnect
PRO
0
86
<Decoding/> the Language of Devs - We Love SEO 2024
Avatar for Nikki Halliwell nikkihalliwell
1
130
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
659
61k
Dominate Local Search Results - an insider guide to GBP, reviews, and Local SEO
Avatar for Greg Gifford greggifford
PRO
0
78
Claude Code のすすめ
Avatar for schroneko schroneko
67
210k
SEO in 2025: How to Prepare for the Future of Search
Avatar for Michael King ipullrank
3
3.3k
Thoughts on Productivity
Avatar for Jon Yablonski jonyablonski
74
5k

Transcript

  1. Circuit Breakers & Microservices @BastianHofmann

  2. None
  3. None

  4. 11 million users

  5. 193 countries

  6. ~1800 request/s

  7. lots of data

  8. >100 million publications

  9. ~ 140 components

  10. ~ 400 repositories

  11. haproxy node memcache postgresql mongodb solr infinispan hbase mongodb solr

    community services

  12. + async events, stream and batch processing

  13. Latency

  14. Stability

  15. Handling failures

  16. What do I do when something breaks?

  17. Errors happen

  18. Bugs

  19. Performance regressions

  20. Server outages

  21. Database overloads

  22. Service A Service B 200 OK

  23. Service A Service B 5xx

  24. Service A Service B Timeout

  25. Circuit Breakers

  26. Service A Service B 200 OK Circuit Breaker Status: closed

    Error rate: 0

  27. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold

  28. Service A Service B Circuit Breaker Status: -> open Error

    rate: > threshold

  29. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold Test if still failing

  30. Service A Service B 200 OK Circuit Breaker Status: ->

    close Error rate: 0 Test if still failing

  31. Gracefully handling exceptions

  32. Component based fronted

  33. None
  34. None
  35. None
  36. None
  37. None
  38. None
  39. None

  40. Degrading Functionality

  41. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu Institution

  42. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu EXCEPTION

    Institution

  43. Profile Publications Publication Publication Publication LeftColumn Image Menu Institution

  44. How do I handle traffic spikes?

  45. Service A Service B 200 OK Circuit Breaker

  46. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  47. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  48. Throttling

  49. Service A Service B Circuit Breaker Service C Circuit Breaker

    Only allow xx% of calls
  50. None

  51. Priority

  52. Service A Service B Circuit Breaker Service C Circuit Breaker

    100% of calls 10% of calls

  53. https://github.com/Netflix/Hystrix

  54. https://github.com/odesk/phystrix

  55. None

  56. http://twitter.com/BastianHofmann http://lanyrd.com/people/BastianHofmann http://speakerdeck.com/u/bastianhofmann [email protected]