Upgrade to PRO for Only $50/Year—Limited-Time Offer! 🔥

Circuit Breakers & Microservices

Avatar for Bastian Hofmann Bastian Hofmann
December 01, 2016
Programming
2
160

Circuit Breakers & Microservices

Avatar for Bastian Hofmann

Bastian Hofmann

December 01, 2016
Tweet

More Decks by Bastian Hofmann

See All by Bastian Hofmann
Monitoring in Kubernetes with Prometheus and Grafana
Avatar for Bastian Hofmann bastianhofmann
0
340
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
120
Highly available cross-region deployments with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
150
From source to Kubernetes in 30 minutes
Avatar for Bastian Hofmann bastianhofmann
0
170
Introduction to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
140
CI/CD with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
0
200
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
1
260
Deploying your first Micro-Service application to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
2
180
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
240

Other Decks in Programming

See All in Programming
Go コードベースの構成と AI コンテキスト定義
Avatar for ANDPAD inc andpad
0
130
TerraformとStrands AgentsでAmazon Bedrock AgentCoreのSSO認証付きエージェントを量産しよう！
Avatar for neruneruo neruneruo
4
930
【Streamlit x Snowflake】データ基盤からアプリ開発・AI活用まで、すべてをSnowflake内で実現
Avatar for Ayumu Yamaguchi ayumu_yamaguchi
1
120
MAP, Jigsaw, Code Golf 振り返り会 by 関東Kaggler会|Jigsaw 15th Solution
Avatar for s.konishi hasibirok0
0
250
LT資料
Avatar for t3tra t3tra
6
940
JETLS.jl ─ A New Language Server for Julia
Avatar for abap34 abap34
1
420
Tinkerbellから学ぶ、Podで DHCPをリッスンする手法
Avatar for Tomofumi Kondo tomokon
0
140
公共交通オープンデータ × モバイルUX 複雑な運行情報を 『直感』に変換する技術
Avatar for Tsubasa SEKIGUCHI tinykitten
PRO
0
140
DevFest Android in Korea 2025 - 개발자 커뮤니티를 통해 얻는 가치
Avatar for Suhyeon Kim wisemuji
0
160
ゆくKotlin くるRust
Avatar for TATSUNO Yasuhiro exoego
1
100
これならできる！個人開発のすゝめ
Avatar for Tsubasa SEKIGUCHI tinykitten
PRO
0
120
AIコーディングエージェント（NotebookLM）
Avatar for kondai kondai24
0
210

Featured

See All Featured
Joys of Absence: A Defence of Solitary Play
Avatar for Sebastian Deterding codingconduct
1
250
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
Avatar for Tech SEO Connect techseoconnect
PRO
0
47
Building AI with AI
Avatar for Ines Montani inesmontani
PRO
1
560
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
180
Why Your Marketing Sucks and What You Can Do About It - Sophie Logan
Avatar for Sophie Logan marketingsoph
0
39
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
0
73
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
0
300
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6k
brightonSEO & MeasureFest 2025 - Christian Goodrich - Winning strategies for Black Friday CRO & PPC
Avatar for Christian Goodrich cargoodrich
2
60
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
Avatar for Umar Saidu Auna auna
0
18
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
210
24k
Building Experiences: Design Systems, User Experience, and Full Site Editing
Avatar for Michelle Schulp Hunt marktimemedia
0
320

Transcript

  1. Circuit Breakers & Microservices @BastianHofmann

  2. None
  3. None

  4. 11 million users

  5. 193 countries

  6. ~1800 request/s

  7. lots of data

  8. >100 million publications

  9. ~ 140 components

  10. ~ 400 repositories

  11. haproxy node memcache postgresql mongodb solr infinispan hbase mongodb solr

    community services

  12. + async events, stream and batch processing

  13. Latency

  14. Stability

  15. Handling failures

  16. What do I do when something breaks?

  17. Errors happen

  18. Bugs

  19. Performance regressions

  20. Server outages

  21. Database overloads

  22. Service A Service B 200 OK

  23. Service A Service B 5xx

  24. Service A Service B Timeout

  25. Circuit Breakers

  26. Service A Service B 200 OK Circuit Breaker Status: closed

    Error rate: 0

  27. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold

  28. Service A Service B Circuit Breaker Status: -> open Error

    rate: > threshold

  29. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold Test if still failing

  30. Service A Service B 200 OK Circuit Breaker Status: ->

    close Error rate: 0 Test if still failing

  31. Gracefully handling exceptions

  32. Component based fronted

  33. None
  34. None
  35. None
  36. None
  37. None
  38. None
  39. None

  40. Degrading Functionality

  41. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu Institution

  42. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu EXCEPTION

    Institution

  43. Profile Publications Publication Publication Publication LeftColumn Image Menu Institution

  44. How do I handle traffic spikes?

  45. Service A Service B 200 OK Circuit Breaker

  46. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  47. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  48. Throttling

  49. Service A Service B Circuit Breaker Service C Circuit Breaker

    Only allow xx% of calls
  50. None

  51. Priority

  52. Service A Service B Circuit Breaker Service C Circuit Breaker

    100% of calls 10% of calls

  53. https://github.com/Netflix/Hystrix

  54. https://github.com/odesk/phystrix

  55. None

  56. http://twitter.com/BastianHofmann http://lanyrd.com/people/BastianHofmann http://speakerdeck.com/u/bastianhofmann [email protected]