Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Circuit Breakers & Microservices

Avatar for Bastian Hofmann Bastian Hofmann
December 01, 2016
Programming
2
160

Circuit Breakers & Microservices

Avatar for Bastian Hofmann

Bastian Hofmann

December 01, 2016
Tweet

More Decks by Bastian Hofmann

See All by Bastian Hofmann
Monitoring in Kubernetes with Prometheus and Grafana
Avatar for Bastian Hofmann bastianhofmann
0
330
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
120
Highly available cross-region deployments with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
150
From source to Kubernetes in 30 minutes
Avatar for Bastian Hofmann bastianhofmann
0
160
Introduction to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
140
CI/CD with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
0
190
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
1
260
Deploying your first Micro-Service application to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
2
180
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
230

Other Decks in Programming

See All in Programming
MCPサーバー「モディフィウス」で変更容易性の向上をスケールする / modifius
Avatar for MinoDriven minodriven
4
500
Designing Repeatable Edits: The Architecture of . in Vim
Avatar for Satoru Kitaguchi satorunooshie
0
220
ビルドプロセスをデバッグしよう！
Avatar for Yuta Tomiyama yt8492
0
220
Reactive Thinking with Signals and the Resource API
Avatar for Manfred Steyer manfredsteyer
PRO
0
120
Introducing RemoteCompose: break your UI out of the app sandbox.
Avatar for Nicolas Roard camaelon
2
430
Register is more than clipboard
Avatar for Satoru Kitaguchi satorunooshie
1
350
Node-REDのノードの開発・活用事例とコミュニティとの関わり(Node-RED Con Nagoya 2025)
Avatar for 404background 404background
0
110
contribution to astral-sh/uv
Avatar for Shunsuke Tsuchiya shunsock
0
580
data-viz-talk-cz-2025
Avatar for Leonardo Collado-Torres lcolladotor
0
110
React Nativeならぬ"Vue Native"が実現するかも？_新世代マルチプラットフォーム開発フレームワークのLynxとLynxのVue.js対応を追ってみよう_Vue Lynx
Avatar for Yuto Nagai(Future) yut0naga1_fa
2
2k
CSC305 Lecture 11
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
320
GC25 Recap: The Code You Reviewed is Not the Code You Built / #newt_gophercon_tour
Avatar for mazrean mazrean
0
140

Featured

See All Featured
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
272
21k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
55
9.1k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
285
14k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
274
41k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
359
30k
Music & Morning Musume
Avatar for Bryan Veloso bryan
46
6.9k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
273
27k
Side Projects
Avatar for Sacha Greif sachag
455
43k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.5k
It's Worth the Effort
Avatar for 3n 3n
187
28k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
615
210k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k

Transcript

  1. Circuit Breakers & Microservices @BastianHofmann

  2. None
  3. None

  4. 11 million users

  5. 193 countries

  6. ~1800 request/s

  7. lots of data

  8. >100 million publications

  9. ~ 140 components

  10. ~ 400 repositories

  11. haproxy node memcache postgresql mongodb solr infinispan hbase mongodb solr

    community services

  12. + async events, stream and batch processing

  13. Latency

  14. Stability

  15. Handling failures

  16. What do I do when something breaks?

  17. Errors happen

  18. Bugs

  19. Performance regressions

  20. Server outages

  21. Database overloads

  22. Service A Service B 200 OK

  23. Service A Service B 5xx

  24. Service A Service B Timeout

  25. Circuit Breakers

  26. Service A Service B 200 OK Circuit Breaker Status: closed

    Error rate: 0

  27. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold

  28. Service A Service B Circuit Breaker Status: -> open Error

    rate: > threshold

  29. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold Test if still failing

  30. Service A Service B 200 OK Circuit Breaker Status: ->

    close Error rate: 0 Test if still failing

  31. Gracefully handling exceptions

  32. Component based fronted

  33. None
  34. None
  35. None
  36. None
  37. None
  38. None
  39. None

  40. Degrading Functionality

  41. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu Institution

  42. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu EXCEPTION

    Institution

  43. Profile Publications Publication Publication Publication LeftColumn Image Menu Institution

  44. How do I handle traffic spikes?

  45. Service A Service B 200 OK Circuit Breaker

  46. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  47. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  48. Throttling

  49. Service A Service B Circuit Breaker Service C Circuit Breaker

    Only allow xx% of calls
  50. None

  51. Priority

  52. Service A Service B Circuit Breaker Service C Circuit Breaker

    100% of calls 10% of calls

  53. https://github.com/Netflix/Hystrix

  54. https://github.com/odesk/phystrix

  55. None

  56. http://twitter.com/BastianHofmann http://lanyrd.com/people/BastianHofmann http://speakerdeck.com/u/bastianhofmann [email protected]