Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Circuit Breakers & Microservices

Avatar for Bastian Hofmann Bastian Hofmann
December 01, 2016
Programming
2
160

Circuit Breakers & Microservices

Avatar for Bastian Hofmann

Bastian Hofmann

December 01, 2016
Tweet

More Decks by Bastian Hofmann

See All by Bastian Hofmann
Monitoring in Kubernetes with Prometheus and Grafana
Avatar for Bastian Hofmann bastianhofmann
0
340
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
130
Highly available cross-region deployments with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
150
From source to Kubernetes in 30 minutes
Avatar for Bastian Hofmann bastianhofmann
0
170
Introduction to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
140
CI/CD with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
0
210
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
1
270
Deploying your first Micro-Service application to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
2
180
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
240

Other Decks in Programming

See All in Programming
疑似コードによるプロンプト記述、どのくらい正確に実行される？
Avatar for kokuyouwind kokuyouwind
0
390
CSC307 Lecture 08
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
670
AIエージェント、”どう作るか”で差は出るか？ / AI Agents: Does the "How" Make a Difference?
Avatar for r-kagaya rkaga
4
2k
QAフローを最適化し、品質水準を満たしながらリリースまでの期間を最短化する #RSGT2026
Avatar for shibayu36 shibayu36
2
4.4k
HTTPプロトコル正しく理解していますか？ 〜かわいい猫と共に学ぼう。ฅ^•ω•^ฅ ﾆｬ〜
Avatar for ♛Heitor Hirose hekuchan
2
690
例外処理とどう使い分ける？Result型を使ったエラー設計 #burikaigi
Avatar for Takuma Kajikawa kajitack
16
6.1k
AI によるインシデント初動調査の自動化を行う AI インシデントコマンダーを作った話
Avatar for azukiazusa azukiazusa1
1
730
0→1 フロントエンド開発 Tips🚀 #レバテックMeetup
Avatar for 弁護士ドットコム bengo4com
0
570
Data-Centric Kaggle
Avatar for ねぼすけAI isax1015
2
770
AIフル活用時代だからこそ学んでおきたい働き方の心得
Avatar for shinoyu shinoyu
0
130
CSC307 Lecture 05
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
500
並行開発のためのコードレビュー
Avatar for Miyuki miyukiw
0
170

Featured

See All Featured
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
61
9.7k
Navigating the moral maze — ethical principles for Al-driven product design
Avatar for Skipper Chong Warson skipperchong
2
240
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
Information Architects: The Missing Link in Design Systems
Avatar for Michelle Chin soysaucechin
0
780
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
50
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
12
1k
How People are Using Generative and Agentic AI to Supercharge Their Products, Projects, Services and Value Streams Today
Avatar for Helen Beal helenjbeal
1
120
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
54
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
133
19k
More Than Pixels: Becoming A User Experience Designer
Avatar for Michelle Schulp Hunt marktimemedia
3
320
Utilizing Notion as your number one productivity tool
Avatar for Mfonobong Umondia mfonobong
3
220
Measuring Dark Social's Impact On Conversion and Attribution
Avatar for Stephen Akadiri stephenakadiri
1
120

Transcript

  1. Circuit Breakers & Microservices @BastianHofmann

  2. None
  3. None

  4. 11 million users

  5. 193 countries

  6. ~1800 request/s

  7. lots of data

  8. >100 million publications

  9. ~ 140 components

  10. ~ 400 repositories

  11. haproxy node memcache postgresql mongodb solr infinispan hbase mongodb solr

    community services

  12. + async events, stream and batch processing

  13. Latency

  14. Stability

  15. Handling failures

  16. What do I do when something breaks?

  17. Errors happen

  18. Bugs

  19. Performance regressions

  20. Server outages

  21. Database overloads

  22. Service A Service B 200 OK

  23. Service A Service B 5xx

  24. Service A Service B Timeout

  25. Circuit Breakers

  26. Service A Service B 200 OK Circuit Breaker Status: closed

    Error rate: 0

  27. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold

  28. Service A Service B Circuit Breaker Status: -> open Error

    rate: > threshold

  29. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold Test if still failing

  30. Service A Service B 200 OK Circuit Breaker Status: ->

    close Error rate: 0 Test if still failing

  31. Gracefully handling exceptions

  32. Component based fronted

  33. None
  34. None
  35. None
  36. None
  37. None
  38. None
  39. None

  40. Degrading Functionality

  41. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu Institution

  42. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu EXCEPTION

    Institution

  43. Profile Publications Publication Publication Publication LeftColumn Image Menu Institution

  44. How do I handle traffic spikes?

  45. Service A Service B 200 OK Circuit Breaker

  46. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  47. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  48. Throttling

  49. Service A Service B Circuit Breaker Service C Circuit Breaker

    Only allow xx% of calls
  50. None

  51. Priority

  52. Service A Service B Circuit Breaker Service C Circuit Breaker

    100% of calls 10% of calls

  53. https://github.com/Netflix/Hystrix

  54. https://github.com/odesk/phystrix

  55. None

  56. http://twitter.com/BastianHofmann http://lanyrd.com/people/BastianHofmann http://speakerdeck.com/u/bastianhofmann [email protected]