Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Circuit Breakers & Microservices

Avatar for Bastian Hofmann Bastian Hofmann
December 01, 2016
Programming
160
2

Circuit Breakers & Microservices

Avatar for Bastian Hofmann

Bastian Hofmann

December 01, 2016

More Decks by Bastian Hofmann

See All by Bastian Hofmann
Monitoring in Kubernetes with Prometheus and Grafana
Avatar for Bastian Hofmann bastianhofmann
0
360
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
150
Highly available cross-region deployments with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
170
From source to Kubernetes in 30 minutes
Avatar for Bastian Hofmann bastianhofmann
0
200
Introduction to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
1
140
CI/CD with Kubernetes
Avatar for Bastian Hofmann bastianhofmann
0
250
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
1
290
Deploying your first Micro-Service application to Kubernetes
Avatar for Bastian Hofmann bastianhofmann
2
210
Creating a fast Kubernetes Development Workflow
Avatar for Bastian Hofmann bastianhofmann
0
280

Other Decks in Programming

See All in Programming
GitHubCopilotCLIのスラッシュコマンドを自作してみる
Avatar for tkym htkym
0
100
AI がコードを書く時代における新卒エンジニアの仕事風景 (2026) / New Graduate Engineers in the Era of AI Coding (2026)
Avatar for sushichan044 sushichan044
0
230
生成AI導入の「期待外れ」を乗り越える ー 開発フロー改革が目指す、真の組織変革
Avatar for starfish719 starfish719
0
1.6k
Welcome to the "Parametricity" 🏙️ − Generic だけど Specific な世界 −
Avatar for TAKASE Kazuyuki guvalif
PRO
1
180
FDEが実現するAI駆動経営の現在地
Avatar for ryuta sakamoto gonta
2
190
Apache Hive: そしてCloud Native Lakehouseへ
Avatar for okumin okumin
1
150
PHP に部分適用が来るぞ！……ところで何それ？おいしいの？ #phpcon / phpcon-2026
Avatar for shogogg shogogg
0
320
アルゴリズムは何を圧縮しているのか ─ Haskell から育った「圧縮代数」というメンタルモデル
Avatar for Naoya Ito naoya
16
3.6k
トークンをケチるな、設計しろ：GitHub Copilotを賢く使うコンテキスト戦略
Avatar for Ochtum ochtum
0
330
地域 SRE コミュニティ最前線 - ホンマでっかSRE勉強会
Avatar for tk3fftk tk3fftk
0
270
AI駆動開発を妨げる技術的負債の解消アプローチ / ai-refactoring-approach
Avatar for MinoDriven minodriven
17
9.2k
共通化で考えるべきは、実装より公開する型だった
Avatar for code-egg codeegg
0
270

Featured

See All Featured
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
25
2k
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
64
56k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
183
10k
Designing for Performance
Avatar for Lara Hogan lara
611
70k
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
4.1k
Thoughts on Productivity
Avatar for Jon Yablonski jonyablonski
76
5.3k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
128
18k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
28
3.6k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
8.2k
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
Avatar for r-kagaya rkaga
62
45k
HDC tutorial
Avatar for Michiel Stock michielstock
2
750
The #1 spot is gone: here's how to win anyway
Avatar for Tamara Novitovic tamaranovitovic
3
1.1k

Transcript

  1. Circuit Breakers & Microservices @BastianHofmann

  2. None
  3. None

  4. 11 million users

  5. 193 countries

  6. ~1800 request/s

  7. lots of data

  8. >100 million publications

  9. ~ 140 components

  10. ~ 400 repositories

  11. haproxy node memcache postgresql mongodb solr infinispan hbase mongodb solr

    community services

  12. + async events, stream and batch processing

  13. Latency

  14. Stability

  15. Handling failures

  16. What do I do when something breaks?

  17. Errors happen

  18. Bugs

  19. Performance regressions

  20. Server outages

  21. Database overloads

  22. Service A Service B 200 OK

  23. Service A Service B 5xx

  24. Service A Service B Timeout

  25. Circuit Breakers

  26. Service A Service B 200 OK Circuit Breaker Status: closed

    Error rate: 0

  27. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold

  28. Service A Service B Circuit Breaker Status: -> open Error

    rate: > threshold

  29. Service A Service B Error Circuit Breaker Status: -> open

    Error rate: > threshold Test if still failing

  30. Service A Service B 200 OK Circuit Breaker Status: ->

    close Error rate: 0 Test if still failing

  31. Gracefully handling exceptions

  32. Component based fronted

  33. None
  34. None
  35. None
  36. None
  37. None
  38. None
  39. None

  40. Degrading Functionality

  41. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu Institution

  42. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu EXCEPTION

    Institution

  43. Profile Publications Publication Publication Publication LeftColumn Image Menu Institution

  44. How do I handle traffic spikes?

  45. Service A Service B 200 OK Circuit Breaker

  46. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  47. Service A Service B Circuit Breaker Service C Circuit Breaker

    Timeouts

  48. Throttling

  49. Service A Service B Circuit Breaker Service C Circuit Breaker

    Only allow xx% of calls
  50. None

  51. Priority

  52. Service A Service B Circuit Breaker Service C Circuit Breaker

    100% of calls 10% of calls

  53. https://github.com/Netflix/Hystrix

  54. https://github.com/odesk/phystrix

  55. None

  56. http://twitter.com/BastianHofmann http://lanyrd.com/people/BastianHofmann http://speakerdeck.com/u/bastianhofmann [email protected]