Circuit Breakers & Microservices

Transcript

1. Circuit Breakers & Microservices @BastianHofmann
4. 11 million users
5. 193 countries
6. ~1800 request/s
7. lots of data
8. >100 million publications
9. ~ 140 components
10. ~ 400 repositories
11. haproxy node memcache postgresql mongodb solr infinispan hbase mongodb solr community services
12. + async events, stream and batch processing
13. Latency
14. Stability
15. Handling failures
16. What do I do when something breaks?
17. Errors happen
18. Bugs
19. Performance regressions
20. Server outages
21. Database overloads
22. Service A Service B 200 OK
23. Service A Service B 5xx
24. Service A Service B Timeout
25. Circuit Breakers
26. Service A Service B 200 OK Circuit Breaker Status: closed Error rate: 0
27. Service A Service B Error Circuit Breaker Status: -> open Error rate: > threshold
28. Service A Service B Circuit Breaker Status: -> open Error rate: > threshold
29. Service A Service B Error Circuit Breaker Status: -> open Error rate: > threshold Test if still failing
30. Service A Service B 200 OK Circuit Breaker Status: -> close Error rate: 0 Test if still failing
31. Gracefully handling exceptions
32. Component based fronted
40. Degrading Functionality
41. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu Institution
42. Profile Publications Publication Publication Publication AboutMe LeftColumn Image Menu EXCEPTION Institution
43. Profile Publications Publication Publication Publication LeftColumn Image Menu Institution
44. How do I handle traffic spikes?
45. Service A Service B 200 OK Circuit Breaker
46. Service A Service B Circuit Breaker Service C Circuit Breaker Timeouts
47. Service A Service B Circuit Breaker Service C Circuit Breaker Timeouts
48. Throttling
49. Service A Service B Circuit Breaker Service C Circuit Breaker Only allow xx% of calls
51. Priority
52. Service A Service B Circuit Breaker Service C Circuit Breaker 100% of calls 10% of calls
53. https://github.com/Netflix/Hystrix
54. https://github.com/odesk/phystrix
56. http://twitter.com/BastianHofmann http://lanyrd.com/people/BastianHofmann http://speakerdeck.com/u/bastianhofmann mail@bastianhofmann.de