The Power of Lacinia & Hsytrix in Production

Lacinia is Walmartlabs’ implementation of Facebook’s GraphQL on Clojure. It supports the full GraphQL spec, a high-performance parser for GraphQL queries built on Antlr4, and efficient and asynchronous query execution.

Hystrix is Netflix’ circuit-breaker implementation. It is a Java library that helps you control the interactions between distributed services by adding latency tolerance and fault tolerance logic.

By combining Lacinia’s resolvers and Hystrix’ highly performant thread-pool and fallback options you can achieve increased performance while also improving your system’s overall resiliency.

In this talk, we will explore the power of these two libraries together.

Transcript

1. The Power of Lacinia & Hystrix in Production @tiagoluchini
2. Hi! @tiagoluchini
4. x 7 x 6
7. OUR MISSION Design & develop the digital products people use every day
9. LACINIA? HYSTRIX? TOGETHER?
10. WHAT’S LACINIA? The Power of Lacinia & Hystrix in Production @tiagoluchini
11. WHAT’S HYSTRIX? The Power of Lacinia & Hystrix in Production @tiagoluchini
12. WHY LACINIA AND HYSTRIX? The Power of Lacinia & Hystrix in Production @tiagoluchini
13. In Practice
15. SCHEMA
17. Neutral Schema (Umlaut) Lacinia Schema SCHEMA CREATION GraphViz Diagram Clojure Spec JS GraphQL Schema Generator Generator Generator Generator
18. SCHEMA
19. SCHEMA RESOLVERS
20. Lacinia GENERIC LACINIA
21. Lacinia HTTP GENERIC LACINIA
22. Lacinia HTTP GraphQL Queries GENERIC LACINIA JSON Responses
23. GRAPHQL IN A NUTSHEL GRAPHQL QUERY
24. GRAPHQL IN A NUTSHEL GRAPHQL QUERY JSON RESPONSE
28. POWER TO THE FRONT END… The Power of Lacinia & Hystrix in Production @tiagoluchini
29. When Things Change
30. x 7 x 6
33. "The world hates change, yet it is the only thing that has brought progress." — Charles Kettering
36. ADDING ADAPTIVE IMAGES… The Power of Lacinia & Hystrix in Production @tiagoluchini
37. SCHEMA
38. NEW SCHEMA
39. NEW SCHEMA
40. NEW SCHEMA
41. NEW SCHEMA
43. LACINIA = CHANGE FAST The Power of Lacinia & Hystrix in Production @tiagoluchini
44. When Things Go Wrong
47. TRANSLATION: "THE SITUATION IS BAD. DEAL WITH IT."
48. DO WE DEAL WITH IT? The Power of Lacinia & Hystrix in Production @tiagoluchini
49. "The issues we are facing have all the same root cause. When the application makes a request to the backend, it in turn makes requests to 3rd party services which may take too long to complete or eventually fail. In such cases the app breaks with request timeout exception.
50. Essentially what this means from a dev perspective is that… … the backend requires no fixes.” "The issues we are facing have all the same root cause. When the application makes a request to the backend, it in turn makes requests to 3rd party services which may take too long to complete or eventually fail. In such cases the app breaks with request timeout exception.
51. Dependencies HTTP + Lacinia HAPPY PATH
52. HTTP + Lacinia Dependencies TINY PROBLEMS, BIG REPERCUSSIONS Slower/Problem
53. µ = 100ms σ = 100ms SINGLE DEPENDENCY LATENCY
55. 1 user → 1.5 pages/session + 40 requests/page → 60 requests/session ~6% of our users experience ~500ms/session 493.3ms 99,9%
56. µ = 100ms σ = 100ms µ = 100ms σ = 100ms TWO DEPENDENCIES LATENCY LATENCY
58. µ = 100ms σ = 100ms µ = 2000ms σ = 2000ms TWO DEPENDENCIES LATENCY LATENCY
61. 100% of our users experience 20,000ms/session
64. 19 req/s 116.24 req/s 69% req loss 0 req loss
68. Dependencies HTTP + Lacinia WITH CIRCUIT BREAKER Hystrix
74. Failure Fail Fast Fail Silently Static Stubbed Cached Content Fallback Common Fallback Strategies Chained Fallbacks Advanced
75. HYSTRIX = FAIL FAST The Power of Lacinia & Hystrix in Production @tiagoluchini
76. Seven Takeaways
77. EMBRACE CHANGE
78. EMBRACE FAILURE
79. Lacinia GraphQL Queries JSON Responses Resolvers GRAPHQL IS JUST PART OF THE EQUATION
80. Lacinia GraphQL Queries JSON Responses Resolvers GRAPHQL IS JUST PART OF THE EQUATION A) RESOLVERS MAY BE TOO COMPLEX
81. Lacinia GraphQL Queries JSON Responses Resolvers GRAPHQL IS JUST PART OF THE EQUATION Hystrix A) RESOLVERS MAY BE TOO COMPLEX
82. Lacinia GraphQL Queries JSON Responses Resolvers GRAPHQL IS JUST PART OF THE EQUATION Hystrix B) NO BROWSER CACHE! A) RESOLVERS MAY BE TOO COMPLEX
83. Lacinia GraphQL Queries JSON Responses Resolvers GRAPHQL IS JUST PART OF THE EQUATION Hystrix Memcached B) NO BROWSER CACHE! A) RESOLVERS MAY BE TOO COMPLEX
84. CIRCUIT BREAKERS COVER GRAPHQL SHORTCOMINGS
86. MONITOR AT THE FUNCTION LEVEL
88. VALUE STARTS AT THE CONSUMING SIDE
90. “FORCE” YOURSELF TO THINK ABOUT FALLBACK
91. Product Features Production Issues Whole Product
92. Product Features Production Issues Whole Product
93. THINK IN TERMS OF WHOLE PRODUCT
94. https://luchini.nyc @tiagoluchini https://work.co @workandco
95. This Presentation & its code Lein Template Umlaut (Schema lang) wrk2 (Perf benchmarking) Do It Yourself Explore Recommended
96. Hystrix Hystrix Stream Hystrix Dashboard Lacinia Lacinia Pedestal Links & References Hystrix & Lacinia Domo The Verge Text Request References
97. Ashley O'Connor Fernando Andrade Igor Oliveira Justin Gehtland João Gomes Nikolas Moya Rafael Rinaldi Rodrigo Senra Rupal Parekh Acknowledgements Nikolas Moya (Umlaut) Howard L. Ship (Lacinia) Dave Ray (Hystrix Bindings) Gil Tene (Latency Benchmarking) Joseph Wilk (original Hystrix Streamer) This talk Open Source
98. Work & Co 231 Front St, 5th Floor, Brooklyn, NY 11201 +1 347-470-4803 newbiz@work.co work.co