Cloud Chaos and Microservices Mayhem

The way we use Java has changed. Applets - or any browser-side Java - are a long, long, time ago. Java moved to the back end, and stayed there, but the back-end has gotten bigger, more distributed, and more complicated. Some things that were a good idea ten years ago turn out to be a terrible idea in the cloud; and what used to be ‘good enough’ for testing really isn’t anymore. Managing microservices architecture demands a lot of us, to ensure observability, operational resiliency, and organisational agility. This talk will introduce some of the new tools, patterns, and best practices for Java development in 2022. It also gives a tour of some of the most painful anti-patterns Holly has seen as a former consultant with the IBM Garage.

Transcript

1. cloud chaos and microservices mayhem Holly Cummins Red Hat @holly_cummins
5. #RedHat @holly_cummins things you need to do well in 2022:
6. #RedHat @holly_cummins handwashing things you need to do well in 2022:
7. #RedHat @holly_cummins handwashing apps things you need to do well in 2022:
8. #RedHat @holly_cummins handwashing apps ops things you need to do well in 2022:
9. #RedHat @holly_cummins handwashing apps ops devops things you need to do well in 2022:
10. #RedHat @holly_cummins handwashing apps ops devops devsecops things you need to do well in 2022:
11. #RedHat @holly_cummins handwashing apps ops devops devsecops finops things you need to do well in 2022:
14. #RedHat @holly_cummins a few
15. #RedHat @holly_cummins
16. #RedHat @holly_cummins technology changes fast (duh)
17. #RedHat @holly_cummins technology changes fast (duh) … but it’s taking us a while to catch up to cloud
18. #RedHat @holly_cummins technology changes fast (duh) … but it’s taking us a while to catch up to cloud
19. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins tracing
20. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins observability
21. #RedHat @holly_cummins hardware old way logs
22. #RedHat @holly_cummins hardware old way cloud way logs container logs
23. #RedHat @holly_cummins hardware old way cloud way logs logs
24. #RedHat @holly_cummins hardware old way cloud way logs oops
25. #RedHat @holly_cummins hardware old way cloud way logs container logs
26. #RedHat @holly_cummins hardware old way cloud way logs container logs
27. #RedHat @holly_cummins hardware old way cloud way logs logs
28. #RedHat @holly_cummins hardware old way cloud way logs logs container logs container logs container logs container logs
29. #RedHat @holly_cummins hardware old way cloud way logs logs container logs container logs container logs container logs
30. #RedHat @holly_cummins hardware old way cloud way logs logs container logs container logs container logs container logs aggregation + correlation
31. #RedHat @holly_cummins hardware old way cloud way logs logs container logs container logs container logs container logs aggregation + correlation open telemetry open tracing
32. #RedHat @holly_cummins
33. #RedHat @holly_cummins good news: observability is ‘fixed’
34. #RedHat @holly_cummins good news: observability is ‘fixed’ bad news: not all of us are using it
35. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins performance requirements
36. #RedHat @holly_cummins memory footprint is money startup time is money
37. #RedHat @holly_cummins ahead of time compilation is (now) a good idea
38. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins performance optimisation
39. #RedHat @holly_cummins
40. #RedHat @holly_cummins
41. #RedHat @holly_cummins the JVM tunes itself differently on servers
42. #RedHat @holly_cummins the JVM tunes itself differently on servers … but what’s a server?
43. #RedHat @holly_cummins answer(ish):
44. #RedHat @holly_cummins // This is the working definition of a server class machine: // >= 2 physical CPU's and >=2GB of memory answer(ish): actual hotspot source code
45. #RedHat @holly_cummins
46. #RedHat @holly_cummins takeaway: don’t shrink your containers too much or your JVM will make bad decisions advice accurate as of June 2022. all performance advice should be independently verified. do not try this at home without testing first. your mileage may vary.
47. #RedHat @holly_cummins wait, isn’t that the opposite of the advice in the previous section? should my containers be big or small?
48. #RedHat @holly_cummins this is the chaos part :) wait, isn’t that the opposite of the advice in the previous section? should my containers be big or small?
49. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins management
50. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins keeping track of hardware
51. #RedHat @holly_cummins The cloud makes it so easy to provision hardware.
52. #RedHat @holly_cummins That doesn’t mean the hardware is free.
53. #RedHat @holly_cummins That doesn’t mean the hardware is free.
54. #RedHat @holly_cummins That doesn’t mean the hardware is free. Or useful.
55. #RedHat @holly_cummins That doesn’t mean the hardware is free. Or useful. Or shuts itself off.
56. #RedHat @holly_cummins Hey boss, I created a Kubernetes cluster.
57. #RedHat @holly_cummins Hey boss, I created a Kubernetes cluster. I forgot it for 2 months.
58. #RedHat @holly_cummins Hey boss, I created a Kubernetes cluster. I forgot it for 2 months. … and it’s €1000 a month.
59. Photo by daveynin, flickr
60. #RedHat @holly_cummins 2017 survey 25% of 16,000 servers doing no useful work
61. #RedHat @holly_cummins 2017 survey 25% of 16,000 servers doing no useful work “perhaps someone forgot to turn them off”
62. #RedHat @holly_cummins finops figuring out who in your company forgot to turn off their cloud
63. #RedHat @holly_cummins companies that went out of business for cloud cost accidents
64. @holly_cummins #RedHat
65. #RedHat @holly_cummins
66. #RedHat @holly_cummins
67. #RedHat @holly_cummins $11,448.30
68. #RedHat @holly_cummins “I did find a setting on your plan that set the max cacheable file size to 15GB and it looks like your zipfile is 18GB big” $11,448.30
69. #RedHat @holly_cummins
70. #RedHat @holly_cummins maybe this is the chaos part
71. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins releasing
72. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins releasing
73. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins microservices
74. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins microservices
75. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins
76. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins “we’re moving too slowly.
77. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins “we’re moving too slowly. we should modernise our COBOL application into microservices.
78. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins “we’re moving too slowly. we should modernise our COBOL application into microservices. … but our release board only meets twice a year.”
79. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins modularity
80. #RedHat @holly_cummins microservices are not the goal
81. #RedHat @holly_cummins microservices are not the goal they are the means
82. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins wishful mimicry
83. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins cloud != microservices
84. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins cloud native != microservices
85. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins “every time we touch one microservice, all the others break.”
86. #RedHat @holly_cummins distributed monolith
87. #RedHat @holly_cummins distributed monolith but without compile-time checking … or guaranteed function execution
88. #RedHat @holly_cummins distributed monolith but without compile-time checking … or guaranteed function execution
89. #RedHat @holly_cummins distributed monolith but without compile-time checking … or guaranteed function execution
90. #RedHat @holly_cummins distributed monolith but without compile-time checking … or guaranteed function execution
91. #RedHat @holly_cummins “each of our microservices has duplicated the same object model … with twenty classes and seventy fields”
92. #RedHat @holly_cummins Microservice Domain
93. #RedHat @holly_cummins Microservice Domain
94. #RedHat @holly_cummins Microservice Domain (this is bad)
95. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins distributed != decoupled
96. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins “ohhhh, we weren’t expecting your service to do that … “
97. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins “uh, what do you mean you corrected the typo in your json?”
98. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins If you’re going to do microservices, you need to get good at automation. And testing.
99. IBM Cloud © 2020 IBM Corporation
100. IBM Cloud © 2020 IBM Corporation the test pyramid
101. IBM Cloud © 2020 IBM Corporation the test pyramid end-to-end tests
102. IBM Cloud © 2020 IBM Corporation the test pyramid end-to-end tests unit tests
103. IBM Cloud © 2020 IBM Corporation the test pyramid end-to-end tests unit tests contract tests
104. IBM Cloud © 2020 IBM Corporation the test pyramid (you can TDD at every level!) end-to-end tests unit tests contract tests
105. #RedHat @holly_cummins How to test a fire alarm?
106. IBM Cloud © 2020 IBM Corporation how not to test a fire alarm
107. IBM Cloud © 2020 IBM Corporation how not to test a fire alarm
108. #RedHat @holly_cummins
109. #RedHat @holly_cummins unit testing a fire alarm
110. #RedHat @holly_cummins uh … is that enough?
111. #RedHat @holly_cummins contract testing a fire alarm
112. #RedHat @holly_cummins contract testing a fire alarm
113. #IBMGarage + IBM Cloud © 2020 IBM Corporation @holly_cummins to the code!
114. #RedHat @holly_cummins demo recap: https://github.com/holly-cummins/house-of-microservices-quarkus-contract-testing-sample
115. #RedHat @holly_cummins demo recap: https://github.com/holly-cummins/house-of-microservices-quarkus-contract-testing-sample
116. #RedHat @holly_cummins demo recap: • consumer-driven contract testing can save your bacon • pact is a mock for the consumer • pact is a functional test for the producer • shared json contracts aligns expectations across services
117. #RedHat @holly_cummins slides