Serverless Java - Cloud Agnostic Design Patterns and Tips @DevNexus

Transcript

1. @kevindubois @danieloh30 Cloud Agnostic Design Patterns and Tips (for Serverless and Java)
2. @kevindubois @danieloh30 The Cloud
3. @kevindubois @danieloh30 Who We Are! Daniel Oh Developer Advocate, Java Champion @danieloh30 Kevin Dubois Developer Advocate, Java Champion @kevindubois
4. @kevindubois @danieloh30 Part 1 - Where are you in your Cloud Journey?
5. @kevindubois @danieloh30 Cloud Computing: Respond more quickly to demand No provisioning/managing of hardware High availability, Disaster Recovery, Resilience Grow your application in a manageable way Use only the resources you need ! €€ …
6. @kevindubois @danieloh30 CI/CD GitOps Networking Container Registry (Some) Components of an Application Platform Developer Tools Monitoring Logging
7. @kevindubois @danieloh30
8. @kevindubois @danieloh30
9. @kevindubois @danieloh30
10. @kevindubois @danieloh30
11. @kevindubois @danieloh30 But…
12. @kevindubois @danieloh30 • Regulatory changes • Outages • Price changes, contract renegotiations • Other vendor offers better hw / services • New CIO/CTO • Shadow IT • … What if …
13. @kevindubois @danieloh30
14. @kevindubois @danieloh30 So … ?
15. @kevindubois @danieloh30 Hybrid / Multi Cloud!?
16. @kevindubois @danieloh30
17. @kevindubois @danieloh30
18. @kevindubois @danieloh30 Open Source & Cloud Native Ecosystem FTW!
19. @kevindubois @danieloh30 Part 2 - Adopting Serverless in your Cloud Native Journey
20. @kevindubois @danieloh30 Serverless “Serverless computing refers to the concept of building and running applications that do not require server management. It describes a finer-grained deployment model where applications, bundled as one or more functions are uploaded to a platform and then executed, scaled, and billed in response to the exact demand needed at the moment” -- CNCF Definition, https://www.cncf.io/blog/2018/02/14/cncf-takes-first-step-towards-serverless-computing/
21. @kevindubois @danieloh30 https://www.cncf.io/blog/2023/12/20/cncf-cloud-native-finops-cloud-financial-management-microsurvey/
22. @kevindubois @danieloh30 overprovisioned & wasting resources underprovisioned & unhappy users! Traditional Deployments NOT Serverless
23. @kevindubois @danieloh30 Serverless Use only what you need! with Serverless
24. @kevindubois @danieloh30 Java & Serverless
25. @kevindubois @danieloh30 JVM Scaling
26. @kevindubois @danieloh30 Supersonic. Subatomic. Java
27. @kevindubois @danieloh30 Build Time Runtime @ @ </> The Quarkus Way Runtime Build Time @ @ </> Package model Build Time Runtime @ @ </>
28. @kevindubois @danieloh30 The Quarkus Way enables Native Compilation OOTB JVM Build Time @ @ </> Package model Native
29. @kevindubois @danieloh30 Quarkus + Native (via GraalVM) 0.016 Seconds Quarkus + JVM (via OpenJDK) 0.943 Seconds Traditional Cloud-Native Stack 4.3 Seconds Supersonic, Subatomic Java Quarkus + Native (via GraalVM) 12 MB Quarkus + JVM (via OpenJDK) 73 MB Traditional Cloud-Native Stack 136 MB
30. @kevindubois @danieloh30 Java warmup time https://youtu.be/bWmuqh6wHgE (first 13 minutes)
31. @kevindubois @danieloh30 AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience FaaS
32. @kevindubois @danieloh30
33. @kevindubois @danieloh30
34. @kevindubois @danieloh30 Writing cloud agnostic functions with Java & Quarkus
35. @kevindubois @danieloh30 github.com/serverless-java-in-action/examples
36. @kevindubois @danieloh30 quarkus create app funqy \ -x quarkus-funqy-amazon-lambda
37. DEMO
38. @kevindubois @danieloh30 Part 3 - Design Cloud Agnostic Serverless Architecture
39. @kevindubois @danieloh30
40. @kevindubois @danieloh30 AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience Serverless Containers With the advent of containers & Kubernetes, many frameworks and solutions started to auto-scale containers. Cloud providers created offerings using managed services completely abstracting Kubernetes APIs. 1.5 ➔ Fargate, Cloud Run, Container Instances ➔ Knative, KEDA, etc ➔ Kubernetes based auto-scaling ➔ Microservices and Functions ➔ Easier to debug & test locally ➔ Polyglot & Portable Serverless is evolving...
41. @kevindubois @danieloh30
42. @kevindubois @danieloh30 Knative https://github.com/knative
43. @kevindubois @danieloh30 Immutable revisions Deploy new features: performing canary, A/B or blue-green testing with gradual traffic rollout with no sweat and following best practices. Any programming language Use any programming language or runtime of choice. From Java, Python, Go and JavaScript to Quarkus, SpringBoot or Node.js. No need to configure number of replicas, or idling. Scale to zero when not in use, auto scale to thousands during peak, with built-in reliability and fault-tolerance. Automatic scaling Simplified developer experience to deploy applications/code on serverless containers abstracting infrastructure & focusing on what matters. Containers made easy Ready for the Hybrid Cloud Truly portable serverless running anywhere Kubernetes runs, that is on-premises or on any public cloud. Leverage data locality and SaaS when needed. prem aws azur e Event Driven Architectures Build loosely coupled & distributed apps connecting with a variety of built-in or third-party event sources or connectors powered by Operators. Knative is an Open Source, Cloud Agnostic Solution to build Serverless and Event Driven Applications on Kubernetes Knative
44. @kevindubois @danieloh30 with serverless workloads Efficient Node Utilization == Less Nodes == Energy + Cost Savings
45. @kevindubois @danieloh30 $ kn func create -l quarkus myfunc $ kn func deploy $ kn service create myservice --image=xyz github.com/serverless-java-in-action/examples
46. @kevindubois @danieloh30 AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience Serverless Containers With the advent of containers & Kubernetes, many frameworks and solutions started to auto-scale containers. Cloud providers created offerings using managed services completely abstracting Kubernetes APIs. 1.5 ➔ Fargate, Cloud Run, Container Instances ➔ Knative, KEDA, etc ➔ Kubernetes based auto-scaling ➔ Microservices and Functions ➔ Easier to debug & test locally ➔ Polyglot & Portable Integration & State The maturity and benefits of Serverless are recognized industry wide and it adds the missing parts to make pattern suitable for general purpose workloads and used on the enterprise. 2.0 ➔ Basic state handling ➔ Enterprise Integration Patterns ➔ Advanced Messaging Capabilities ➔ Blended with your PaaS ➔ Enterprise-ready event sources ➔ Solutions and outcome focused
47. @kevindubois @danieloh30
48. @kevindubois @danieloh30 Knative Eventing Eventing is a set of APIs for routing events from Producers to Consumers (known as Sinks) CloudEvent specification allows for the creation of Serverless components that are driven by Event rather than Traffic
49. @kevindubois @danieloh30 CloudEvents CNCF graduated project - https://cloudevents.io/ Provides a common event schema => Interoperability, portability Extensible through extension attributes SDKs for different programming languages Protocol-agnostic (HTTP, AMQP, MQTT, …) Wide adoption
50. @kevindubois @danieloh30 Knative Eventing Usage Patterns Source to Sink
51. @kevindubois @danieloh30 Knative Eventing Usage Patterns Channel and Subscription
52. @kevindubois @danieloh30 Knative Eventing Usage Patterns Broker and Trigger
53. @kevindubois @danieloh30 Who wants more demos?
54. @kevindubois @danieloh30
55. @kevindubois @danieloh30
56. @kevindubois @danieloh30 github.com/kdubois/CamelQuarkusVoter
57. @kevindubois @danieloh30 Serverless + AI ? https://knative.dev/docs/about/case-studies/deepc/
58. @kevindubois @danieloh30 Wrapping it up… • Cloud providers offer a LOT of cool stuff • We need to be mindful of cloud lock-in • Serverless is much more than just FAAS • Use Open Source when you can, proprietary services when you must • If you find yourself limited by Open Source solutions, contribute and participate!
59. @kevindubois @danieloh30 Free Developer e-Books & tutorials! developers.redhat.com/eventtutorials
60. @kevindubois @danieloh30 Serverless Java in Action Kevin Dubois & Daniel Oh
61. @kevindubois @danieloh30 Agenda Cloud Native Track - 10 & 11th April 2024 Wednesday, April 10th 17.00 Your Java code in the Kubernetes native Era: A live coding experience - Daniel Oh Thursday, April 11th API Management as code: A declarative approach to handling API artifacts – Hugo Guerrero 11.30 Going from containers, to pods, to Kubernetes - help for your developer environments - Cedric Clyburn 10.00 13.30 Quarkus 3: The road to virtual threads for cheaper, faster and easier concurrent Applications - Daniel Oh Java automation for yesterday, today and tomorrow – Andrew Block & Harsha Cherukuri 16.00 Supersonic, Subatomic GitHub - Jason Lee 15.00
62. @kevindubois @danieloh30 Get started Sign up at developers.redhat.com Find out more about Red Hat’s project and products, and what it offers developers
63. @kevindubois @danieloh30 Join us
64. Book Signing with Daniel Oh Thursday, April 11th At 2:40pm Come meet Daniel Oh and have him sign a free copy of “Quarkus for Spring Developers”. (Limited Quantities) Use this QR code to get a free digital copy.
65. @kevindubois @danieloh30 Thank you! Daniel Oh Developer Advocate, Java Champion @danieloh30 Kevin Dubois Developer Advocate, Java Champion @kevindubois