Slide 1

Slide 1 text

@kevindubois Cloud Agnostic Design Patterns and Tips (for Serverless and Java) Kevin Dubois, Principal Developer Advocate, Red Hat

Slide 2

Slide 2 text

@kevindubois The Cloud

Slide 3

Slide 3 text

@kevindubois Kevin Dubois ★ Principal Developer Advocate at Red Hat ★ Java Champion ★ Based in Belgium 󰎐 ★ Speak English, Dutch, French, Italian 🤌 ★ Open Source Contributor (Quarkus, Camel, Knative, ..) ★ Community Member (BeJUG, BeCNCF) @[email protected] youtube.com/@thekevindubois linkedin.com/in/kevindubois github.com/kdubois @kevindubois.com

Slide 4

Slide 4 text

@kevindubois Cloud Computing: Respond more quickly to demand No provisioning/managing of hardware High availability, Disaster Recovery, Resilience Grow your application in a manageable way Use only the resources you need ! €€ …

Slide 5

Slide 5 text

@kevindubois CI/CD GitOps Networking Container Registry (Some) Components of an Application Platform Developer Tools Monitoring Logging

Slide 6

Slide 6 text

@kevindubois

Slide 7

Slide 7 text

@kevindubois

Slide 8

Slide 8 text

@kevindubois

Slide 9

Slide 9 text

@kevindubois

Slide 10

Slide 10 text

@kevindubois But…

Slide 11

Slide 11 text

@kevindubois ● Regulatory changes ● Outages ● Price changes, contract renegotiations ● Other vendor offers better hw / services ● New CIO/CTO ● Shadow IT ● … What if …

Slide 12

Slide 12 text

@kevindubois

Slide 13

Slide 13 text

@kevindubois So … ?

Slide 14

Slide 14 text

@kevindubois Hybrid / Multi Cloud!?

Slide 15

Slide 15 text

@kevindubois

Slide 16

Slide 16 text

@kevindubois

Slide 17

Slide 17 text

@kevindubois Open Source & Cloud Native Ecosystem FTW!

Slide 18

Slide 18 text

@kevindubois What about Serverless?

Slide 19

Slide 19 text

@kevindubois Serverless “Serverless computing refers to the concept of building and running applications that do not require server management. It describes a finer-grained deployment model where applications, bundled as one or more functions are uploaded to a platform and then executed, scaled, and billed in response to the exact demand needed at the moment” -- CNCF Definition, https://www.cncf.io/blog/2018/02/14/cncf-takes-first-step-towards-serverless-computing/

Slide 20

Slide 20 text

@kevindubois https://www.cncf.io/blog/2023/12/20/cncf-cloud-native-finops-cloud-financial-management-microsurvey/

Slide 21

Slide 21 text

@kevindubois overprovisioned & wasting resources underprovisioned & unhappy users! Traditional Deployments

Slide 22

Slide 22 text

@kevindubois Serverless Use only what you need! with Serverless

Slide 23

Slide 23 text

@kevindubois Java & Serverless

Slide 24

Slide 24 text

@kevindubois JVM Scaling

Slide 25

Slide 25 text

@kevindubois Supersonic. Subatomic. Java

Slide 26

Slide 26 text

@kevindubois Build Time Runtime @ @ > The Quarkus Way Runtime Build Time @ @ > Package model Build Time Runtime @ @ >

Slide 27

Slide 27 text

@kevindubois The Quarkus Way enables Native Compilation OOTB JVM Build Time @ @ > Package model Native

Slide 28

Slide 28 text

@kevindubois Quarkus + Native (via GraalVM) 0.016 Seconds Quarkus + JVM (via OpenJDK) 0.943 Seconds Traditional Cloud-Native Stack 4.3 Seconds Supersonic, Subatomic Java Quarkus + Native (via GraalVM) 12 MB Quarkus + JVM (via OpenJDK) 73 MB Traditional Cloud-Native Stack 136 MB

Slide 29

Slide 29 text

@kevindubois Java warmup time https://youtu.be/bWmuqh6wHgE (first 13 minutes)

Slide 30

Slide 30 text

@kevindubois AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience FaaS

Slide 31

Slide 31 text

@kevindubois

Slide 32

Slide 32 text

@kevindubois

Slide 33

Slide 33 text

@kevindubois Writing cloud agnostic functions with Java & Quarkus

Slide 34

Slide 34 text

@kevindubois github.com/serverless-java-in-action/examples

Slide 35

Slide 35 text

@kevindubois quarkus create app funqy \ -x quarkus-funqy-amazon-lambda

Slide 36

Slide 36 text

@kevindubois

Slide 37

Slide 37 text

@kevindubois AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience Serverless Containers With the advent of containers & Kubernetes, many frameworks and solutions started to auto-scale containers. Cloud providers created offerings using managed services completely abstracting Kubernetes APIs. 1.5 ➔ Fargate, Cloud Run, Container Instances ➔ Knative, KEDA, etc ➔ Kubernetes based auto-scaling ➔ Microservices and Functions ➔ Easier to debug & test locally ➔ Polyglot & Portable Serverless is evolving...

Slide 38

Slide 38 text

@kevindubois

Slide 39

Slide 39 text

@kevindubois Knative https://github.com/knative

Slide 40

Slide 40 text

@kevindubois Immutable revisions Deploy new features: performing canary, A/B or blue-green testing with gradual traffic rollout with no sweat and following best practices. Any programming language Use any programming language or runtime of choice. From Java, Python, Go and JavaScript to Quarkus, SpringBoot or Node.js. No need to configure number of replicas, or idling. Scale to zero when not in use, auto scale to thousands during peak, with built-in reliability and fault-tolerance. Automatic scaling Simplified developer experience to deploy applications/code on serverless containers abstracting infrastructure & focusing on what matters. Containers made easy Ready for the Hybrid Cloud Truly portable serverless running anywhere Kubernetes runs, that is on-premises or on any public cloud. Leverage data locality and SaaS when needed. prem aws azur e Event Driven Architectures Build loosely coupled & distributed apps connecting with a variety of built-in or third-party event sources or connectors powered by Operators. Knative is an Open Source, Cloud Agnostic Solution to build Serverless and Event Driven Applications on Kubernetes Knative

Slide 41

Slide 41 text

@kevindubois $ kn func create -l quarkus myfunc $ kn func deploy $ kn service create myservice --image=xyz github.com/serverless-java-in-action/examples

Slide 42

Slide 42 text

@kevindubois AWS Lambda, Functions... Built around the FaaS components and other services such as API Gateways. It enabled a variety of use cases but it is far from ideal for general computing and with room for improvements. 1.0 ➔ HTTP and other few Sources ➔ Functions only ➔ Limited execution time (5 min) ➔ No orchestration ➔ Limited local development experience Serverless Containers With the advent of containers & Kubernetes, many frameworks and solutions started to auto-scale containers. Cloud providers created offerings using managed services completely abstracting Kubernetes APIs. 1.5 ➔ Fargate, Cloud Run, Container Instances ➔ Knative, KEDA, etc ➔ Kubernetes based auto-scaling ➔ Microservices and Functions ➔ Easier to debug & test locally ➔ Polyglot & Portable Integration & State The maturity and benefits of Serverless are recognized industry wide and it adds the missing parts to make pattern suitable for general purpose workloads and used on the enterprise. 2.0 ➔ Basic state handling ➔ Enterprise Integration Patterns ➔ Advanced Messaging Capabilities ➔ Blended with your PaaS ➔ Enterprise-ready event sources ➔ Solutions and outcome focused

Slide 43

Slide 43 text

@kevindubois

Slide 44

Slide 44 text

@kevindubois Knative Eventing Eventing is a set of APIs for routing events from Producers to Consumers (known as Sinks) CloudEvent specification allows for the creation of Serverless components that are driven by Event rather than Traffic

Slide 45

Slide 45 text

@kevindubois CloudEvents CNCF graduated project - https://cloudevents.io/ Provides a common event schema => Interoperability, portability Extensible through extension attributes SDKs for different programming languages Protocol-agnostic (HTTP, AMQP, MQTT, …) Wide adoption

Slide 46

Slide 46 text

@kevindubois Usage Patterns Source to Sink

Slide 47

Slide 47 text

@kevindubois Usage Patterns Channel and Subscription

Slide 48

Slide 48 text

@kevindubois Usage Patterns Broker and Trigger

Slide 49

Slide 49 text

@kevindubois

Slide 50

Slide 50 text

@kevindubois

Slide 51

Slide 51 text

@kevindubois github.com/kdubois/CamelQuarkusVoter

Slide 52

Slide 52 text

@kevindubois Serverless + AI ? https://knative.dev/docs/about/case-studies/deepc/

Slide 53

Slide 53 text

@kevindubois Wrapping it up… ● Cloud providers offer a LOT of cool stuff ● We need to be mindful of cloud lock-in ● Serverless is much more than just FAAS ● Use Open Source when you can, proprietary services when you must ● If you find yourself limited by Open Source solutions, contribute and participate!

Slide 54

Slide 54 text

@kevindubois Free Developer e-Books & tutorials! developers.redhat.com/eventtutorials

Slide 55

Slide 55 text

@kevindubois OpenShift Sandbox: We changed the default deployment type to Serverless

Slide 56

Slide 56 text

@kevindubois github.com/serverless-java-in-action

Slide 57

Slide 57 text

@kevindubois github.com/kdubois/CamelQuarkusVoter

Slide 58

Slide 58 text

@kevindubois Serverless Java in Action Kevin Dubois & Daniel Oh

Slide 59

Slide 59 text

@kevindubois Thank you! @[email protected] youtube.com/@thekevindubois linkedin.com/in/kevindubois github.com/kdubois @kevindubois.com