A hitchhiker's guide to cloud native API gateways

Slide 1

Slide 1 text

A Hitchhiker’s Guide to Cloud Native API Gateways

Slide 2

Slide 2 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 2 Mario-Leander Reimer Principal Software Architect QAware GmbH

Slide 3

Slide 3 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 3 Monolithic Vintage System Users system.example.com

Slide 4

Slide 4 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 4 Users Monolithic Vintage System A Shared PasS A Namespace Service A system.example.com service-a.default.example.com Route

Slide 5

Slide 5 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 5 Users Monolithic Vintage System A Shared PasS A Namespace Service A system.example.com service-a.default.example.com Route Service B Route service-b…

Slide 6

Slide 6 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 6 Users Monolithic Vintage System A Shared PasS A Namespace Service A system.example.com service-a.default.example.com Route Service B Route service-b… Service C Route service-c…

Slide 7

Slide 7 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 7 Users Monolithic Vintage System A Shared PasS A Namespace Service A’ system.example.com service-a.default.example.com Route Service B Route service-b… Service C' Route service-c… 3rd Party Apps

Slide 8

Slide 8 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 8 Users Monolithic Vintage System A Shared PasS A Namespace Service A’ system.example.com service-a.default.example.com Route Service B Route service-b… Service C' Route service-c… 3rd Party Apps B Namespace Service X Service Y Service Z gRPC

Slide 9

Slide 9 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 9 Users Monolithic Vintage System A Shared PasS A Namespace Service A’ system.example.com service-a.default.example.com Route Service B Route service-b… Service C' Route service-c… 3rd Party Apps B Namespace Service X Service Y Service Z’ Unreliable Legacy Systems SOAP gRPC

Slide 10

Slide 10 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 10 Users Monolithic Vintage System A Shared PasS A Namespace Service A’ system.example.com service-a.default.example.com Route Service B Route service-b… Service C' Route service-c… 3rd Party Apps B Namespace Service X Service Y Service Z’ Unreliable Legacy Systems SOAP gRPC Route Internal Systems

Slide 11

Slide 11 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 11 APIs are the center piece of any successful digital product. Proper management of your APIs right from the start is crucial, to not end up in API hell. https://thenewstack.io/history-service-mesh/

Slide 12

Slide 12 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 12 APIs are the center piece of any successful digital product. Proper management of your APIs right from the start is crucial, to not end up in API hell. https://thenewstack.io/history-service-mesh/

Slide 13

Slide 13 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 13 Users Monolithic Vintage System A Shared PasS A Namespace Service A Service B Service C 3rd Party Apps B Namespace Service X Service Y Service Z Unreliable Legacy Systems SOAP API Gateway Backend for Frontend Internal Systems API Gateway API

Slide 14

Slide 14 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 14 API Gateways are like the Façade Pattern in  Cloud Native Application Design and Microservice Architectures

Slide 15

Slide 15 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware • Traﬃc Management: Path, Header, Host based Routing, Path Rewrite • Rollout and Deployment: A/B Deployment, Canary Release, et.al. • QoS and Resiliency: Circuit Breaker, Retry, Timeouts, Rate Limiting • Security: AAA, Terminate TLS, Support for JWT and JWKS, Open ID, … • Protocol Translation: XML to JSON, gRPC to JSON, … • Transformation: Fan Out / Collect, Backend for Frontend, GraphQL, … • Observability: Integration into Logging, Monitoring, Tracing Stacks 15

Slide 16

Slide 16 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 16 W E N S Ingress Egress API Gateways for North-South Communication Service Meshes for East-West Communication

Slide 17

Slide 17 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware API Gateways in a Nutshell • Benefits • Encapsulates internal structure of application • Provides client-specific APIs • BFF reduce the number of round trips • Simplifies client code 17 • Drawbacks • Yet another highly available component that needs to be managed and deployed • Risk of becoming a development bottleneck if managed centrally • Business logic in API gateway leads to accidental ESB

Slide 18

Slide 18 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware Possible Criteria for a Comparison • Open Source: no initial $$$ and no vendor lock-in please • Maturity: good and active community, little issues, frequent releases • Supported Features: Traﬃc Management, Deployment, Security, Translation, Transformation, QoS, Resiliency, Observability • DevOps Friendly: Easy setup and operability, supported platforms, CI/CD • Performance: Small overhead, high throughput, super scalable • Observability: good logging, monitoring, tracing capabilities + integration 18

Slide 19

Slide 19 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 19

Slide 20

Slide 20 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 20

Slide 21

Slide 21 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware Four Categories of API Gateways A. Build Your Own API Gateway B. API Management Solutions C. Service Proxies D. Cloud Native API Gateways 21

Slide 22

Slide 22 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware A. Build Your Own API Gateway 22 • Several frameworks available: Netﬂix Zuul 2, Spring Cloud Gateway, Node, Vert.x, Ballerina, Camel (K), Express Gateway, Sentinel • Provides a lot of ﬂexibility. • But: your team needs to develop, maintain and operate the gateway!

Slide 23

Slide 23 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware B. API Management Solutions 23 • Several full-blown API Management solutions: Kong, Tyk, Mulesoft, 3scale, Apigee, … • Makes sense in Enterprise use cases. Generally cost $. • Provide additional features such as payment, developer portals with API key management, integrations into enterprise infrastructure. • Usually, centrally deployed and operated for the whole platform and all its applications.

Slide 24

Slide 24 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware C. Service Proxies 24 • Many choices: Nginx, OpenResty, Envoy, Traeﬁk, Apache, HA Proxy, … • Lightweight and simple to use. • Provided features vary a lot between products.

Slide 25

Slide 25 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware D. Cloud Native API Gateways 25 • Few choices: KrakenD, Ambassador, Gloo • Usually build upon a service proxy such as Envoy and enhance it. • Provide tight integration with cloud native platform, like K8s.

Slide 26

Slide 26 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware Demos 26 https://github.com/lreimer/hitchhikers-guide-api-gateways https://speakerdeck.com/lreimer/a-hitchhikers-guide-to-cloud-native-api-gateways

Slide 27

Slide 27 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware 42. THE ANSWER TO LIFE, UNIVERSE, THE CLOUD AND API GATEWAYS. 27

Slide 28

Slide 28 text

Visit us @  Booth 321

Slide 29

Slide 29 text

| #OReillySACon Berlin 2019 | A Hitchhiker’s Guide to Cloud Native API Gateways | @LeanderReimer #cloudnativenerd #qaware Please rate today’s session 29 Session page on conference website O’Reilly Events App