Data Gateways: Legacy Data for Microservices

Application architecture evolution has fragmented the backend implementation into independent microservices and functions. However there is still a gap on the way this evolution has dealt with data as it tends to avoid dealing with static environments. At the same time, microservices encourage developers to create new polyglot data persistence layers that then, need to be composite to deliver business value. How can we apply the knowledge from API gateways to these new data stores?

In this session we will talk about:
- How data gateways act like API gateways to offer a secured abstraction layer on top of the physical data stores,
- the different data gateway types and architectures, and
- extended data-proxy for hybrid cloud deployments.

Transcript

1. Legacy data for microservices Data Gateways Hugo Guerrero APIs & Messaging Developer Advocate, Red Hat DATA GATEWAYS 1
2. Agenda DATA GATEWAYS 2 Architecture Evolution Application architecture trends Microservices Data The rise of the gateways Microservices Data Data Gateways Capabilities Types Open source data gateways Hugo Guerrero Mexican @ MA, USA APIs & Event-Driven Specialist | Open Source Advocate | History, Travel & Food Enthusiast @hguerreroo
3. DATA GATEWAYS 3 12 factor apps What became hot? Application Architecture Evolution Microservices Serverless
4. DATA GATEWAYS 4 MICROSERVICES ARCHITECTURE MONOLITHIC DATABASE
5. DATA GATEWAYS 5 Source: https://www.infoq.com/articles/data-gateways-cloud-native/ Traditional Architecture
6. DATA GATEWAYS 6 Source: https://www.infoq.com/articles/data-gateways-cloud-native/ Distributed Architecture
7. DATA GATEWAYS 7 The Rise of API Gateways The traditional Load Balancer is not enough Developer Apps API Backend 2 API Gateway API Request Authorized API Request API Backend 1 API Backend 3
8. 8 DATA GATEWAYS Microservices Data • Independent database per microservice ◦ Independent database instance ◦ Independent schema and logical grouping of tables • Only one microservice owns the data
9. 9 Source: https://martinfowler.com/bliki/PolyglotPersistence.html DATA GATEWAYS Microservices Data • Polyglot persistence layer ◦ Data is different, so the persistence layer • Relational database and document and in-memory and…
10. DATA GATEWAYS 10 Source: https://www.infoq.com/articles/data-gateways-cloud-native/ Gateways
11. Source: https://www.infoq.com/articles/data-gateways-cloud-native/ “A data gateway is like an API gateway, but it understands and acts on the data layer implementation rather than the networking layer” DATA GATEWAYS 11
12. 12 DATA GATEWAYS Data Gateway Capabilities • Abstraction / Decoupling ◦ Hides implementation ◦ Abstracts physical source • Security ◦ Access control based on data model (row, column, etc.) • Scaling ◦ Caching and materialized views • Federation • Schema-first based on SQL standard
13. 13 DATA GATEWAYS Many Types of Data Gateways • Classic Data Virtualization • Database with Federation • GraphQL bridges • Cloud-hosted • Secure tunneling data-proxies • Open source data gateways
14. • Apache Drill ◦ Schema-free SQL query engine for NoSQL databases and file systems • PrestoDB ◦ Distributed SQL query engine targeting big data use cases through its coordinator-worker architecture • Teiid ◦ Data federation engine purposefully re-written for the Kubernetes ecosystem sponsored by Red Hat 14 DATA GATEWAYS Open Source Data Gateways
15. DATA GATEWAYS 15
16. “Data has gravity, requires granular access control, is hard to scale, and difficult to move on/off/between cloud-native infrastructures. Having a data gateway component as part of the cloud-native tooling arsenal, which is hybrid and works on multiple cloud providers, supports different use cases is becoming a necessity.” DATA GATEWAYS 16 Source: https://www.infoq.com/articles/data-gateways-cloud-native/
17. linkedin.com/company/red-hat youtube.com/user/RedHatVideos facebook.com/redhatinc twitter.com/RedHat 17 Red Hat is the world’s leading provider of enterprise open source software solutions. Award-winning support, training, and consulting services make Red Hat a trusted adviser to the Fortune 500. Thank you DATA GATEWAYS