Data Dichotomy

Problema dos dados na arquitetura de micro serviços

Transcript

1. DATA DICHOTOMY Data system are about exposing data. Services are about hiding it http://vignette2.wikia.nocookie.net/memoryalpha/images/e/e7/Data_makeup_tests.jpg/revision/latest?cb=20120725111417&path-prefix=en
2. 15+ anos Sr System Engineer at Bemobi / Opera github.com/aoqfonseca @aoqfonseca
3. Ben Stopford. December 13, 2016. https://www.confluent.io/blog/data-dichotomy-rethinking-the-way-we-treat-data-and-services/ JR D'Amore. May 5, 2015. https://www.thoughtworks.com/pt/insights/blog/scaling-microservices-event-stream
4. https://en.wikipedia.org/wiki/Data_(Star_Trek) “ Data: is a character from Star Trek , from next generation. A robot with all knowledge…"
5. https://martinfowler.com/articles/microservices.html “ … In short, the microservice architectural style [1] is an approach to developing a single application as a suite of small services, each running in its own process and communicating with lightweight mechanisms, often an HTTP resource API. These services are built around business capabilities and independently deployable by fully automated deployment machinery. There is a bare minimum of centralized management of these services, which may be written in different programming languages and use different data storage technologies… "
6. MONOLITHS
7. F G A B C D I J H
8. FEATURES
9. • Easy to deploy • Evolve multiples features • Monitoring • Model / Data / PROS
10. F G A B C D I J H
11. DOMAIN
12. • Polyglot (best tool for the job) • Scaling • Distributed • Reduced number of LoC / PROS
15. Share State
16. A B C BD
17. • Database aren’t easy to scale (shards, shared files, etc) • Single point of failure. • Not polyglot • Hard evolving: if you change some scheme, you need to adapt all services that use it. • Not isolated
18. Flow State
19. A B C REST
23. ASYNC
25. https://www.cartoonstock.com/directory/q/queue_jumpers.asp Queues
29. CELERY
32. Neha Narkhede : 18/02/2016 https://www.confluent.io/blog/announcing-kafka-connect-building-large-scale-low-latency-data-pipelines/
33. https://www.confluent.io/blog/announcing-kafka-connect-building-large-scale-low-latency-data-pipelines/
37. Kafka Stream Stream Stream Emit events