Drinking from the Stream

Drinking from the Stream: How to use messaging platforms for scalability & performance

Most mission-critical systems have distributed elements or are entirely distributed, resulting in a number of challenges: performance, scalability, reliability, resilience...the eight fallacies of distributed computing are alive and well!

Messaging platforms are often used to solve these problems and increase the "ilities", but they don't come without a few complexities of their own. This session demonstrates how to leverage open source solutions like Spring Cloud Stream, RabbitMQ, & Apache Kafka to maximize your distributed systems' capabilities while minimizing complexity. All examples coded *live & in real-time*!

Transcript

1. Drinking from the Stream How to use messaging platforms for scalability & performance Mark Heckler Professional Problem Solver, Spring Developer & Advocate www.thehecklers.com mark@thehecklers.com mheckler@pivotal.io @mkheck
2. @mkheck www.thehecklers.com Distributed systems are easy…right?
3. @mkheck www.thehecklers.com Who am I? • Author • Architect & Developer • Java Champion, Rockstar • Professional Problem Solver • Spring Developer & Advocate • Creador y curador de
4. @mkheck www.thehecklers.com New book! But you can’t buy it yet… DISCLAIMER: artist’s rendition only, not the real cover
5. @mkheck www.thehecklers.com Takeaways Why use messaging platforms/where do they fit in a distributed architecture? Examples of leading messaging platforms What is Spring Cloud Stream? Why use it?
6. @mkheck www.thehecklers.com Takeaways Why use messaging platforms/where do they fit in a distributed architecture? Examples of leading messaging platforms What is Spring Cloud Stream? Why use it?
7. @mkheck www.thehecklers.com Takeaways Why use messaging platforms/where do they fit in a distributed architecture? Examples of leading messaging platforms What is Spring Cloud Stream? Why use it?
8. @mkheck www.thehecklers.com Takeaways Why use messaging platforms/where do they fit in a distributed architecture? Examples of leading messaging platforms What is Spring Cloud Stream? Why use it?
9. @mkheck www.thehecklers.com Why use it?
10. @mkheck www.thehecklers.com SCSt + ${messaging.platform} =
11. @mkheck www.thehecklers.com Sink Processor Power Source
12. @mkheck www.thehecklers.com Processor Sink Sink Processor Scalability Source Sink Sink
13. @mkheck www.thehecklers.com Processor Sink Sink Processor Flexibility Source Sink Sink
14. @mkheck www.thehecklers.com Processor Sink Sink Processor Versatility Source Sink Sink
15. @mkheck www.thehecklers.com Sink Processor Stream Revisited: Legacy Source
16. @mkheck www.thehecklers.com Consumer Function Stream Revisited: Evolution Supplier
17. @mkheck www.thehecklers.com Let’s code!
18. @mkheck www.thehecklers.com
19. @mkheck www.thehecklers.com Resources https://github.com/mkheck/drinking-from-the-stream https://cloud.spring.io/spring-cloud-stream/ mark@thehecklers.com, mheckler@pivotal.io @mkheck on Twitter Kotlin fan? https://github.com/mkheck/drinking-from-the-stream-kotlin