Spinning up microservices using Ruby/Kafka

Learn how to create your own ruby applications and link them up using Kafka

Transcript

1. Private & Confidential Spinning up microservices using Ruby/Kafka ankitagupta12
2. Private & Confidential API v/s Event Stream
3. Private & Confidential An event stream limits the concern of publishing service to broadcasting a message when an event occurs i.e. fire and forget What is an event stream?
4. Private & Confidential Kafka is a distributed, partitioned, replicated commit log service
5. Private & Confidential Kafka clusters contain topics that can be subscribed to by multiple consumers
6. Private & Confidential Producer. Publishes messages Consumer. Subscribes to messages Topic. Category of messages Key Definitions
7. Private & Confidential So what does this look like in practice?
8. Private & Confidential Pheromone. https://github.com/ankitagupta12/pheromone Pheromone allows easy publishing of changes (inserts and updates) in ActiveRecord models to topics in Kafka. Setting up your first Producer
9. Private & Confidential Setting up a Producer using Pheromone
10. Private & Confidential Karafka. https://github.com/karafka/karafka Karafka is a higher level abstraction on raw Kafka drivers, providing tools to set up consumers for multiple topics within a single application. Setting up your first Consumer
11. Private & Confidential Register a consumer and topic
12. Private & Confidential Add in the consumer logic
13. Private & Confidential Thank you