The Three Paths of Scaling with Akka

This talk consists of a comprehensive walkthrough of the microservices pattern with Akka and Cassandra. It reviews the three primary aspects to consider when developing scalable microservices: - Separating functionality in Microservices - Cloning nodes - Data partitioning

For our purposes, the talk will mainly focus on this third aspect of leveraging Akka and Cassandra to achieve scalable microservices through proper data partitioning.

The Microservices Pattern is on the top of the wave nowadays. Knowing its fundamentals, and how Akka can help on this approach is highly valuable to any developer who is currently involved, or will be in the future, with high volumes of data, and will open the door to creating a more resilient and robust application.

Transcript

1. The Three Paths of Scaling with Akka
2. Who am I? Fran Pérez Senior Software Engineer @47deg Husband & Future[Father[Twins]] @FPerezP fran.p@47deg.com
3. Roadmap • Scalability • Project proposal • Functional Decomposition • Event Sourcing & CQRS • Data Partitioning • Horizontal Duplication • Code Examples • Demo • Common Problems
4. Scalability
5. Conference Management System Our Project
6. Functional Decomposition
7. Microservices Pattern • Consistency Level • Identify Domains • Bounded domains in their own context • Identify Relationships • Be ready to discover hidden relationships • FD != code decomposition
8. Conference Management System • C4P management • Attendees management • Segmentation • Email Management • Analytics
9. Conference Management System • C4P management • Attendees management • Segmentation • Email Management • Analytics
10. Architecture Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
11. The Akka Ecosystem • Akka Streams • Akka Clustering Tools • Akka Persistence • Akka Persistence Query • Akka HTTP
12. Event Sourcing Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
13. CQRS Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
14. Data Partitioning Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
15. Horizontal Duplication Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
16. Structure 2 SBT modules
17. Dependency Encapsulation
18. CQRS: Command Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
19. Write API: Kafka CSV
20. Write API: Kafka Consumer
21. Write API: Kafka Producer
22. Write API: Kafka PublisherActor
23. Data Partitioning Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
24. Sharding Region Splitting by attendeeId
25. Event Sourcing Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
26. EntityActor Persistent EntityActor
27. EntityActor Reusable state modifier
28. EntityActor
29. EntityActor Recovery
30. Horizontal Duplication Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
31. Persistence Akka Persistence Cassandra
32. Persistence Handle Snapshots
33. CQRS: Query Kafka Kafka HTTP DB CSV JSON µS SR EA EA EA
34. Read API: HTTP JSON
35. Persistence Query
36. μService Structure
37. Demo
38. Common Problems • Relationships • Split Brain • Serialization • Message Size • Persistency weight • Logs
39. Q&A Thanks! https://github.com/47deg/scalaio-microservices