GABC2018: Microservices with Azure Service Fabric. Easy... or is it? by Daniel Marbach

Service Fabric is so simple! Just click-click-deploy and we have a stateless microservice! But what if we want to store business data? We can use reliable collections and even transactions to store data inside the cluster, but what happens when our single partition goes down? We could lose everything! Now we need to partition our data… how do we do that? And how do we integrate with other PaaS offerings like Azure Service Bus? Maybe this isn’t so easy after all. In this talk I'll walk you through Service Fabric Partitioning, a partition affinity model for Azure Service Bus queues and challenges you'll face with messaging patterns like request/response, publish/subscribe, process managers and other stateful entities running inside a Service Fabric Cluster.

Transcript

1. Microservices with Service Fabric Easy... or is it?
2. Goals Stateless and Stateful Services Partitioning of Business Data Message Patterns and Partitioning
3. Premise
4. A Tale of
5. Horrible death of easter bunnies
6. Karl’s, SalesPitch
7. https://channel9.msdn.com/Blogs/Azure/Azure-Service-Fabric https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-overview On-premises or in the cloud High Availability Hyper Scale Data Partitioning Rolling Upgrades Our Chocolate Microservices Automatic Rollback Container orchestration & lifecycle management Stateless Services StatefulServices Self-healing Replication & Failover Load balancing Health Monitoring
8. Stateless1 Stateless1 Stateless1 Stateless1 Stateless1 Cluster Connector Remoting Chaos Demo
9. Demo
10. Let’s scale choco
11. http://microservices.io/articles/scalecube.html Horizontal duplication Functional decomposition Y-axis Scale by splitting different things
12. Loadbalancer FrontEnd1 FrontEnd2 FrontEnd3 Stateless1 Stateless2 Stateless3 Storage Tier Stateless Web Stateless Middletier
13. Mandy spoke up and then
14. Mandy spoke up and then
15. Mandy spoke up and then
16. Loadbalancer FrontEnd1 FrontEnd2 FrontEnd3 Stateful1 Stateful2 Stateful3 Storage Tier (Cold) Stateless Web Stateful Tier (Hot)
17. http://microservices.io/articles/scalecube.html Horizontal duplication Functional decomposition Y-axis Scale by splitting different things Data Partitioning
18. Loadbalancer FrontEnd1 FrontEnd2 FrontEnd3 Dark Brown White
19. Loadbalancer FrontEnd1 FrontEnd2 FrontEnd3 Dark Brown White
20. However Joe couldn’t understand it
21. Loadbalancer FrontEnd1 FrontEnd2 FrontEnd3 Order Dark Order White Dark Brown White
22. And then Sophia threw a grenade
23. Loadbalancer WcfOrderSvc1 WcfOrderSvc2 WcfOrderSvcN+1 (Slow)ThirdParty FAT DB …
24. Loadbalancer WcfOrderSvc1 WcfOrderSvc2 WcfOrderSvcN+1 FAT DB … (Slow)ThirdParty Queue Gateway
25. FrontEnd1 FrontEnd2 FrontEnd3 Stateful1 Stateful2 Stateful3 Queue Broker Middleware
26. Peter snatches the whiteboard markers
27. screams and furiously
28. FrontEnd1 FrontEnd2 FrontEnd3 Queue Broker Middleware Dark Brown White Order Dark
29. Broker FrontEnd1 FrontEnd2 FrontEnd3 Dark Dark Brown White Brown White
30. Commands
31. OrderSender Dark OrderProcessor1 Brown White OrderProcessor2 OrderProcessor3 Logical Receiver Cmd Same bounded context Sender Side Distribution OrderChocolate
32. The PhD dude acts like a smart ass
33. Events
34. Publisher Shipping1 Shipping1 Shipping2 Shipping3 Logical Subscriber “Shipping” Evnt Shipping Shipping2 Shipping3 ChocolateOrdered Different bounded context
35. Receiver Side Distribution Publisher Shipping1 Shipping1 Shipping2 Shipping3 Logical Subscriber “Shipping” Evnt Shipping Shipping2 Shipping3 ChocolateOrdered Different bounded context
36. Request / Reply
37. Dark OrderProcessor1 Brown White OrderProcessor2 OrderProcessor3 Logical Receiver Sender1 OrderSender1 Sender2 Sender3 OrderSender2 OrderSender3 Logical Sender Cmd Rpl
38. Process Manager
39. ChocolateOrder ProcessManager Evnt ChocolateOrdered Cmd OrderChocolate Cmd MakePayment Evnt OrderPayed Cmd ShipOrder Evnt OrderShipped
40. ChocolateOrder.Front ChocolateOrder Dark Brown White Order Microservice Frontend (Stateless) Broker Sender Side Distribution Sender and Receiver Side Distribution ChocolateOrder ChocolateOrder ChocolateOrder ProcessManager Backend (Stateful) Shipping 33000 66000 99000 Shipping Microservice Broker Receiver Side Distribution Shipping Shipping Backend (Stateful)
41. Demo
42. Recap It is always more difficult than Microsoft tells you ;) Stateful computation with low latency requires smart routing Service Fabric with stateless and stateful services combined with messaginggives you best of two worlds
43. docs.particular.net/ tutorials/quickstart
44. docs.particular.net/ samples/azure/azure-service-fabric-routing/
45. go.particular.net/ sf-webinar
46. github.com/danielmarbach/Microservices.ServiceFabric Slides, Links…
47. Q & A
48. Software Engineer Enthusiastic Software Engineer Microsoft MVP @danielmarbach particular.net/blog planetgeek.ch
49. Thanks