Wprowadzenie do Watermill GoCracow

Transcript

1. roblaszczak Wprowadzenie do Watermill zbudujmy aplikację opartą o eventy w 30 minut
2. roblaszczak About me • I’m Robert • Tech Lead @ • Blogging at https://threedots.tech/ • @roblaszczak at
3. roblaszczak Cascading failures
4. roblaszczak
5. roblaszczak
6. roblaszczak
7. roblaszczak PROBLEM?
8. roblaszczak BUILDING EVENT-DRIVEN APPLICATIONS IS NOT EASY
9. roblaszczak Building applications based on Kafka is not easy • Consumer groups • Partitioning • At-least-once delivery • Message Ack and Nack support • Not losing any message • Not everyone is familiar with event-driven architecture
10. roblaszczak How to make building event-driven applications easy in Go?
11. roblaszczak Watermill
12. roblaszczak 1.4k GitHub Stars
13. roblaszczak 16 Contributors
14. roblaszczak 8 Supported Pub/Subs
15. roblaszczak
16. roblaszczak Watermill is a library Watermill is not a framework
17. roblaszczak
18. roblaszczak HOW?
19. roblaszczak Unix philosophy (1978) • Write programs that do one thing and do it well. • Write programs to work together. • Write programs to handle text streams message, because that is a universal interface.
20. roblaszczak type Publisher interface { Publish(topic string, messages ...*Message) error Close() error } type Subscriber interface { Subscribe(ctx context.Context, topic string) (<-chan *Message, error) Close() error }
21. roblaszczak type HandlerFunc func(msg *Message) ([]*Message, error)
22. roblaszczak
23. roblaszczak
24. roblaszczak
25. roblaszczak
26. roblaszczak Testing
27. roblaszczak func TestPublishSubscribe(t *testing.T) { features := tests.Features{ ConsumerGroups: true, ExactlyOnceDelivery: false, GuaranteedOrder: false, Persistent: true, } tests.TestPubSub( t, features, createPubSub, createPubSubWithConsumerGrup, ) }
28. roblaszczak var stressTestTestsCount = 10 func TestPubSubStressTest( t *testing.T, features Features, pubSubConstructor PubSubConstructor, consumerGroupPubSubConstructor ConsumerGroupPubSubConstructor, ) { for i := 0; i < stressTestTestsCount; i++ { t.Run(fmt.Sprintf("%d", i), func(t *testing.T) { t.Parallel() TestPubSub(t, features, pubSubConstructor, consumerGroupConstructor) }) } }
29. roblaszczak
30. roblaszczak How fast is Watermill?
31. roblaszczak Pub/Sub Publish (messages / s) Subscribe (messages / s) Kafka 70,252 117,529 NATS 76,208 38,169 SQL (MySQL) 6,989 143 Google Cloud Pub/Sub 7,416 39,591 AMQP 2,408 10,608
32. roblaszczak Pub/Sub Publish (messages / s) Subscribe (messages / s) Kafka 70,252 117,529 NATS 76,208 38,169 SQL (MySQL) 6,989 143 Google Cloud Pub/Sub 7,416 39,591 AMQP 2,408 10,608
33. roblaszczak Pub/Sub Publish (messages / s) Subscribe (messages / s) Kafka 70,252 117,529 NATS 76,208 38,169 SQL (MySQL) 6,989 143 Google Cloud Pub/Sub 7,416 39,591 AMQP 2,408 10,608
34. roblaszczak The first rule of live coding
35. roblaszczak Don’t do livecoding The first rule of live coding
36. roblaszczak Not covered • It’s even hard to show everything in 20 minutes :) • Kafka and Google Cloud Pub/Sub internals • At-least-once delivery • CQRS component • Go to watermill.io !
37. roblaszczak
38. roblaszczak
39. roblaszczak Thanks for all contributors!
40. roblaszczak roblaszczak https://watermill.io/ https://threedots.tech/ THANKS!
41. roblaszczak Photo by Micheile Henderson @micheile010 // Visual Stories [nl] on Unsplash Photo by Thomas Ehling on Unsplash