The Rise of Reactive Microservices

CraftConf 2022, Budapest

Transcript

1. The Rise of Reactive
   Microservices
   CraftConf 2022
   @duffleit
   

   View Slide

2. David Leitner
   @duffleit
   Coding Architect
   david@squer.at
   @duffleit
   

   View Slide

3. The Rise of Reactive
   Microservices
   CraftConf 2022
   @duffleit
   

   View Slide

4. @duffleit
   “ Programming with,
   or designing upon,
   asynchronous data
   streams.
   

   View Slide

5. @duffleit
   

   View Slide

6. “ streams are just another data structure.
   @duffleit
   Time
   Space
   Value
   Getter Setter
   Collections
   Iterators Generators
   Promise
   Deferred Resolver
   Stream
   Subscriber Emitter
   

   View Slide

7. “ streams are just another data structure.
   @duffleit
   

   View Slide

8. @duffleit
   “ Programming with,
   or designing upon,
   asynchronous data
   streams.
   

   View Slide

9. @duffleit
   var counter = 2;
   var doubled = counter * 2;
   1
   2
   

   View Slide

10. @duffleit
    var counter = 2;
    var doubled = counter * 2;
    assert(doubled, 4);
    1
    2
    3
    4
    ✅
    

    View Slide

11. @duffleit
    var counter = 2;
    var doubled = counter * 2;
    // updating the counter
    counter = 3;
    1
    2
    3
    4
    5
    

    View Slide

12. @duffleit
    var counter = 2;
    var doubled = counter * 2;
    // updating the counter
    counter = 3;
    assert(doubled, 6)
    1
    2
    3
    4
    5
    6
    7
    💔
    

    View Slide

13. @duffleit
    var counter = 2;
    var doubled = counter * 2;
    // updating the counter
    counter = 3;
    doubled = counter * 2;
    1
    2
    3
    4
    5
    6
    

    View Slide

14. @duffleit
    var counter = 2;
    var doubled = counter * 2;
    // updating the counter
    counter = 3;
    doubled = counter * 2;
    assert(doubled, 6)
    1
    2
    3
    4
    5
    6
    7
    8
    

    View Slide

15. @duffleit
    var counter = 2;
    var doubled = counter * 2;
    // updating the counter
    counter = 3;
    doubled = counter * 2;
    assert(doubled, 6)
    1
    2
    3
    4
    5
    6
    7
    8
    ✅
    doubled
    🔗
    counter
    paulstovell.com/reactive-programming/
    

    View Slide

16. @duffleit
    var counter = 2;
    var doubled <= counter * 2;
    1
    2
    doubled
    🔗
    counter
    👆
    

    View Slide

17. @duffleit
    var counter = 2;
    var doubled <= counter * 2;
    // updating the counter
    counter = 3;
    1
    2
    3
    4
    5
    doubled
    🔗
    counter
    

    View Slide

18. @duffleit
    var counter = 2;
    var doubled <= counter * 2;
    // updating the counter
    counter = 3;
    assert(doubled, 6)
    1
    2
    3
    4
    5
    6
    7
    doubled
    🔗
    counter
    ✅
    

    View Slide

19. @duffleit
    var counter = stream(2);
    1
    🔗
    = streams
    👈 counter: [2]
    

    View Slide

20. @duffleit
    var counter = stream(2);
    var doubled = counter.map(x -> x * 2)
    1
    2
    👈 counter: [2]
    

    View Slide

21. @duffleit
    var counter = stream(2);
    var doubled = counter.map(x -> x * 2)
    1
    2
    🔗
    = streams
    👆
    counter: [2]
    

    View Slide

22. @duffleit
    var counter = stream(2);
    var doubled = counter.map(x -> x * 2)
    1
    2 👆
    counter: [2]
    doubled: [4]
    

    View Slide

23. @duffleit
    var counter = stream(2);
    var doubled = counter.map(x -> x * 2)
    1
    2
    “ we project the data from our counter stream into
    our doubled stream.
    👆
    counter: [2]
    doubled: [4]
    

    View Slide

24. @duffleit
    var counter = stream(2);
    var doubled = counter.map(x -> x * 2)
    // updating the counter
    1
    2
    3
    4
    👈
    counter: [2]
    doubled: [4]
    

    View Slide

25. @duffleit
    var counter = stream(2);
    var doubled = counter.map(x -> x * 2)
    // updating the counter
    counter.emit(3);
    1
    2
    3
    4
    5
    👈
    counter: [2]
    doubled: [4]
    

    View Slide

26. @duffleit
    var counter = stream(2);
    var doubled = counter.map(x -> x * 2)
    // updating the counter
    counter.emit(3);
    1
    2
    3
    4
    5
    counter: [2, 3]
    doubled: [4]
    👈
    

    View Slide

27. @duffleit
    var counter = stream(2);
    var doubled = counter.map(x -> x * 2)
    // updating the counter
    counter.emit(3);
    1
    2
    3
    4
    5
    counter: [2, 3]
    doubled: [4, 6]
    👈
    

    View Slide

28. @duffleit
    var counter = stream(2);
    var doubled = counter.map(x -> x * 2)
    // updating the counter
    counter.emit(3);
    assert(doubled.value, 6)
    1
    2
    3
    4
    5
    6
    7
    👈
    counter: [2, 3]
    doubled: [4, 6]
    ✅
    

    View Slide

29. @duffleit
    

    View Slide

30. @duffleit
    var counter = new BehaviorSubject(2);
    1
    👈
    

    View Slide

31. @duffleit
    var counter = new BehaviorSubject(2);
    var doubled = counter.pipe(map(x -> x * 2));
    1
    2
    👈
    

    View Slide

32. @duffleit
    var counter = new BehaviorSubject(2);
    var doubled = counter.pipe(map(x -> x * 2));
    // updating the counter
    counter.emit(3);
    1
    2
    3
    4
    5
    👈
    

    View Slide

33. @duffleit
    var counter = new BehaviorSubject(2);
    var doubled = counter.pipe(map(x -> x * 2));
    // updating the counter
    counter.emit(3);
    assert(doubled.value, 6);
    1
    2
    3
    4
    5
    6
    7
    👈 ✅
    

    View Slide

34. @duffleit
    

    View Slide

35. @duffleit
    var counter = 2;
    1
    👈
    

    View Slide

36. @duffleit
    var counter = 2;
    $: doubled = counter * 2;
    1
    2
    👈
    

    View Slide

37. @duffleit
    var counter = 2;
    $: doubled = counter * 2;
    1
    2
    👈
    

    View Slide

38. @duffleit
    var counter = 2;
    $: doubled = counter * 2;
    // updating the counter
    counter = 3;
    1
    2
    3
    4
    5
    👈
    

    View Slide

39. @duffleit
    var counter = 2;
    $: doubled = counter * 2;
    // updating the counter
    counter = 3;
    assert(doubled, 6);
    1
    2
    3
    4
    5
    6
    7
    👈
    ✅
    

    View Slide

40. @duffleit
    We can apply those
    Concepts of Reactive Programming
    on Architecture as well.
    * and hope they still make sense.
    

    View Slide

41. @duffleit
    User
    <μService>
    Account
    <μService>
    Legder
    <μService>
    WebBanking
    New Payment
    💸
    Perform Payment
    € 20, 00
    👧
    Lisa
    to
    David
    from
    transferMoney
    triggerPayment
    createTransactions
    

    View Slide

42. @duffleit
    User
    <μService>
    Account
    <μService>
    Legder
    <μService>
    WebBanking
    Your payment was
    successfully executed.
    transferMoney
    triggerPayment
    createTransactions
    ✅
    

    View Slide

43. @duffleit
    User
    <μService>
    Account
    <μService>
    Legder
    <μService>
    WebBanking
    New Payment
    💸
    Perform Payment
    € 20, 00
    👧
    Lisa
    to
    David
    from
    transferMoney
    triggerPayment
    createTransactions <μService>
    Legder
    Legder
    <μService>
    

    View Slide

44. @duffleit
    User
    <μService>
    Account
    <μService>
    Legder
    <μService>
    WebBanking
    Your payment was
    successfully executed.
    transferMoney
    triggerPayment
    createTransactions
    ✅
    Retries
    Timeouts
    Circuit Breakers
    Synchronise
    

    View Slide

45. First Generation of MicroServices
    Synchronously Integrated
    @duffleit
    

    View Slide

46. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    <μService>
    Legder
    

    View Slide

47. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    <μService>
    Legder
    

    View Slide

48. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Queue
    <μService>
    Legder
    

    View Slide

49. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Queue
    <μService>
    Legder
    

    View Slide

50. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Queue
    <μService>
    Legder
    

    View Slide

51. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Queue
    <μService>
    Legder
    

    View Slide

52. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Queue
    <μService>
    Legder
    

    View Slide

53. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions Queue
    <μService>
    Legder
    Your payment was
    accepted.
    ✅
    

    View Slide

54. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions Queue
    <μService>
    Legder
    Your payment was
    accepted.
    ✅
    Legder
    <μService>
    

    View Slide

55. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions Queue
    <μService>
    Legder
    Your payment was
    accepted.
    ✅
    Legder
    <μService>
    

    View Slide

56. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions Queue
    <μService>
    Legder
    Your payment was
    accepted.
    ✅
    Legder
    <μService>
    Queue
    

    View Slide

57. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions Queue
    <μService>
    Legder
    Your payment was
    accepted.
    ✅
    Legder
    <μService>
    Queue
    Queue
    

    View Slide

58. Second Generation of MicroServices
    Message-Driven and Asynchronously
    Integrated
    @duffleit
    

    View Slide

59. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Legder
    <μService>
    Queue
    Queue
    Queue
    

    View Slide

60. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Legder
    <μService>
    Queue
    Queue
    Queue
    As a Customer, I want my
    transaction to be booked
    by the ledger.
    

    View Slide

61. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Legder
    <μService>
    Queue
    Queue
    Queue
    As a Customer, I want the
    account service to update
    my balance.
    

    View Slide

62. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    transferMoney
    triggerPayment
    createTransactions
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Legder
    <μService>
    Queue
    Queue
    Queue
    As a Customer, I want
    to transfer money to
    someone else.
    

    View Slide

63. The Entity Service
    Antipattern.
    @duffleit
    

    View Slide

64. Let's create Services along
    Customer Journeys.
    @duffleit
    

    View Slide

65. @duffleit
    “ On the Criteria To Be Used in
    Decomposing Systems into Modules
    — Parnas, 1972
    

    View Slide

66. Let's create Services along
    Customer Journeys.
    @duffleit
    

    View Slide

67. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Legder
    <μService>
    Payments
    <μService>
    Domain Services
    Journey Services
    As a Customer, I want
    to transfer money to
    someone else.
    

    View Slide

68. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Legder
    <μService>
    Web-BFF
    <μService>
    Domain Services
    Backend For Frontends
    As a Customer, I want
    to transfer money to
    someone else.
    Mobile-BFF
    <μService>
    Mobile Banking
    € 20, 00
    Pay
    Payment Flow
    Payment Flow
    

    View Slide

69. @duffleit
    No Domain Logic in
    Backend For Frontends.
    It's about Ui-Specific Aggregation, to get rid
    of over-fetching and over-requesting.
    

    View Slide

70. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Legder
    <μService>
    Payments
    <μService>
    Domain Services
    Journey Services
    

    View Slide

71. @duffleit
    User
    <μService>
    Account
    <μService>
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Legder
    <μService>
    Payments
    <μService>
    Domain Services
    Journey Services
    Balance
    <μService>
    

    View Slide

72. @duffleit
    ⚡
    Customer Journey and Entity Data
    Mismatch Problem
    

    View Slide

73. @duffleit
    Users Accounts Transactions
    Entities
    Customer Journeys
    Payments
    Onboarding
    Fraud Detection
    ⚡
    

    View Slide

74. @duffleit
    User Account
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Transactions
    Payments
    Domain Services
    Journey Services
    Onboarding Fraud Detection
    User Account
    Account Transactions
    

    View Slide

75. @duffleit
    User Account
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Transactions
    Payments
    Domain Services
    Journey Services
    Onboarding Fraud Detection
    User Account
    Account Transactions
    ⚡
    ⚡ ⚡
    

    View Slide

76. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User Account
    Account Transactions
    User
    Account
    Transactions
    Service Autnomy
    

    View Slide

77. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User Account
    Account Transactions
    User
    Account
    Transactions
    Data Duplication
    ⚡
    

    View Slide

78. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User Account
    Account Transactions
    User
    Account
    Transactions
    Data Syncronisation
    🤯
    ⚡
    

    View Slide

79. @duffleit
    clarify who owns which Data.
    Always
    

    View Slide

80. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User Account
    Account Transactions
    User
    Account
    Transactions
    

    View Slide

81. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Synchronous Calls
    😔
    

    View Slide

82. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Synchronous Calls
    😔
    

    View Slide

83. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User Cache
    Account
    Transactions
    Synchronous Calls
    😔
    

    View Slide

84. @duffleit
    “ we project data from our counter variable into our
    doubled variable.
    There must be a better solution
    🤔
    

    View Slide

85. @duffleit
    “ we project the users from our onboarding service
    into our payments service.
    There must be a better solution
    🤔
    Payments
    User
    Onboarding
    User
    project
    

    View Slide

86. @duffleit
    Payments
    Onboarding
    User Aggregate User Readmodel
    UserChangedEvent
    UserChange
    Command
    That's CQRS in a nutshell
    🥜
    update
    

    View Slide

87. @duffleit
    Payments
    Onboarding
    User Aggregate User Readmodel
    UserChangedEvent
    UserChange
    Command
    Stream
    

    View Slide

88. @duffleit
    Payments
    Onboarding
    User Aggregate User Readmodel
    UserChange
    Command
    Stream
    UserChangedEvent
    transform
    apply
    

    View Slide

89. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    

    View Slide

90. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    

    View Slide

91. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    

    View Slide

92. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    

    View Slide

93. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    Projections
    

    View Slide

94. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    Projections
    

    View Slide

95. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    Projections
    

    View Slide

96. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    Projections
    

    View Slide

97. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    

    View Slide

98. @duffleit
    WebBanking
    New Payment
    💸
    € 20, 00
    👧
    Lisa
    to
    David
    from
    Perform Payment
    Payments
    Journey Services
    Onboarding Fraud Detection
    User
    Account
    Account
    Transactions
    User
    Account
    Transactions
    Stream
    Projections
    

    View Slide

99. @duffleit
    But didn't we just introduce
    Eventual Consistency?
    

    View Slide

100. @duffleit
     The different faces of
     Eventual Consistency
     

     View Slide

101. @duffleit
     Eventual Consistency
     Eventual Divergence
     Dashboard
     User (age: 22)
     UserChanged (age: 21)
     UserChanged (age: 22)
     Profile
     User (age: 21)
     ⚡
     timestamp
     timestamp
     

     View Slide

102. @duffleit
     Eventual Consistency
     Eventual Divergence
     Eventual Variance
     Ledger
     Stream
     Transaction (+10€)
     🔥
     

     View Slide

103. @duffleit
     Eventual Consistency
     Eventual Divergence
     Eventual Variance
     Ledger
     Dashboard
     Stream
     🔥 Transaction (+10€) Transaction (+10€)
     Balance: 20€
     

     View Slide

104. @duffleit
     Eventual Consistency
     Eventual Divergence
     Eventual Variance
     Eventual Latency
     Service B
     Stream
     UserChanged (age: 21) UserChanged (age: 22)
     Profile
     User (age: 21)
     Dashboard
     User (age: 21)
     User (age: 22)
     

     View Slide

105. Single User Context
     @duffleit
     Eventual Consistency
     Eventual Divergence
     Eventual Variance
     Eventual Latency
     Service B
     Stream
     UserChanged (age: 21) UserChanged (age: 22)
     Profile
     User (age: 21)
     Dashboard
     User (age: 21)
     User (age: 22)
     🕰
     

     View Slide

106. @duffleit
     Eventual Consistency
     Eventual Divergence
     Eventual Variance
     Eventual Latency
     same events, different results.
     same events, different quantity.
     same events, different realisation.
     Ordering Guarantees
     Optimistic UIs
     At-Least-Once
     Delivery
     Deduplication
     Mechanisms
     

     View Slide

107. @duffleit
     tl/dr:
     Eventual Consistency is
     often used as a
     knock-out argument
     @duffleit
     

     View Slide

108. @duffleit
     tl/dr:
     Eventual Consistency is
     often used as a
     knock-out argument
     but isn't, in most cases.
     @duffleit
     

     View Slide

109. @duffleit
     WebBanking
     New Payment
     💸
     € 20, 00
     👧
     Lisa
     to
     David
     from
     Perform Payment
     Payments
     Journey Services
     Onboarding Fraud Detection
     User
     Account
     Account
     Transactions
     User
     Account
     Transactions
     Stream
     Projections
     

     View Slide

110. @duffleit
     Mobile Banking Usage
     93% — Show balance & last transactions
     3% — Initiate new payment
     4% — Any other functionality
     

     View Slide

111. @duffleit
     Payments
     Journey Services
     Onboarding Overview
     User
     Account
     Account
     Transactions
     User
     Account
     Transactions
     Stream
     

     View Slide

112. @duffleit
     Payments
     Journey Services
     Onboarding Overview
     User
     Account
     Account
     Transactions
     User
     Account
     Transactions
     Stream
     

     View Slide

113. @duffleit
     Payments
     Journey Services
     Onboarding Overview
     User
     Account
     Account
     Transactions
     User
     Account
     Transactions
     Stream
     

     View Slide

114. @duffleit
     Payments
     Journey Services
     Onboarding Overview
     User
     Account
     Account
     Transactions
     User
     Account
     Transactions
     Stream
     

     View Slide

115. @duffleit
     Payments
     Journey Services
     Onboarding Overview
     User
     Account
     Account
     Transactions
     User
     Account
     Transactions
     Stream
     

     View Slide

116. @duffleit
     Payments
     Journey Services
     Onboarding Overview
     User
     Account
     Account
     Transactions
     User
     Account
     Transactions
     Stream
     93% of what our users need
     can still be performed.
     WebBanking
     Current Balance: 200€
     👧
     You sent Lisa 100€
     Christoph sent you 300€
     

     View Slide

117. @duffleit
     WebBanking
     Current Balance: 200€
     👧
     You sent Lisa 100€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     Overview
     Transactions
     We can easily scale
     horizontally.
     

     View Slide

118. @duffleit
     WebBanking
     Current Balance: 200€
     👧
     You sent Lisa 100€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     Overview
     Transactions
     We can easily scale
     horizontally.
     

     View Slide

119. @duffleit
     WebBanking of David
     Current Balance: 300€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     

     View Slide

120. @duffleit
     WebBanking of David
     Current Balance: 300€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     

     View Slide

121. @duffleit
     WebBanking of David
     Current Balance: 300€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     

     View Slide

122. @duffleit
     WebBanking of David
     Current Balance: 300€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     

     View Slide

123. @duffleit
     WebBanking of David
     Current Balance: 300€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     

     View Slide

124. @duffleit
     WebBanking of David
     Current Balance: 300€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     

     View Slide

125. @duffleit
     WebBanking of David
     Current Balance: 300€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     

     View Slide

126. @duffleit
     WebBanking of David
     Current Balance: 300€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     👧
     Lisa sent you 20€
     

     View Slide

127. @duffleit
     WebBanking of David
     Current Balance: 320€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     👧
     Lisa sent you 20€
     

     View Slide

128. @duffleit
     WebBanking of David
     Current Balance: 320€
     Christoph sent you 300€
     Payments
     Journey Services
     Onboarding Overview
     User Account
     Transactions
     User
     Account
     Transactions
     Stream
     WebBanking of Lisa
     👧
     New Payment
     💸
     € 20, 00 David
     to
     👧
     Lisa
     from
     Perform Payment
     👧
     Lisa sent you 20€
     GraphQL
     subscriptions
     mutations
     Out-of-the-box
     real-time
     capabilities.
     

     View Slide

129. @duffleit
     WebBanking of David
     Current Balance: 320€
     Christoph sent you 300€
     Payments
     Journey Services
     Legacy System
     Accounts
     Stream
     👧
     Lisa sent you 20€
     User
     😮 💨😮 💨
     😮 💨
     Change Data
     Capture (CDC) User User
     

     View Slide

130. Third Generation of MicroServices
     Built on Reactive Data-Streams
     @duffleit
     High Resilience
     🔥
     Horizontal Scaling ↔
     Real Time Integration
     ⏱
     Good Integration with Legacy Systems
     🏚
     

     View Slide

131. Dimensions of Scaling
     @duffleit
     Vertical
     Horizontal
     Service
     

     View Slide

132. Dimensions of Scaling
     @duffleit
     Vertical
     Horizontal
     Service
     

     View Slide

133. Dimensions of Scaling
     Vertical
     Horizontal
     Service Service Service
     Stream
     

     View Slide

134. Dimensions of Scaling
     Vertical
     Horizontal
     Service Service Service
     Stream
     

     View Slide

135. Dimensions of Scaling
     Vertical
     Horizontal
     Service Service Service
     Sharding
     

     View Slide

136. Dimensions of Scaling
     Vertical
     Horizontal
     Service
     Service
     Service
     Sharding
     Users A-H
     Users I-P
     Users Q-Z
     

     View Slide

137. Dimensions of Scaling
     Vertical
     Horizontal
     Service
     Service
     Service
     User from
     User from
     Users from
     Service Service
     Service
     Sharding
     

     View Slide

138. @duffleit
     UserTriggeredPayment
     

     View Slide

139. @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     

     View Slide

140. @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     

     View Slide

141. @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     

     View Slide

142. @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     ValidPaymentReceived
     

     View Slide

143. @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     Stream
     ValidPaymentReceived
     Partition 0 Partition 1 Partition 2
     

     View Slide

144. Fraud Detection Fraud Detection
     @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     Stream
     ValidPaymentReceived
     Partition 0 Partition 1 Partition 2
     Fraud Detection
     PaymentCheckedAgainstFraud
     

     View Slide

145. Fraud Detection Fraud Detection
     @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     Stream
     ValidPaymentReceived
     Partition 0 Partition 1 Partition 2
     Fraud Detection
     Stream
     PaymentChecked
     Partition 0 Partition 1 Partition 2
     

     View Slide

146. Fraud Detection Fraud Detection
     @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     Stream
     ValidPaymentReceived
     Partition 0 Partition 1 Partition 2
     Fraud Detection
     Stream
     PaymentChecked
     Partition 0 Partition 1 Partition 2
     Ledger Ledger Ledger
     TransactionBooked
     

     View Slide

147. Fraud Detection Fraud Detection
     @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     Stream
     ValidPaymentReceived
     Partition 0 Partition 1 Partition 2
     Fraud Detection
     Stream
     PaymentChecked
     Partition 0 Partition 1 Partition 2
     Ledger Ledger Ledger
     Partition 0 Partition 1 Partition 2
     Stream
     TransactionBooked
     

     View Slide

148. Fraud Detection Fraud Detection
     @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     Stream
     ValidPaymentReceived
     Partition 0 Partition 1 Partition 2
     Fraud Detection
     Partition 0 Partition 1 Partition 2
     Ledger Ledger Ledger
     Partition 0 Partition 1 Partition 2
     Projecting
     Transactions
     Streams
     Flink
     Stream
     PaymentChecked
     Stream
     TransactionBooked
     Independent Shards
     

     View Slide

149. Fraud Detection Fraud Detection
     @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     Stream
     ValidPaymentReceived
     Partition 0 Partition 1 Partition 2
     Fraud Detection
     Stream
     PaymentChecked
     Partition 0 Partition 1 Partition 2
     Ledger Ledger Ledger
     Partition 0 Partition 1 Partition 2
     Stream
     TransactionBooked
     Shard 0 Shard 1 Shard 2
     DataSink
     Streams
     Flink
     Projecting
     Transactions
     WebBanking WebBanking WebBanking
     

     View Slide

150. Fraud Detection Fraud Detection
     @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     Stream
     ValidPaymentReceived
     Partition 0 Partition 1 Partition 2
     Fraud Detection
     Stream
     PaymentChecked
     Partition 0 Partition 1 Partition 2
     Ledger Ledger Ledger
     Partition 0 Partition 1 Partition 2
     Stream
     TransactionBooked
     Shard 0 Shard 1 Shard 2
     DataSink
     Streams
     Flink
     Projecting
     Transactions
     WebBanking WebBanking WebBanking
     

     View Slide

151. Fraud Detection Fraud Detection
     @duffleit
     Stream
     UserTriggeredPayment Partition 0 Partition 1 Partition 2
     UserTriggeredPayment
     Payments Payments Payments
     Stream
     ValidPaymentReceived
     Partition 0 Partition 1 Partition 2
     Fraud Detection
     Stream
     PaymentChecked
     Partition 0 Partition 1 Partition 2
     Ledger Ledger Ledger
     Partition 0 Partition 1 Partition 2
     Stream
     TransactionBooked
     Shard 0 Shard 1 Shard 2
     DataSink
     🚀 We can scale
     nearly unlimited.
     Projecting
     Transactions
     WebBanking WebBanking WebBanking
     

     View Slide

152. Forth Generation of MicroServices
     Shared and fully Stream Based
     @duffleit
     Massive Throughput
     🚀
     Extremely Scalable ↔
     

     View Slide

153. So many choices,
     Lets sum up.
     @duffleit
     

     View Slide

154. Monolith
     @duffleit
     

     View Slide

155. Monolith
     @duffleit
     

     View Slide

156. Syncronously
     😩 Pain
     @duffleit
     

     View Slide

157. Modulith
     @duffleit
     

     View Slide

158. Asyncronously
     📦 Shared Data
     @duffleit
     

     View Slide

159. Reactive
     ⚡ From Pull to Push
     @duffleit
     

     View Slide

160. Streaming Massiv Throughput
     🚀
     @duffleit
     

     View Slide

161. Monolith Reactive
     Push-Based
     Async
     Pull-Based
     Streamed
     Availability
     🟢
     , Resilience
     🦺
     , Scalability ↔ , Throughput
     🚀
     Complexity
     💰
     @duffleit
     

     View Slide

162. Monolith Reactive
     Push-Based
     Async
     Pull-Based
     Streamed
     @duffleit
     The Rise of Reactive Microservices.
     And the future of fully Stream Based Architectures.
     

     View Slide

163. David Leitner
     @duffleit
     Coding Architect
     david@squer.at
     @duffleit
     

     View Slide

164. squer.link /
     slicing-microservices
     

     View Slide