Scala With Cats: Case Study: CRDTs

Transcript

1. Scala with Cats Case Study: CRDTs https://underscore.io/books/scala-with-cats/
2. CRDTs • Commutative Replicated Data Types • or Conflict-free Replicated Data Types • ݁Ռ੔߹ੑͷ͋Δσʔλߏ଄ • ϞϊΠυ͕ͲͷΑ͏ʹ໾ཱ͔ͭͷྫͱͯ͠CRDTsΛ঺հ
3. Consistency • γεςϜ͕εέʔϧ͢Δͱ୯ҰͷϚγϯΛ௒͑ͯσʔλ Λ؅ཧ͠ͳ͍ͱ͍͚ͳ͘ͳΔ • શͯͷϚγϯ͕ಉ͡σʔλΛ࣋ͭ؀ڥΛ૝ఆ͢Δ • 1ͭͷϚγϯ͕ϢʔβͷύεϫʔυΛߋ৽͢Δͱɺ
 શ୆ͷϚγϯ͕ಉ͡ίϐʔΛ࣋ͭ • શ୆ͷϚγϯ͕ͦΕΛड͚ೖΕͨ͋ͱ
 ͦͷૢ࡞͸׬ྃ͢Δ
4. Eventual Consistency • લϖʔδͷྫͩͱ੔߹ੑ͕อͯΔ͕ɺ1ͭͷૢ࡞ͷͨΊʹશ୆ ͱಉظΛͱΔͷͰϨΠςϯγ͕ѱԽ͢Δ • ωοτϫʔΫো֐ʹΑΔ෼அ΋ൃੜ͢Δ • ੔߹ੑΛอͭͨΊʹ͸ૢ࡞Λڋ൱͢Δ͔͠ͳ͍ • ݁Ռ੔߹ੑͷ͋ΔγεςϜͰ͸֤Ϛγϯ͕Ұ࣌తʹҟͳΔ
 ঢ়ଶΛ࣋ͭࣄΛڐ༰͢Δ • ݁Ռతʹ੔߹ੑ͕औΕΕ͹͍͍ͷͰૢ࡞ʹର͢ΔԠ౴͸
 ૣ͘ͳΔ • ωοτϫʔΫো֐ʹΑΔ෼அ͕ൃੜͯ͠΋ॲཧΛܧଓͰ͖Δ
5. CRDT • ͲͷΑ͏ʹͯ͠ϚγϯؒͰ݁Ռ੔߹ੑΛऔΔͷ͔ʁ • CRDT͕ͻͱͭͷղͱͳΔ • Commutative Replicated Data Types • CRDTͷ࣮૷ͷͻͱͭͱͯ͠G-CounterΛ঺հ͢Δ
6. G-Counters • ෼ࢄΧ΢ϯλͱͯ͠࢖͑Δ • ૿Ճ͢ΔΦϖϨʔγϣϯʹͷΈରԠ͢Δ • webαʔόͷ๚໰ऀͷΧ΢ϯτ౳ʹ࢖͑Δ
7. Simple counters • ୯ʹड͚औͬͨϦΫΤετ਺Λ௨஌ͯ͠଍͠߹ΘͤΔ
8. Simple counters • ௥ՃͰϦΫΤετ͕དྷͨͱ͖ʹΧ΢ϯλͷ஋Λ଍্͠ ͛Δͱ͓͔͘͠ͳΔ • 2୆ͱ΋"6"Λอ͍࣋ͯ͠ͳ͍ͱ͍͚ͳ͍͸ͣ…
9. G-Counters • G-Counter͸֤ϚγϯͷΧ΢ϯλΛ͍࣋ͬͯΔ • ஋ΛΠϯΫϦϝϯτͰ͖Δͷ͸ࣗ෼ͷΧ΢ϯλ͚ͩ • ঢ়ଶߋ৽ͷϝοηʔδ͕དྷͨΒɺͦͷϚγϯͷΧ΢ ϯλͷ࠷େ஋Ͱஔ͖׵͑Δ(Grow only)
10. G-Counters • ͦͷϚγϯͷΧ΢ϯλͷ࠷େ஋Ͱஔ͖׵͑Δ
11. 11.2.3 Exercise: GCounter Implementation • G-CounterΛ࣮૷ͯ͠Έ·͠ΐ͏ • counter: Map[String, Int] • key͕machine id, value͕Χ΢ϯτ • increment: GCounter • ࢦఆͨ͠machineͷΧ΢ϯτΛࢦఆͨ͠
 amount͚ͩ଍͢ • merge: GCounter • 2ͭͷGCounterΛϚʔδ͢Δ
12. 11.2.3 Exercise: GCounter Implementation • G-CounterΛ࣮૷ͯ͠Έ·͠ΐ͏
13. Additional Exercise: PN-Counter Implementation • PN-CounterΛ࣮૷ͯ͠Έ·͠ΐ͏ • Ҿ͖ࢉ΋Մೳʹͨ͠CRDTs (Positive, Negative)
14. Additional Exercise: PN-Counter Implementation • PN-CounterΛ࣮૷ͯ͠Έ·͠ΐ͏ • Ҿ͖ࢉ΋Մೳʹͨ͠CRDTs
15. Generalisation • ͖͞΄ͲͷG-CounterΛந৅Խ͍ͯ͘͠ • G-Counter͸ • Ճࢉ: ΠϯΫϦϝϯτ͞Εͨ߹ܭ஋Λ࣋ͭ • ࠷େ஋: Ϛʔδ࣌͸࠷େ஋Λ࣋ͭ • ॳظ஋͸ 0 • => ϞϊΠυͰ͋Δ • (a + b) + c == a + (b + c) • 0 + a == a + 0 == a • a max a = a (mergeͷૢ࡞͸ႈ౳ੑ͕͋Δ)
16. Generalisation • ͖͞΄ͲͷG-CounterΛந৅Խ͍ͯ͘͠ • increment: monoid • total: monoid + Մ׵ • merge: monoid + ႈ౳ + Մ׵ • => ༗ք൒ଋͱݴ͏
17. Generalisation • લड़ͷಛ௃ΑΓɺGCounter͸ࣗવ਺ͱಉ༷ͳૢ࡞͕Ͱ ͖Δ΋ͷʹ΋ஔ͖׵͑ΒΕΔ • ࣗવ਺ͷ୅ΘΓʹSet[A]Λ࢖ͬͯGSetͱ͍͏ܕΛ࣮૷ ͢Δ͜ͱ΋Ͱ͖Δ͸ͣ
18. Bounded SemiLattice • ༗ք൒ଋ • https://qiita.com/yasuabe2613/items/ ba2c5136a4e0822b6ba4
19. 11.3.2 Exercise: BoundedSemiLattice Instances • IntͱSet༻ͷ༗ք൒ଋΛ࣮૷ͯ͠Έ·͠ΐ͏ • Int͸ࣗવ਺(0ΛؚΉ)͔࣋ͨ͠ͳ͍ͱԾఆͯ͠Α͍
20. 11.3.2 Exercise: BoundedSemiLattice Instances • IntͱSet༻ͷ༗ք൒ଋΛ࣮૷ͯ͠Έ·͠ΐ͏ • Int͸ࣗવ਺(0ΛؚΉ)͔࣋ͨ͠ͳ͍ͱԾఆͯ͠Α͍
21. 11.3.3 Exercise:Generic G-Counter • MonoidͱBoundedSemiLatticeΛ࢖ͬͯGCounterΛ
 ࣮૷͠·͠ΐ͏ • Monoidͷจ๏Λ࢖ͬͯγϯϓϧʹॻ͖·͠ΐ͏
22. Abstracting G-Counter to a Type Class • TypeClassΛ࢖ͬͯG-CounterΛ͞Βʹந৅Խ͢Δ • Map΋2ͭͷܕύϥϝʔλΛऔΔԿ͔ͳΒΑ͍ͷͰ͸
23. Abstracting a Key Value Store • Map͸KVSʹஔ͖׵͑ΒΕΔ͸ͣ • Mapͩͬͨ෦෼Λந৅Խ͢Δ
24. Abstracting a Key Value Store • Map͸KVSʹஔ͖׵͑ΒΕΔ͸ͣ • σʔλܕͷૢ࡞Λ֦ு͢Δimplicit class
25. Abstracting a Key Value Store • KVS͕ந৅ԽͰ͖ͨ͜ͱͰKVSͷ࢓༷Λຬ͍ͨͯ͠Ε͹ ͲΜͳܕͰ΋G-Counter͕࡞ΕΔΑ͏ʹͳͬͨ
26. Summary • γϯϓϧͳCRDTͰ͋ΔG-CounterΛTypeClassΛ༻͍ͯ Ͳ͏࣮૷͢Δ͔Λࣔͨ͠ • ίʔυͷ࠶ར༻ੑΛߴΊɺΧ΢ϯτ͢Δͱ͍͏ૢ࡞ʹ ͚ͩʹറΒΕͳ͘ͳͬͨ • ଞʹ΋CRDTs͸͍Ζ͍Ζ͋ΔͷͰҎԼΛࢀߟʹ • https://hal.inria.fr/inria-00609399v2/document