Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=47 Patrick Van Stee
December 14, 2012
Programming
4
360

Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=128

Patrick Van Stee

December 14, 2012
Tweet

More Decks by Patrick Van Stee

See All by Patrick Van Stee
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
116
4.8k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
3
540
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
8
500
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
11
350
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
22
1.8k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
1
120
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
4
260
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
10
470

Other Decks in Programming

See All in Programming
285cc95c4c9fe056b03afca581533266?s=48 fkubota
1
390
Ca17a082a30f4cbfed1d0a6dacbe3af2?s=48 shin1x1
0
590
A7a5efde86e0137d32a93d8609b7a022?s=48 yumcyawiz
4
610
D76231a2114896dfcc7b79ac69558b79?s=48 yosuke_furukawa
PRO
13
3.6k
E473e5af1263c050599921981db46068?s=48 akatsukinewgrad
0
150
1d5a7a934b466ede82b89a39b1404c0b?s=48 daiki1020
0
1.1k
1623dd1adf096ba35ba33727d933e14c?s=48 nbkouhou
0
790
E4acf8d83d816ef2ff215fb99401469f?s=48 pdone
0
210
7975b9fd58c8945ae1c6b38747de7f28?s=48 line_developers_tw2
0
620
B793da271a45d149b52f507bca9f137c?s=48 77web
0
210
5c588fdfe782f92fa6b081903edd82bb?s=48 hr01
0
1.6k
7eca3e06edc3c69004aaf57de51900c2?s=48 ajstarks
2
550

Featured

See All Featured
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
17
1.1k
3d6ace9554821d552146413bcdf874f6?s=48 trishagee
20
2k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
27
1.9k
D8fc2580cfaca035f666d9e4ee79a7f7?s=48 mongodb
23
3.8k
719435d98d452de7ac367c828266cf01?s=48 erikaheidi
13
4.2k
245cee81a9c424266e5e401d844ea881?s=48 lara
172
9.5k
B83d5b590577969ee79a5ad845411a7d?s=48 ammeep
656
54k
E4f5d494ebdc9e7cce1aecf3ce3e8bc1?s=48 shpigford
368
42k
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
283
47k
761be20b5ebd271008bcee1244fc5b52?s=48 matthewcrist
73
7.5k
7c8469ee8c9e594c65c59b919626c08d?s=48 scottboms
251
11k
C44e1f7e22c3f23cff7bc130871047ef?s=48 eileencodes
113
25k

Transcript

  1. Convergent Replicated Data Types

  2. @vanstee vanstee@bignerdranch.com Patrick Van Stee

  3. “Structuring data so conflict resolution is automatic”

  4. Dynamo Trade consistency for availability and partition tolerance

  5. Node 1 Node 2 { a: “200” } { a:

    “-3000” } :(

  6. Node 1 Node 2 { a: “200” } { a:

    “-3000” } { a: “200”, a: “-3000” } Riak

  7. CRDT •Counter •Set •Graph •List •Tree

  8. CRDT •Counter •Set •Graph •List •Tree

  9. Counter •Can only be increased •Merge: use largest value

  10. Chat Room Karma Fault-Tolerant Distributed

  11. Serious Business { SB[PVS]: 0} Serious Coding { SB[PVS]: 1}

    # PVS++ { SC[PVS]: 0} { SC[PVS]: 5} # PVS += 5 { SB[PVS]: 2} # PVS++ Merge { SB[PVS]: 2, SC[PVS]: 5} { SB[PVS]: 1, SC[PVS]: 5} { SB[PVS]: 2, SC[PVS]: 5} { PVS: 7}

  12. What about decrements? Use separate counters for positive and negative.

    Take the difference for the result.

  13. Serious Business { SB[PVS+]: 0, SB[PVS-]: 0 } Serious Coding

    { SB[PVS+]: 1, SB[PVS-]: 0 } # PVS++ { SB[PVS+]: 0, SB[PVS-]: 0 } { SB[PVS+]: 5, SB[PVS-]: 0 } # PVS += 5 { SB[PVS+]: 1, SB[PVS-]: 1 } # PVS-- Merge { PVS+: 6, PVS-: 1 } { PVS+: 6, PVS-: 0 } { PVS+: 6, PVS-: 1 } { PVS: 5 }

  14. Set •Can only be added to •Merge: take the union

  15. Serious Business { PVS: [ ] } Serious Coding {

    PVS: [] } { PVS: [] } { PVS: [ ] } Merge { PVS: [ , ] } { PVS: [ , ] } { PVS: [ , , ] } { PVS: [ , , ] }

  16. Hold on, Can we remove stuff? Use separate sets for

    added and removed elements.

  17. Serious Business { PVS+: [ ], PVS-: [] } Serious

    Coding { PVS+: [], PVS-: [] } { PVS+: [], PVS-: [] } { PVS+: [ ], PVS-: [] } Merge { PVS+: [ , ], PVS-: [ ] } { PVS+: [ ], PVS-: [ ] } { PVS+: [ , ], PVS-: [] } { PVS+: [ , ], PVS-: [ ] } { PVS: [ ] }

  18. But wait, we can only remove once?

  19. U-Set •Append unique values to all set members •Garbage collection

    becomes an issue

  20. basho/riak_dt Demo

  21. Use Cases •Like button •Page Views •Shopping Cart

  22. Reference •INRIA paper •basho/riak_dt •RICON talk

  23. Beginning Ruby on Rails Course bignerdranch.com/classes/beginning_ruby_on_rails