Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=47 Patrick Van Stee
December 14, 2012
Programming
4
350

Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=128

Patrick Van Stee

December 14, 2012
Tweet

More Decks by Patrick Van Stee

See All by Patrick Van Stee
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
115
4.7k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
3
530
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
8
490
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
11
340
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
20
1.7k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
1
110
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
4
260
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
10
450

Other Decks in Programming

See All in Programming
Fa54d97af93719f9aa82873de3acb3b3?s=48 decoc
1
470
D360f2c7f29fa7e28e3e648031fbe2f3?s=48 kajyuuen
0
110
41a66760b3483d518d9e48a7da37f91b?s=48 shibadog1121
9
1.7k
C302e84057a922dce0ecbe80207e3fcc?s=48 mu_zaru
1
210
137d3908243acfc30e126615d59d4e6d?s=48 glaforge
0
260
1652e9ff825e902738efa399389878df?s=48 youta1119
0
120
7eca3e06edc3c69004aaf57de51900c2?s=48 ajstarks
2
310
Bf3acef686273e03fa4fdf125fdad3e9?s=48 kuncevic
0
120
80a3a3857a55f154d23acb705eff72cc?s=48 star_zero
3
140
9fbbe5d0b8e2ee1cdc3a576b55a2d63d?s=48 uzimaru0000
0
240
0fb2ce77513181750c384115cd0bc937?s=48 ksukenobe
0
190
D882856fd493248c73331872a516d1b5?s=48 exsoul
1
120

Featured

See All Featured
Dad095ea7038f89f760419ce475d5d14?s=48 michaelherold
224
8.2k
6bb82b13cda86d3b821fa44100335ddf?s=48 thoeni
2
300
3d4519fd34b76fb265fc0237f3792bd4?s=48 danielanewman
196
19k
C620790ae5bf5b50c245b2e0ef95f338?s=48 deanohume
293
27k
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
86
11k
E6c6e133e74c3b83f04d2861deaa1c20?s=48 searls
202
35k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
266
16k
E43f8dfd01057f8304f5f8fb9a294d7d?s=48 jeffersonlam
323
14k
C1daf20e5c49ff910745198ef9869ac2?s=48 hatefulcrawdad
257
16k
462dad0dd24c568a32dcdb0ae895ae1b?s=48 rasmusluckow
314
18k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
319
53k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
28
3.1k

Transcript

  1. Convergent Replicated Data Types

  2. @vanstee vanstee@bignerdranch.com Patrick Van Stee

  3. “Structuring data so conflict resolution is automatic”

  4. Dynamo Trade consistency for availability and partition tolerance

  5. Node 1 Node 2 { a: “200” } { a:

    “-3000” } :(

  6. Node 1 Node 2 { a: “200” } { a:

    “-3000” } { a: “200”, a: “-3000” } Riak

  7. CRDT •Counter •Set •Graph •List •Tree

  8. CRDT •Counter •Set •Graph •List •Tree

  9. Counter •Can only be increased •Merge: use largest value

  10. Chat Room Karma Fault-Tolerant Distributed

  11. Serious Business { SB[PVS]: 0} Serious Coding { SB[PVS]: 1}

    # PVS++ { SC[PVS]: 0} { SC[PVS]: 5} # PVS += 5 { SB[PVS]: 2} # PVS++ Merge { SB[PVS]: 2, SC[PVS]: 5} { SB[PVS]: 1, SC[PVS]: 5} { SB[PVS]: 2, SC[PVS]: 5} { PVS: 7}

  12. What about decrements? Use separate counters for positive and negative.

    Take the difference for the result.

  13. Serious Business { SB[PVS+]: 0, SB[PVS-]: 0 } Serious Coding

    { SB[PVS+]: 1, SB[PVS-]: 0 } # PVS++ { SB[PVS+]: 0, SB[PVS-]: 0 } { SB[PVS+]: 5, SB[PVS-]: 0 } # PVS += 5 { SB[PVS+]: 1, SB[PVS-]: 1 } # PVS-- Merge { PVS+: 6, PVS-: 1 } { PVS+: 6, PVS-: 0 } { PVS+: 6, PVS-: 1 } { PVS: 5 }

  14. Set •Can only be added to •Merge: take the union

  15. Serious Business { PVS: [ ] } Serious Coding {

    PVS: [] } { PVS: [] } { PVS: [ ] } Merge { PVS: [ , ] } { PVS: [ , ] } { PVS: [ , , ] } { PVS: [ , , ] }

  16. Hold on, Can we remove stuff? Use separate sets for

    added and removed elements.

  17. Serious Business { PVS+: [ ], PVS-: [] } Serious

    Coding { PVS+: [], PVS-: [] } { PVS+: [], PVS-: [] } { PVS+: [ ], PVS-: [] } Merge { PVS+: [ , ], PVS-: [ ] } { PVS+: [ ], PVS-: [ ] } { PVS+: [ , ], PVS-: [] } { PVS+: [ , ], PVS-: [ ] } { PVS: [ ] }

  18. But wait, we can only remove once?

  19. U-Set •Append unique values to all set members •Garbage collection

    becomes an issue

  20. basho/riak_dt Demo

  21. Use Cases •Like button •Page Views •Shopping Cart

  22. Reference •INRIA paper •basho/riak_dt •RICON talk

  23. Beginning Ruby on Rails Course bignerdranch.com/classes/beginning_ruby_on_rails