Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=47 Patrick Van Stee
December 14, 2012
Programming
4
360

Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=128

Patrick Van Stee

December 14, 2012
Tweet

More Decks by Patrick Van Stee

See All by Patrick Van Stee
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
118
4.9k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
3
550
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
8
500
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
11
350
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
22
1.8k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
1
120
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
4
260
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
10
480

Other Decks in Programming

See All in Programming
3179e6bb62dc91d29bb906ffef4fa2d4?s=48 marcoow
0
170
Ee974eb4dea26c2f17f42460366bb745?s=48 progate
2
520
D0a6969000c3715087b3a00abd646d20?s=48 timeseriesfr
0
120
C4d991702dcb0afa2b2afd8464be7f66?s=48 sysrich
0
250
D07d36d7d3263da869c7d030ba4a64a6?s=48 y__mattu
0
210
9e32efa81b675ecd55c166fb7b0a1890?s=48 clusterinc
0
280
394576121c6b861048493988254160dd?s=48 tarappo
4
440
5155c9bc5b30d9e2a8fd677695887861?s=48 kaonash
2
1.9k
E0e036f89c14b3e59640318eedf9670b?s=48 bkuhlmann
4
300
14d83dc17e2c893d7564b609ff8da4ca?s=48 techharmony
0
180
1d1580fb0945b0ffadff18e28bead3c5?s=48 adarapata
1
470
8ec2b967e38f000eb63ae345cd7c58e6?s=48 minodriven
37
28k

Featured

See All Featured
E14f55d3f939977cecbf51b64ff6f861?s=48 keithpitt
402
20k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
PRO
54
4.3k
Aff5641764408271f7bc398f2097edd0?s=48 denniskardys
220
120k
812e1705ff0f8bc1bcf18587bde687d5?s=48 62gerente
586
200k
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
242
21k
245cee81a9c424266e5e401d844ea881?s=48 lara
17
2.9k
78b475797a14c84799063c7cd073962f?s=48 holman
462
280k
A9704266587836f7e784235e5073b93e?s=48 jmmastey
11
700
C4de88ea47538e4594750e3861a341c8?s=48 brettharned
93
3.1k
2f5463832ccb768ccb4a1ca3607c27ef?s=48 jacobian
257
20k
Dad095ea7038f89f760419ce475d5d14?s=48 michaelherold
226
8.6k
3d4519fd34b76fb265fc0237f3792bd4?s=48 danielanewman
202
20k

Transcript

  1. Convergent Replicated Data Types

  2. @vanstee vanstee@bignerdranch.com Patrick Van Stee

  3. “Structuring data so conflict resolution is automatic”

  4. Dynamo Trade consistency for availability and partition tolerance

  5. Node 1 Node 2 { a: “200” } { a:

    “-3000” } :(

  6. Node 1 Node 2 { a: “200” } { a:

    “-3000” } { a: “200”, a: “-3000” } Riak

  7. CRDT •Counter •Set •Graph •List •Tree

  8. CRDT •Counter •Set •Graph •List •Tree

  9. Counter •Can only be increased •Merge: use largest value

  10. Chat Room Karma Fault-Tolerant Distributed

  11. Serious Business { SB[PVS]: 0} Serious Coding { SB[PVS]: 1}

    # PVS++ { SC[PVS]: 0} { SC[PVS]: 5} # PVS += 5 { SB[PVS]: 2} # PVS++ Merge { SB[PVS]: 2, SC[PVS]: 5} { SB[PVS]: 1, SC[PVS]: 5} { SB[PVS]: 2, SC[PVS]: 5} { PVS: 7}

  12. What about decrements? Use separate counters for positive and negative.

    Take the difference for the result.

  13. Serious Business { SB[PVS+]: 0, SB[PVS-]: 0 } Serious Coding

    { SB[PVS+]: 1, SB[PVS-]: 0 } # PVS++ { SB[PVS+]: 0, SB[PVS-]: 0 } { SB[PVS+]: 5, SB[PVS-]: 0 } # PVS += 5 { SB[PVS+]: 1, SB[PVS-]: 1 } # PVS-- Merge { PVS+: 6, PVS-: 1 } { PVS+: 6, PVS-: 0 } { PVS+: 6, PVS-: 1 } { PVS: 5 }

  14. Set •Can only be added to •Merge: take the union

  15. Serious Business { PVS: [ ] } Serious Coding {

    PVS: [] } { PVS: [] } { PVS: [ ] } Merge { PVS: [ , ] } { PVS: [ , ] } { PVS: [ , , ] } { PVS: [ , , ] }

  16. Hold on, Can we remove stuff? Use separate sets for

    added and removed elements.

  17. Serious Business { PVS+: [ ], PVS-: [] } Serious

    Coding { PVS+: [], PVS-: [] } { PVS+: [], PVS-: [] } { PVS+: [ ], PVS-: [] } Merge { PVS+: [ , ], PVS-: [ ] } { PVS+: [ ], PVS-: [ ] } { PVS+: [ , ], PVS-: [] } { PVS+: [ , ], PVS-: [ ] } { PVS: [ ] }

  18. But wait, we can only remove once?

  19. U-Set •Append unique values to all set members •Garbage collection

    becomes an issue

  20. basho/riak_dt Demo

  21. Use Cases •Like button •Page Views •Shopping Cart

  22. Reference •INRIA paper •basho/riak_dt •RICON talk

  23. Beginning Ruby on Rails Course bignerdranch.com/classes/beginning_ruby_on_rails