Save 37% off PRO during our Black Friday Sale! »

Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=47 Patrick Van Stee
December 14, 2012
Programming
4
410

Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=128

Patrick Van Stee

December 14, 2012
Tweet

More Decks by Patrick Van Stee

See All by Patrick Van Stee
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
123
5.2k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
3
560
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
8
510
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
11
350
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
22
2k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
1
130
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
4
260
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
10
490

Other Decks in Programming

See All in Programming
58b40ae3b0db6cf0202a3802e9dd70fe?s=48 cockscomb
0
420
Ec2fcdc4ea7905b289967a2c4c43e154?s=48 sgeengineer
0
210
893f54413c2bd9ba41d11d753aacaf2c?s=48 quramy
6
1.7k
B04bd8797ce182483a5ded98f7cada6f?s=48 berlysia
14
3.7k
82d6167c4d14393c2e20b37a74b363c5?s=48 kasacchiful
0
130
D14332b39b012820d44d362a3e2a8d98?s=48 shibe23
4
1.5k
9a5d3eac40dd7a3a8d5373b22145fa88?s=48 sntree2mi8
0
120
91b03a57e0ef56fee59fbddc66a7f6fd?s=48 takasehideki
1
120
A1792748885fe8f2555d9c718ee7ae53?s=48 joytomo
1
230
023b04c98f39cc041293d780352432ff?s=48 koic
11
970
635e53b96114c922fa5486b418895960?s=48 fadis
7
4.4k
67d6b5b2fdd654b6fbd49b5c7771d678?s=48 1pay
0
170

Featured

See All Featured
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
224
15k
0bce06bd06ee7a2c4f5500f25dcf7f18?s=48 paulrobertlloyd
72
3.9k
3d4519fd34b76fb265fc0237f3792bd4?s=48 danielanewman
208
20k
Fe6b81005d1553accd6b2a28f6a2bef1?s=48 phodgson
92
4.2k
Aff5641764408271f7bc398f2097edd0?s=48 denniskardys
223
120k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
122
16k
E195ae45320d9202eaa01c9f1d31a416?s=48 marktimemedia
15
750
A0517b08532aec8ab2aae3f65d40ad86?s=48 hannesfritz
32
1.2k
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
196
17k
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
85
8.2k
0438ae60cde4c7add6f9da48f28c15cc?s=48 chrisshort
6
28k
A16eb159db895e3b01d3dc95767ad595?s=48 jonyablonski
40
1.8k

Transcript

  1. Convergent Replicated Data Types

  2. @vanstee vanstee@bignerdranch.com Patrick Van Stee

  3. “Structuring data so conflict resolution is automatic”

  4. Dynamo Trade consistency for availability and partition tolerance

  5. Node 1 Node 2 { a: “200” } { a:

    “-3000” } :(

  6. Node 1 Node 2 { a: “200” } { a:

    “-3000” } { a: “200”, a: “-3000” } Riak

  7. CRDT •Counter •Set •Graph •List •Tree

  8. CRDT •Counter •Set •Graph •List •Tree

  9. Counter •Can only be increased •Merge: use largest value

  10. Chat Room Karma Fault-Tolerant Distributed

  11. Serious Business { SB[PVS]: 0} Serious Coding { SB[PVS]: 1}

    # PVS++ { SC[PVS]: 0} { SC[PVS]: 5} # PVS += 5 { SB[PVS]: 2} # PVS++ Merge { SB[PVS]: 2, SC[PVS]: 5} { SB[PVS]: 1, SC[PVS]: 5} { SB[PVS]: 2, SC[PVS]: 5} { PVS: 7}

  12. What about decrements? Use separate counters for positive and negative.

    Take the difference for the result.

  13. Serious Business { SB[PVS+]: 0, SB[PVS-]: 0 } Serious Coding

    { SB[PVS+]: 1, SB[PVS-]: 0 } # PVS++ { SB[PVS+]: 0, SB[PVS-]: 0 } { SB[PVS+]: 5, SB[PVS-]: 0 } # PVS += 5 { SB[PVS+]: 1, SB[PVS-]: 1 } # PVS-- Merge { PVS+: 6, PVS-: 1 } { PVS+: 6, PVS-: 0 } { PVS+: 6, PVS-: 1 } { PVS: 5 }

  14. Set •Can only be added to •Merge: take the union

  15. Serious Business { PVS: [ ] } Serious Coding {

    PVS: [] } { PVS: [] } { PVS: [ ] } Merge { PVS: [ , ] } { PVS: [ , ] } { PVS: [ , , ] } { PVS: [ , , ] }

  16. Hold on, Can we remove stuff? Use separate sets for

    added and removed elements.

  17. Serious Business { PVS+: [ ], PVS-: [] } Serious

    Coding { PVS+: [], PVS-: [] } { PVS+: [], PVS-: [] } { PVS+: [ ], PVS-: [] } Merge { PVS+: [ , ], PVS-: [ ] } { PVS+: [ ], PVS-: [ ] } { PVS+: [ , ], PVS-: [] } { PVS+: [ , ], PVS-: [ ] } { PVS: [ ] }

  18. But wait, we can only remove once?

  19. U-Set •Append unique values to all set members •Garbage collection

    becomes an issue

  20. basho/riak_dt Demo

  21. Use Cases •Like button •Page Views •Shopping Cart

  22. Reference •INRIA paper •basho/riak_dt •RICON talk

  23. Beginning Ruby on Rails Course bignerdranch.com/classes/beginning_ruby_on_rails