Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=47 Patrick Van Stee
December 14, 2012
Programming
4
460

Convergent Replicated Data Types

B6a8f005f39d23ffc930508ac9da68b9?s=128

Patrick Van Stee

December 14, 2012
Tweet

More Decks by Patrick Van Stee

See All by Patrick Van Stee
Raft: Consensus for Rubyists
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
127
5.5k
Elixir and Ecto
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
4
570
Bootstrap
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
8
540
HTTP API Design for iOS Applications
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
11
380
Consensus: An Introduction to Raft
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
22
2.1k
Pour Over Brewing Method
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
1
130
Celluloid & DCell
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
4
280
Map Reduce & Ruby
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
10
500

Other Decks in Programming

See All in Programming
料理の注文メニューの3D化への挑戦
Fbe7836c8ca96e3099dd5bbd83d1a391?s=48 hideg
0
290
実践 SpiceDB - クライドネイティブ時代をサバイブできるパーミッション管理の実装を目指して / Practical SpiceDB
B1bddcb899ec3060fe9913f3cb70dbb6?s=48 lmt_swallow
0
130
パラメタライズドテスト
4f8c3a1aedaf9aafd6c74ab077d9ad18?s=48 ledsun
0
220
NestJS_meetup_atamaplus
F0a8d07597a19192791bf663504d2a17?s=48 atamaplus
0
210
アジャイルで始める データ分析基盤構築
384e4d8bab8ac2a5e6f64dab1300c491?s=48 nagano
1
900
Git操作編
A3efba75cfbb0b7d5248eb74d1d29d79?s=48 smt7174
2
250
20220706_Google Apps Scriptを実演で学ぶ～ GAS × Slack ～
C983c1e22d0d19f21590b83884d9b754?s=48 apachan
2
620
Cloudflare WorkersでGoのHTTPサーバーを動かすライブラリを作った話
5e511bb6d01d856b4ec7a0e5b1f6a2f0?s=48 syumai
0
150
Isar勉強会
693ed679c8dde3eccbc682ff44f357e1?s=48 hoddy3190
0
470
kintone × LINE Bot で餃子検定Botを作った話
9452778272d5d1a19e897f4b75204fb2?s=48 naberina
0
330
테라폼으로 ECR 관리하기 (How to Manage ECR with Terraform)
330c5e37fb238d6b319ae6e18770f44b?s=48 posquit0
0
530
Untangling Coroutine Testing (Droidcon Berlin 2022)
4047c64e3a1e2f81addd4ba675ddc451?s=48 zsmb
1
480

Featured

See All Featured
Why You Should Never Use an ORM
88bc30284c6a424b63a92aad27d0ba36?s=48 jnunemaker
PRO
47
7.6k
Fight the Zombie Pattern Library - RWD Summit 2016
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
226
15k
Debugging Ruby Performance
D47656e20ff5e42f125fc5ea0fd636c6?s=48 tmm1
65
10k
Designing for humans not robots
D36d2c1821af9249b69ff7f5ed60529b?s=48 tammielis
241
24k
Web development in the modern age
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
197
9.3k
Designing Dashboards & Data Visualisations in Web Apps
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
223
49k
Thoughts on Productivity
A16eb159db895e3b01d3dc95767ad595?s=48 jonyablonski
44
2.4k
Bootstrapping a Software Product
A9179349dd2bdc67f377719f56d85656?s=48 garrettdimon
296
110k
GitHub's CSS Performance
64827b31aef81498662e8af4bd6d5157?s=48 jonrohan
1020
420k
Large-scale JavaScript Application Architecture
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
499
110k
Making the Leap to Tech Lead
32de0bd2ba869609d26fd052a4622778?s=48 cromwellryan
113
7.4k
Done Done
282d599b414022eba5096510f675b6e2?s=48 chrislema
174
14k

Transcript

  1. Convergent Replicated Data Types

  2. @vanstee vanstee@bignerdranch.com Patrick Van Stee

  3. “Structuring data so conflict resolution is automatic”

  4. Dynamo Trade consistency for availability and partition tolerance

  5. Node 1 Node 2 { a: “200” } { a:

    “-3000” } :(

  6. Node 1 Node 2 { a: “200” } { a:

    “-3000” } { a: “200”, a: “-3000” } Riak

  7. CRDT •Counter •Set •Graph •List •Tree

  8. CRDT •Counter •Set •Graph •List •Tree

  9. Counter •Can only be increased •Merge: use largest value

  10. Chat Room Karma Fault-Tolerant Distributed

  11. Serious Business { SB[PVS]: 0} Serious Coding { SB[PVS]: 1}

    # PVS++ { SC[PVS]: 0} { SC[PVS]: 5} # PVS += 5 { SB[PVS]: 2} # PVS++ Merge { SB[PVS]: 2, SC[PVS]: 5} { SB[PVS]: 1, SC[PVS]: 5} { SB[PVS]: 2, SC[PVS]: 5} { PVS: 7}

  12. What about decrements? Use separate counters for positive and negative.

    Take the difference for the result.

  13. Serious Business { SB[PVS+]: 0, SB[PVS-]: 0 } Serious Coding

    { SB[PVS+]: 1, SB[PVS-]: 0 } # PVS++ { SB[PVS+]: 0, SB[PVS-]: 0 } { SB[PVS+]: 5, SB[PVS-]: 0 } # PVS += 5 { SB[PVS+]: 1, SB[PVS-]: 1 } # PVS-- Merge { PVS+: 6, PVS-: 1 } { PVS+: 6, PVS-: 0 } { PVS+: 6, PVS-: 1 } { PVS: 5 }

  14. Set •Can only be added to •Merge: take the union

  15. Serious Business { PVS: [ ] } Serious Coding {

    PVS: [] } { PVS: [] } { PVS: [ ] } Merge { PVS: [ , ] } { PVS: [ , ] } { PVS: [ , , ] } { PVS: [ , , ] }

  16. Hold on, Can we remove stuff? Use separate sets for

    added and removed elements.

  17. Serious Business { PVS+: [ ], PVS-: [] } Serious

    Coding { PVS+: [], PVS-: [] } { PVS+: [], PVS-: [] } { PVS+: [ ], PVS-: [] } Merge { PVS+: [ , ], PVS-: [ ] } { PVS+: [ ], PVS-: [ ] } { PVS+: [ , ], PVS-: [] } { PVS+: [ , ], PVS-: [ ] } { PVS: [ ] }

  18. But wait, we can only remove once?

  19. U-Set •Append unique values to all set members •Garbage collection

    becomes an issue

  20. basho/riak_dt Demo

  21. Use Cases •Like button •Page Views •Shopping Cart

  22. Reference •INRIA paper •basho/riak_dt •RICON talk

  23. Beginning Ruby on Rails Course bignerdranch.com/classes/beginning_ruby_on_rails