Basic intro to Riak through Ruby-colored glasses. Presented at the Atlanta Ruby Users Group on 8/14/2013: http://www.meetup.com/atlantaruby/events/104483692/
Riak on RubyKeys Values & CRDTs8/14/2013
View Slide
tsantero{ twittergithubbasho.com@
https://identicons.github.com/tsantero.png
Riakhttps://github.com/basho/riakhttp://docs.basho.com/riak/latest/downloads/
masterless&distributed
$ wget http://$PATH/debian/6/riak_1.4.1-‐1_amd64.deb-‐-‐2013-‐08-‐14 14:00:35-‐-‐ http://$PATH/riak_1.4.1-‐1_amd64.debResolving s3.amazonaws.com... 176.32.99.42Connecting to s3.amazonaws.com|176.32.99.42|:80... connected.HTTP request sent, awaiting response... 200 OKLength: 26883312 (26M) [application/x-‐debian-‐package]Saving to: ‘riak_1.4.1-‐1_amd64.deb’100%[=========================>] 26,883,312 691KB/s in 37s2013-‐08-‐14 14:01:13 (703 KB/s) -‐ ‘riak_1.4.1-‐1_amd64.deb’ saved [26883312/26883312]
$ lsriak_1.4.1-‐1_amd64.deb$ sudo dpkg -‐i riak_1.4.1-‐1_amd64.deb# repeat for all nodes in cluster
# on all nodes in cluster do:$ riak-‐admin cluster join [email protected]
$ riak-‐admin cluster plan############################################################################### After cluster transition 1/2###############################################################################================================= Membership ==================================Status Ring Pending Node-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐valid 100.0% 20.0% '[email protected]'joining 0.0% 20.0% '[email protected]'joining 0.0% 20.0% '[email protected]'joining 0.0% 20.0% '[email protected]'joining 0.0% 20.0% '[email protected]'-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐Valid:1 / Leaving:0 / Exiting:0 / Joining:4 / Down:0...$ riak-‐admin cluster commit
Riak ClusterRiak Node
Riak Ruby Clienthttps://github.com/basho/riak-ruby-client
$ gem install riak-client
123456789101112131415#!/usr/bin/env rubyrequire ‘riak’# open connection to Riakclient = Riak::Client.newclient.ping # => true
123456789101112131415#!/usr/bin/env rubyrequire ‘riak’# specify a list of nodes to connect toclient = Riak::Client.new(:nodes => [{:host => “riak1.domain.com”, :pb_port => 8081},{:host => “riak2.domain.com”, :pb_port => 8081},{:host => “riak3.domain.com”, :pb_port => 8081},{:host => “riak4.domain.com”, :pb_port => 8081},{:host => “riak5.domain.com”, :pb_port => 8081}])
{“key” : “value”}
Keys are namespaced=> BUCKETS
123456789101112131415# create a Riak::Bucket objectzomg_bucket = client.bucket(‘my_bucket’)# or you can assign buckets like a hashzomg_bucket = client[‘my_bucket’]# => #
12 # list bucket propertiespp client[‘meow’].props{"name"=>"meow", "allow_mult" => false, "basic_quorum" => false, "big_vclock" => 50, "dw" => "quorum", "last_write_wins" => false, "n_val"=> 3, "notfound_ok" => true, "old_vclock" => 86400, "postcommit"=> [], "pr" => 0, "precommit" => [], "pw" => 0, "r" => "quorum", "rw" => "quorum", "small_vclock" => 50, "w" => "quorum", "young_vclock" => 20}
QuorumrequestsN R WPR/PW DW
123456789101112131415# let’s change some bucket propertiesclient[‘meow’] = {“n_val” => 5, “r” => 1, “w” => 5}
GETPUTDELETECRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUDCRUD
123456789101112131415client[‘my_bucket’].exists?(‘my_key’)# => falsesome_object = client[‘my_bucket’].get_or_new(‘my_key’)# => # some_object.data = [‘a’, ‘list’, ‘of’, ‘strings’]some_object.storeclient[‘my_bucket’][‘my_key’]# => #‘list’, ‘of’, ‘strings’]>
123456789101112131415# create and store a new objectatlrug = {:title => ‘Riak: Keys, Values and CRDTs’:speaker => ‘Tom Santero’:link => ‘http://www.meetup.com/atlantaruby/events/104483692/’:date => ‘2013-‐08-‐14’}meetups_bucket = client[‘meetups’]meetup_object = meetups.bucket.new(atlrug[date])meetup_object.data = atlrugmeetup_object.store# object will be encoded as JSON
123456789101112131415# Tom’s talk was horrible, lets forget it ever happenedtoms_talk = client[‘meetups’][‘2013-‐08-‐14’]toms_talk.deleteclient[‘meetups’].exists?[‘2013-‐08-‐14’]# => false
123456789101112131415# objects in Riak are opaqueclient[‘images’].new(‘kittah.jpg’).tap do |robject|robject.content_type = ‘image/jpeg’robject.raw_data = File.read(~/Desktop/kittah.jpg’)robject.storeend# => #
Conflict-Free Replicated Data Types(CRDTs)
Riak isEventuallyConsistent
AB
Conflicts!
CRDTs
CRDTsC {ConvergentCommutative
CRDTsC {ConvergentCommutativeConflict Free
Counters
G CounterGrow Only Counter
Monotonic
Convergentstate-based
{actor_id, value}
A B Cval_a: 4val_b: 7val_c: 10Total: 21val_a: 4val_b: 7val_c: 10Total: 21val_a: 4val_b: 7val_c: 10Total: 21
A B Cval_a: 5val_b: 7val_c: 10Total: 22val_a: 4val_b: 8val_c: 10Total: 22val_a: 4val_b: 7val_c: 10Total: 21
A B Cval_a: 5val_b: 7val_c: 10Total: 22val_a: 4val_b: 8val_c: 10Total: 22val_a: 4val_b: 7val_c: 10Total: 21MERGE!
A B Cval_a: 5val_b: 8val_c: 10Total: 23val_a: 5val_b: 8val_c: 10Total: 23val_a: 5val_b: 8val_c: 10Total: 23
:)
:(
PN Counter
{P_val, N_val}+ -
{P_val, N_val}+ -Value = P - N
Sets, Registers, Maps...other types:
CRDTsno more conflicts!
fin
tsantero
.jpg){kind=avatar}
gtnao
nsuz
soutaro
takesinoda
manfredsteyer
qualiarts
k0kubun
xblood
dunglas
prof18
pocke
hirokunimaeta
myddelton
morganepeng
wjessup
carmenintech
michaelherold
edds
chrislema
philnash
tmm1
chriscoyier
mraible
hannesfritz