Riak Cloud Storage

Simple Available Cloud Storage
CloudStack Collaboration Conference
Friday, November 30, 12

View Slide

whoami
andy gross
@argv0
chief architect
basho technologies

View Slide

basho
Founded 2008 by ex-Akamai execs, engineers
Sponsors of the Riak open source (Apache2)
distributed database
100+ employees, 75% engineers, in SF, MA, DC,
London, Tokyo
We sell Riak EDS (Open Source + Multi-Datacenter
replication), plus support, training, services.
... and Riak CS!

View Slide


View Slide

Design
Goals
high-availability
low-latency
horizontal scalability
fault tolerance
ops friendliness
predictability

View Slide

Overview

View Slide

On March 27, 2012
Basho
announced a new
product called
Riak CS

View Slide

Riak CS is...
enterprise cloud storage
Riak
S3-compatibility
multi-tenancy
per user billing
o!ering
built
on top
of
large object storage

View Slide

Riak distributed, masterless
highly available key value store
PROS:
CONS:
high read/write availability
predictable latency
minimal maintenance required
I/O bound
network is very chatty
permissive API

View Slide

Enabling you to host your own
PUBLIC
PRIVATE
&
CLOUDS

View Slide

STORE MEDIA
STORE BACKUPS

View Slide

STORE
ANY TYPE
OF DATA
YOU LIKE
01101011 01101001 01110100 01110100
01100101 01101110 01110011 00100000
01110000 01110101 01110000 01110000
01101001 01100101 01110011 00100000
01101000 01100001 01101101 01110011
01110100 01100101 01110010 01110011
00100000 01110011 01110101 01100111
01100001 01110010 00100000 01100111
01101100 01101001 01100100 01100101
01110010 01110011 00100000 00100001

View Slide

STORE
ANY TYPE
OF DATA
YOU LIKE
and read it back the same way.
01101011 01101001 01110100 01110100
01100101 01101110 01110011 00100000
01110000 01110101 01110000 01110000
01101001 01100101 01110011 00100000
01101000 01100001 01101101 01110011
01110100 01100101 01110010 01110011
00100000 01110011 01110101 01100111
01100001 01110010 00100000 01100111
01101100 01101001 01100100 01100101
01110010 01110011 00100000 00100001
01101011 01101001 01110100 01110100
01100101 01101110 01110011 00100000
01110000 01110101 01110000 01110000
01101001 01100101 01110011 00100000
01101000 01100001 01101101 01110011
01110100 01100101 01110010 01110011
00100000 01110011 01110101 01100111
01100001 01110010 00100000 01100111
01101100 01101001 01100100 01100101
01110010 01110011 00100000 00100001

View Slide

USERS
multi-tenancy:
Riak CS will track
individual usage/stats
BASIC
CONCEPTS
access_key secret_key
users identi"ed by users authenticated by

View Slide

BUCKETS
users create buckets
buckets are like folders
store objects in buckets
names are globally unique
BASIC
CONCEPTS

View Slide

OBJECTS
stored in buckets
objects are opaque
store any "le type
"le sizes up to 5GB*
BASIC
CONCEPTS

View Slide

ACLs
Access Control Lists
permissions on buckets
permissions on objects
permissions on permissions
BASIC
CONCEPTS

View Slide

on cloud services...

View Slide

“cloud” =
handwaving over
complexity

View Slide

cloud = compute +
storage

View Slide

cloud = global scale

View Slide

cloud = distributed
systems

View Slide

Desirable
Properties
high-availability
low-latency
horizontal scalability
fault tolerance
ops friendliness
predictability

View Slide

Announcing Today:
Multi-DC Replication
• Replicates objects globally to many
datacenters
• Allows public cloud providers to de!ne
global regions
• Allows enterprises global, low latency
access to storage
“[deploying Riak CS] reduces the risk of using AWS and allows
customers to store their data in their own data centers, on their
own terms.” - Alex Williams, TechCrunch

View Slide

Coming Soon:
Integration with
CloudStack
• Patch to enable Riak CS as secondary storage
• https://reviews.apache.org/r/8123/
• Targeting 4.0.1 release
• Deeper integration also in the works

View Slide

Architecture

View Slide

Riak
Node
Riak
Node
Riak
Node
Riak
Node
Riak
Node
Large Object
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API

View Slide

Riak
Node
Riak
Node
Riak
Node
Riak
Node
Riak
Node
Large Object
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
1. user uploads
an object

View Slide

Riak
Node
Riak
Node
Riak
Node
Riak
Node
Riak
Node
Large Object
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API

View Slide

Riak
Node
Riak
Node
Riak
Node
Riak
Node
Riak
Node
Large Object
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
1 MB
2. Riak CS
breaks object
into 1 MB chunks
1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB

View Slide

Riak
Node
Riak
Node
Riak
Node
Riak
Node
Riak
Node
Large Object
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB

View Slide

Riak
Node
Riak
Node
Riak
Node
Riak
Node
Riak
Node
Large Object
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB
3. Riak CS
streams chunks
to Riak nodes

View Slide

Riak
Node
Riak
Node
Riak
Node
Riak
Node
Riak
Node
Large Object
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API

View Slide

Riak
Node
Riak
Node
Riak
Node
Riak
Node
Riak
Node
Large Object
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
Riak CS
S3
API
Reporting
API
4. Riak
replicates
and stores
chunks

View Slide

THE HOOD
UNDER

View Slide

consistent hashing
replicas
virtual nodes (vnodes)
handoff
gossip protocols
anti-entropy
REPLICATION and ADMINISTRATION

View Slide

THE RING
DIVIDED
EVENLY
INTO
160-BIT INT
KEYSPACE
PARTITIONS

View Slide

VNODES
PARTITIONS
node 0
node 1
node 2
CLAIM

View Slide

VNODES
PARTITIONS
node 0
node 1
node 2

View Slide

REBALANCE
VNODES
PARTITIONS
node 0
node 1
node 2
node 3
+

View Slide

consistent hashing
node 0
node 1
node 2
node 3
hash(“bucket/key”)
N = 3

View Slide

Quorum
requests
N R W
PR/PW DW

View Slide

disaster
scenario
node 0
node 1
node 3
node 2

View Slide

disaster
scenario
node 0
node 1
node 3
node 2
requests go to fallback

View Slide

disaster
scenario
node 0
node 1
node 3
node 2

View Slide

disaster
scenario
node 0
node 1
node 3
node 2
node comes back online

View Slide

disaster
scenario
node 0
node 1
node 3
node 2

View Slide

disaster
scenario
node 0
node 1
node 3
node 2
normal operations resume

View Slide

Operations

View Slide

stats
DTrace
&
built-in
support
track access &
storage per user
monitor total
cluster ops
inspect ops with
DTrace probes
create custom
billing policies

View Slide

OPERATIONAL STATS
exposed via HTTP resource: /riak-cs/stats
block bucket object
GET, PUT, DELETE
LIST KEYS, CREATE,
DELETE, GET/PUT ACL
GET, PUT, DELETE
HEAD, GET/PUT ACL
HISTOGRAMS & COUNTERS

View Slide

TRACK INDIVIDUAL USER’S
THE
“USAGE”
BUCKET
ACCESS STORAGE

View Slide

QUERY USAGE STATS
GET s3://usage/access_key/options/start_time/end_time
access_key: MT_WDIUW64WFQLUP6IOO
options: (a = access, b = storage ; j = JSON, x = XML)
start_time: 20121017T140000Z (ISO8601)
end_time: 20121018T140000Z (ISO8601)
via HTTP or S3

View Slide

{
"Access": {
"Errors": [],
"Nodes": [
{
"Node": "[email protected]",
"Samples": [
{
"EndTime": "20121018T130000Z",
"StartTime": "20121018T120000Z",
"UsageRead": {
"BytesOut": 10509,
"Count": 1
}
},
{
"EndTime": "20121018T130000Z",

View Slide

"UsageRead": {
"BytesOut": 10509,
"Count": 1
}
},
{
"EndTime": "20121018T000000Z",
"KeyWrite": {
"BytesIn": 104857600,
"Count": 1
},
"ListBuckets": {
"BytesOut": 406,
"Count": 1
},
"StartTime": "20121017T230000Z"
},
{
"EndTime": "20121018T000000Z",

View Slide

{
"EndTime": "20121020T020000Z",
"KeyWrite": {
"UserErrorBytesIn": 10240000000,
"UserErrorBytesOut": 224,
"UserErrorCount": 1
},
you can’t store objects > 5GB
USER ERRORS:
requests that result in 400-499 response codes

View Slide

{
"Access": "not_requested",
"Storage": {
"Errors": [],
"Samples": [
{
"EndTime": "20121018T060204Z",
"StartTime": "20121018T060203Z",
"some_bucket": {
"Bytes": 107167497049,
"Objects": 106
},
"empty_bucket": {
"Bytes": 0,
"Objects": 0

View Slide

{
"EndTime": "20121017T060202Z",
"StartTime": "20121017T060201Z",
"tsantero": {
"Bytes": 106014063449,
"Objects": 104
},
"empty_bucket": {
"Bytes": 0,
"Objects": 0
}
}
]
}
}

View Slide

FIND US FOR A
DEVELOPER’S TRIAL
http://docs.basho.com/riakcs/latest/
Q&A

View Slide

Riak Cloud Storage

Riak Cloud Storage

Andy Gross

More Decks by Andy Gross

Other Decks in Technology

Featured

Transcript