Riak Cloud Storage - Speaker Deck

Slide 1

Slide 1 text

Simple Available Cloud Storage CloudStack Collaboration Conference Friday, November 30, 12

Slide 2

Slide 2 text

whoami andy gross @argv0 chief architect basho technologies Friday, November 30, 12

Slide 3

Slide 3 text

basho Founded 2008 by ex-Akamai execs, engineers Sponsors of the Riak open source (Apache2) distributed database 100+ employees, 75% engineers, in SF, MA, DC, London, Tokyo We sell Riak EDS (Open Source + Multi-Datacenter replication), plus support, training, services. ... and Riak CS! Friday, November 30, 12

Slide 4

Slide 4 text

Friday, November 30, 12

Slide 5

Slide 5 text

Design Goals high-availability low-latency horizontal scalability fault tolerance ops friendliness predictability Friday, November 30, 12

Slide 6

Slide 6 text

Overview Friday, November 30, 12

Slide 7

Slide 7 text

On March 27, 2012 Basho announced a new product called Riak CS Friday, November 30, 12

Slide 8

Slide 8 text

Riak CS is... enterprise cloud storage Riak S3-compatibility multi-tenancy per user billing o!ering built on top of large object storage Friday, November 30, 12

Slide 9

Slide 9 text

Riak distributed, masterless highly available key value store PROS: CONS: high read/write availability predictable latency minimal maintenance required I/O bound network is very chatty permissive API Friday, November 30, 12

Slide 10

Slide 10 text

Enabling you to host your own PUBLIC PRIVATE & CLOUDS Friday, November 30, 12

Slide 11

Slide 11 text

STORE MEDIA STORE BACKUPS Friday, November 30, 12

Slide 12

Slide 12 text

STORE ANY TYPE OF DATA YOU LIKE 01101011 01101001 01110100 01110100 01100101 01101110 01110011 00100000 01110000 01110101 01110000 01110000 01101001 01100101 01110011 00100000 01101000 01100001 01101101 01110011 01110100 01100101 01110010 01110011 00100000 01110011 01110101 01100111 01100001 01110010 00100000 01100111 01101100 01101001 01100100 01100101 01110010 01110011 00100000 00100001 Friday, November 30, 12

Slide 13

Slide 13 text

STORE ANY TYPE OF DATA YOU LIKE and read it back the same way. 01101011 01101001 01110100 01110100 01100101 01101110 01110011 00100000 01110000 01110101 01110000 01110000 01101001 01100101 01110011 00100000 01101000 01100001 01101101 01110011 01110100 01100101 01110010 01110011 00100000 01110011 01110101 01100111 01100001 01110010 00100000 01100111 01101100 01101001 01100100 01100101 01110010 01110011 00100000 00100001 01101011 01101001 01110100 01110100 01100101 01101110 01110011 00100000 01110000 01110101 01110000 01110000 01101001 01100101 01110011 00100000 01101000 01100001 01101101 01110011 01110100 01100101 01110010 01110011 00100000 01110011 01110101 01100111 01100001 01110010 00100000 01100111 01101100 01101001 01100100 01100101 01110010 01110011 00100000 00100001 Friday, November 30, 12

Slide 14

Slide 14 text

USERS multi-tenancy: Riak CS will track individual usage/stats BASIC CONCEPTS access_key secret_key users identi"ed by users authenticated by Friday, November 30, 12

Slide 15

Slide 15 text

BUCKETS users create buckets buckets are like folders store objects in buckets names are globally unique BASIC CONCEPTS Friday, November 30, 12

Slide 16

Slide 16 text

OBJECTS stored in buckets objects are opaque store any "le type "le sizes up to 5GB* BASIC CONCEPTS Friday, November 30, 12

Slide 17

Slide 17 text

ACLs Access Control Lists permissions on buckets permissions on objects permissions on permissions BASIC CONCEPTS Friday, November 30, 12

Slide 18

Slide 18 text

on cloud services... Friday, November 30, 12

Slide 19

Slide 19 text

“cloud” = handwaving over complexity Friday, November 30, 12

Slide 20

Slide 20 text

cloud = compute + storage Friday, November 30, 12

Slide 21

Slide 21 text

cloud = global scale Friday, November 30, 12

Slide 22

Slide 22 text

cloud = distributed systems Friday, November 30, 12

Slide 23

Slide 23 text

Desirable Properties high-availability low-latency horizontal scalability fault tolerance ops friendliness predictability Friday, November 30, 12

Slide 24

Slide 24 text

Announcing Today: Multi-DC Replication • Replicates objects globally to many datacenters • Allows public cloud providers to de!ne global regions • Allows enterprises global, low latency access to storage “[deploying Riak CS] reduces the risk of using AWS and allows customers to store their data in their own data centers, on their own terms.” - Alex Williams, TechCrunch Friday, November 30, 12

Slide 25

Slide 25 text

Coming Soon: Integration with CloudStack • Patch to enable Riak CS as secondary storage • https://reviews.apache.org/r/8123/ • Targeting 4.0.1 release • Deeper integration also in the works Friday, November 30, 12

Slide 26

Slide 26 text

Architecture Friday, November 30, 12

Slide 27

Slide 27 text

Slide 28

Slide 28 text

Riak Node Riak Node Riak Node Riak Node Riak Node Large Object Riak CS S3 API Reporting API Riak CS S3 API Reporting API Riak CS S3 API Reporting API Riak CS S3 API Reporting API Riak CS S3 API Reporting API 1. user uploads an object Friday, November 30, 12

Slide 29

Slide 29 text

Slide 30

Slide 30 text

Slide 31

Slide 31 text

Slide 32

Slide 32 text

Slide 33

Slide 33 text

Slide 34

Slide 34 text

Slide 35

Slide 35 text

THE HOOD UNDER Friday, November 30, 12

Slide 36

Slide 36 text

consistent hashing replicas virtual nodes (vnodes) handoff gossip protocols anti-entropy REPLICATION and ADMINISTRATION Friday, November 30, 12

Slide 37

Slide 37 text

THE RING DIVIDED EVENLY INTO 160-BIT INT KEYSPACE PARTITIONS Friday, November 30, 12

Slide 38

Slide 38 text

VNODES PARTITIONS node 0 node 1 node 2 CLAIM Friday, November 30, 12

Slide 39

Slide 39 text

VNODES PARTITIONS node 0 node 1 node 2 Friday, November 30, 12

Slide 40

Slide 40 text

REBALANCE VNODES PARTITIONS node 0 node 1 node 2 node 3 + Friday, November 30, 12

Slide 41

Slide 41 text

consistent hashing node 0 node 1 node 2 node 3 hash(“bucket/key”) N = 3 Friday, November 30, 12

Slide 42

Slide 42 text

consistent hashing node 0 node 1 node 2 node 3 hash(“bucket/key”) N = 3 Friday, November 30, 12

Slide 43

Slide 43 text

Quorum requests N R W PR/PW DW Friday, November 30, 12

Slide 44

Slide 44 text

disaster scenario node 0 node 1 node 3 node 2 Friday, November 30, 12

Slide 45

Slide 45 text

disaster scenario node 0 node 1 node 3 node 2 Friday, November 30, 12

Slide 46

Slide 46 text

disaster scenario node 0 node 1 node 3 node 2 requests go to fallback Friday, November 30, 12

Slide 47

Slide 47 text

disaster scenario node 0 node 1 node 3 node 2 Friday, November 30, 12

Slide 48

Slide 48 text

disaster scenario node 0 node 1 node 3 node 2 node comes back online Friday, November 30, 12

Slide 49

Slide 49 text

disaster scenario node 0 node 1 node 3 node 2 Friday, November 30, 12

Slide 50

Slide 50 text

disaster scenario node 0 node 1 node 3 node 2 normal operations resume Friday, November 30, 12

Slide 51

Slide 51 text

Operations Friday, November 30, 12

Slide 52

Slide 52 text

stats DTrace & built-in support track access & storage per user monitor total cluster ops inspect ops with DTrace probes create custom billing policies Friday, November 30, 12

Slide 53

Slide 53 text

OPERATIONAL STATS exposed via HTTP resource: /riak-cs/stats block bucket object GET, PUT, DELETE LIST KEYS, CREATE, DELETE, GET/PUT ACL GET, PUT, DELETE HEAD, GET/PUT ACL HISTOGRAMS & COUNTERS Friday, November 30, 12

Slide 54

Slide 54 text

TRACK INDIVIDUAL USER’S THE “USAGE” BUCKET ACCESS STORAGE Friday, November 30, 12

Slide 55

Slide 55 text

QUERY USAGE STATS GET s3://usage/access_key/options/start_time/end_time access_key: MT_WDIUW64WFQLUP6IOO options: (a = access, b = storage ; j = JSON, x = XML) start_time: 20121017T140000Z (ISO8601) end_time: 20121018T140000Z (ISO8601) via HTTP or S3 Friday, November 30, 12

Slide 56

Slide 56 text

{ "Access": { "Errors": [], "Nodes": [ { "Node": "[email protected]", "Samples": [ { "EndTime": "20121018T130000Z", "StartTime": "20121018T120000Z", "UsageRead": { "BytesOut": 10509, "Count": 1 } }, { "EndTime": "20121018T130000Z", Friday, November 30, 12

Slide 57

Slide 57 text

"UsageRead": { "BytesOut": 10509, "Count": 1 } }, { "EndTime": "20121018T000000Z", "KeyWrite": { "BytesIn": 104857600, "Count": 1 }, "ListBuckets": { "BytesOut": 406, "Count": 1 }, "StartTime": "20121017T230000Z" }, { "EndTime": "20121018T000000Z", Friday, November 30, 12

Slide 58

Slide 58 text

{ "EndTime": "20121020T020000Z", "KeyWrite": { "UserErrorBytesIn": 10240000000, "UserErrorBytesOut": 224, "UserErrorCount": 1 }, you can’t store objects > 5GB USER ERRORS: requests that result in 400-499 response codes Friday, November 30, 12

Slide 59

Slide 59 text

{ "Access": "not_requested", "Storage": { "Errors": [], "Samples": [ { "EndTime": "20121018T060204Z", "StartTime": "20121018T060203Z", "some_bucket": { "Bytes": 107167497049, "Objects": 106 }, "empty_bucket": { "Bytes": 0, "Objects": 0 Friday, November 30, 12

Slide 60

Slide 60 text

{ "EndTime": "20121017T060202Z", "StartTime": "20121017T060201Z", "tsantero": { "Bytes": 106014063449, "Objects": 104 }, "empty_bucket": { "Bytes": 0, "Objects": 0 } } ] } } Friday, November 30, 12

Slide 61

Slide 61 text

FIND US FOR A DEVELOPER’S TRIAL http://docs.basho.com/riakcs/latest/ Q&A Friday, November 30, 12