Riak CS Introduction - Speaker Deck

Slide 1

Slide 1 text

Simple, Available Cloud Storage

Slide 2

Slide 2 text

github.com/basho  twitter.com/basho  docs.basho.com

Slide 3

Slide 3 text

Overview

Slide 4

Slide 4 text

On March 27, 2012  Basho  announced a new  product called  Riak CS

Slide 5

Slide 5 text

On March 20, 2013  Riak CS  became open source

Slide 6

Slide 6 text

Riak CS is... enterprise cloud storage Riak S3-compatibility multi-tenancy per user reporting built on top of large object storage

Slide 7

Slide 7 text

Enabling you to host your own PUBLIC PRIVATE & CLOUDS or…. Reliable Storage Behind Apps

Slide 8

Slide 8 text

About Riak

Slide 9

Slide 9 text

Riak Dynamo-inspired key/value store Written in Erlang with C/C++ Open source under Apache 2 license Thousands of production deployments

Slide 10

Slide 10 text

Riak High availability Low-latency Horizontal scalability Fault-tolerance Ops friendliness

Slide 11

Slide 11 text

Riak Masterless •  No master/slave or different roles •  All nodes are equal •  Write availability and scalability •  All nodes can accept/route requests

Slide 12

Slide 12 text

Riak No Sharding •  Consistent hashing •  Prevents “hot spots” •  Lowers operational burden of scale •  Data rebalanced automatically

Slide 13

Slide 13 text

Riak Availability and Fault-Tolerance •  Automatically replicates data •  Read and write data during hardware failure and network partition •  Hinted handoff

Slide 14

Slide 14 text

How It Works

Slide 15

Slide 15 text

Riak CS Riak Stanchion

Slide 16

Slide 16 text

Riak CS node for every   node of Riak 1

Slide 17

Slide 17 text

Riak  Node Riak  Node Riak  Node Riak  Node Riak  Node Large Object Riak CS  S3 API Reporting API Riak CS  S3 API Reporting API Riak CS  S3 API Reporting API Riak CS  S3 API Reporting API Riak CS  S3 API Reporting API 1. User uploads an object 1 MB 2. Riak CS  breaks object into 1 MB chunks 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 3. Riak CS  streams chunks to Riak nodes 4. Riak replicates and stores chunks

Slide 18

Slide 18 text

USERS multi-tenancy: Riak CS will track individual usage/stats access_key secret_key users identiﬁed by users authenticated by

Slide 19

Slide 19 text

BUCKETS users create buckets. buckets are like folders. store objects in buckets. names are globally unique.

Slide 20

Slide 20 text

OBJECTS stored in buckets. objects are opaque. store any ﬁle type.

Slide 21

Slide 21 text

Features

Slide 22

Slide 22 text

Riak CS Large Object Support •  Started with 5GB / object •  Now have multipart upload •  Content agnostic

Slide 23

Slide 23 text

Riak CS S3-Compatible API •  Use existing S3 libraries and tools •  RESTful operations •  Multipart upload •  S3-style ACLs for object/bucket permissions •  S3 authentication scheme

Slide 24

Slide 24 text

Riak CS Administration and Users •  Interface for user creation, deletion, and credentials •  Conﬁgure so only admins can create users

Slide 25

Slide 25 text

Riak CS New Stuff in Riak 1.3 •  Multipart upload: parts between 5MB and 5GB •  Support for GET range queries •  Restrict access to buckets based on source IP

Slide 26

Slide 26 text

Riak CS

Slide 27

Slide 27 text

Riak CS Packages •  Debian •  Ubuntu •  FreeBSD •  Mac •  Red Hat Enterprise •  Fedora •  SmartOS •  Solaris •  Source

Slide 28

Slide 28 text

Operations

Slide 29

Slide 29 text

stats DTrace  & built-in  support track access & storage per user monitor total cluster ops inspect ops with DTrace probes

Slide 30

Slide 30 text

OPERATIONAL STATS exposed via HTTP resource: /riak-cs/stats block bucket object GET, PUT, DELETE LIST KEYS, CREATE, DELETE, GET/PUT ACL GET, PUT, DELETE HEAD, GET/PUT ACL HISTOGRAMS & COUNTERS

Slide 31

Slide 31 text

TRACK INDIVIDUAL USER’S  THE “USAGE” BUCKET ACCESS STORAGE

Slide 32

Slide 32 text

QUERY USAGE STATS Storage and access statistics tracked on per-user basis, as rollups for slices of time •  Operations, Count, BytesIn, BytesOut, + system and user error •  Objects, Bytes

Slide 33

Slide 33 text

Partnerships

Slide 34

Slide 34 text

Citrix CloudStack •  Combined platform for compute and storage •  Summer ‘13: integrated authentication support •  Videos on our blog

Slide 35

Slide 35 text

Enterprise

Slide 36

Slide 36 text

Multi-Datacenter Replication •  For active backups, availability zones, disaster recovery, global traffic •  Real-time or full-sync •  24/7 support •  Per-node or storage-based pricing