Riak CS Introduction

Transcript

1. Simple, Available Cloud Storage

2. github.com/basho
 twitter.com/basho
 docs.basho.com

3. Overview

4. On March 27, 2012
 Basho
 announced a new
 product called


   Riak CS

5. On March 20, 2013
 Riak CS
 became open source

6. Riak CS is... enterprise cloud storage Riak S3-compatibility multi-tenancy per

   user reporting built on top of large object storage

7. Enabling you to host your own PUBLIC PRIVATE & CLOUDS

   or…. Reliable Storage Behind Apps

8. About Riak

9. Riak Dynamo-inspired key/value store Written in Erlang with C/C++ Open

   source under Apache 2 license Thousands of production deployments

10. Riak High availability Low-latency Horizontal scalability Fault-tolerance Ops friendliness

11. Riak Masterless •  No master/slave or different roles •  All

    nodes are equal •  Write availability and scalability •  All nodes can accept/route requests

12. Riak No Sharding •  Consistent hashing •  Prevents “hot spots”

    •  Lowers operational burden of scale •  Data rebalanced automatically

13. Riak Availability and Fault-Tolerance •  Automatically replicates data •  Read

    and write data during hardware failure and network partition •  Hinted handoff

14. How It Works

15. Riak CS Riak Stanchion

16. Riak CS node for every 
 node of Riak 1

17. Riak
 Node Riak
 Node Riak
 Node Riak
 Node Riak
 Node

    Large Object Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API 1. User uploads an object 1 MB 2. Riak CS
 breaks object into 1 MB chunks 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 3. Riak CS
 streams chunks to Riak nodes 4. Riak replicates and stores chunks

18. USERS multi-tenancy: Riak CS will track individual usage/stats access_key secret_key

    users identified by users authenticated by

19. BUCKETS users create buckets. buckets are like folders. store objects

    in buckets. names are globally unique.

20. OBJECTS stored in buckets. objects are opaque. store any file

    type.

21. Features

22. Riak CS Large Object Support •  Started with 5GB /

    object •  Now have multipart upload •  Content agnostic

23. Riak CS S3-Compatible API •  Use existing S3 libraries and

    tools •  RESTful operations •  Multipart upload •  S3-style ACLs for object/bucket permissions •  S3 authentication scheme

24. Riak CS Administration and Users •  Interface for user creation,

    deletion, and credentials •  Configure so only admins can create users

25. Riak CS New Stuff in Riak 1.3 •  Multipart upload:

    parts between 5MB and 5GB •  Support for GET range queries •  Restrict access to buckets based on source IP

26. Riak CS

27. Riak CS Packages •  Debian •  Ubuntu •  FreeBSD • 

    Mac •  Red Hat Enterprise •  Fedora •  SmartOS •  Solaris •  Source

28. Operations

29. stats DTrace
 & built-in
 support track access & storage per

    user monitor total cluster ops inspect ops with DTrace probes

30. OPERATIONAL STATS exposed via HTTP resource: /riak-cs/stats block bucket object

    GET, PUT, DELETE LIST KEYS, CREATE, DELETE, GET/PUT ACL GET, PUT, DELETE HEAD, GET/PUT ACL HISTOGRAMS & COUNTERS

31. TRACK INDIVIDUAL USER’S
 THE “USAGE” BUCKET ACCESS STORAGE

32. QUERY USAGE STATS Storage and access statistics tracked on per-user

    basis, as rollups for slices of time •  Operations, Count, BytesIn, BytesOut, + system and user error •  Objects, Bytes

33. Partnerships

34. Citrix CloudStack •  Combined platform for compute and storage • 

    Summer ‘13: integrated authentication support •  Videos on our blog

35. Enterprise

36. Multi-Datacenter Replication •  For active backups, availability zones, disaster recovery,

    global traffic •  Real-time or full-sync •  24/7 support •  Per-node or storage-based pricing

37. basho.com SIGN UP FOR AN ENTERPRISE DEVELOPER TRIAL http://docs.basho.com/

38. RICON.io A distributed systems conference RICON25Web for 25% off

39. github.com/basho
 twitter.com/basho
 docs.basho.com

40. Q&A