Riak CS Introduction

E0f4dbccf64a1d37a92e224b070ee84f?s=47 Basho Technologies
April 02, 2013
Technology
7
3.6k

Riak CS Introduction

Intro to Riak CS presentation. Covers architecture, features, operations, stats and interfaces.

E0f4dbccf64a1d37a92e224b070ee84f?s=128

Basho Technologies

April 02, 2013
Tweet

Want more?

E0f4dbccf64a1d37a92e224b070ee84f?s=48 basho
1
7k
E0f4dbccf64a1d37a92e224b070ee84f?s=48 basho
3
520
E0f4dbccf64a1d37a92e224b070ee84f?s=48 basho
0
900
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
2
140
A9a491b0fcbe0fbce3d64063a37add99?s=48 rmw
1
71
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
0
68
61857dafbd287b3027c4dcea9008ad3c?s=48 carmenhchung
5
140
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
4
160
C0390e8b11079f8761c0cd3274ed61cb?s=48 productmarketing
2
220
C35e01544a0dd94a2cf1619ee8a42ebb?s=48 clairelew
2
430
6bb82b13cda86d3b821fa44100335ddf?s=48 thoeni
1
110
B3ace07412a5178ea778e7eec161fc0a?s=48 jcasabona
4
200

Transcript

  1. 1.

    Simple, Available Cloud Storage

  2. 2.

    github.com/basho
 twitter.com/basho
 docs.basho.com

  3. 3.

    Overview

  4. 4.

    On March 27, 2012
 Basho
 announced a new
 product called


    Riak CS
  5. 5.

    On March 20, 2013
 Riak CS
 became open source

  6. 6.

    Riak CS is... enterprise cloud storage Riak S3-compatibility multi-tenancy per

    user reporting built on top of large object storage
  7. 7.

    Enabling you to host your own PUBLIC PRIVATE & CLOUDS

    or…. Reliable Storage Behind Apps
  8. 8.

    About Riak

  9. 9.

    Riak Dynamo-inspired key/value store Written in Erlang with C/C++ Open

    source under Apache 2 license Thousands of production deployments
  10. 10.

    Riak High availability Low-latency Horizontal scalability Fault-tolerance Ops friendliness

  11. 11.

    Riak Masterless •  No master/slave or different roles •  All

    nodes are equal •  Write availability and scalability •  All nodes can accept/route requests
  12. 12.

    Riak No Sharding •  Consistent hashing •  Prevents “hot spots”

    •  Lowers operational burden of scale •  Data rebalanced automatically
  13. 13.

    Riak Availability and Fault-Tolerance •  Automatically replicates data •  Read

    and write data during hardware failure and network partition •  Hinted handoff
  14. 14.

    How It Works

  15. 15.

    Riak CS Riak Stanchion

  16. 16.

    Riak CS node for every 
 node of Riak 1

  17. 17.

    Riak
 Node Riak
 Node Riak
 Node Riak
 Node Riak
 Node

    Large Object Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API 1. User uploads an object 1 MB 2. Riak CS
 breaks object into 1 MB chunks 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 3. Riak CS
 streams chunks to Riak nodes 4. Riak replicates and stores chunks
  18. 18.

    USERS multi-tenancy: Riak CS will track individual usage/stats access_key secret_key

    users identified by users authenticated by
  19. 19.

    BUCKETS users create buckets. buckets are like folders. store objects

    in buckets. names are globally unique.
  20. 20.

    OBJECTS stored in buckets. objects are opaque. store any file

    type.
  21. 21.

    Features

  22. 22.

    Riak CS Large Object Support •  Started with 5GB /

    object •  Now have multipart upload •  Content agnostic
  23. 23.

    Riak CS S3-Compatible API •  Use existing S3 libraries and

    tools •  RESTful operations •  Multipart upload •  S3-style ACLs for object/bucket permissions •  S3 authentication scheme
  24. 24.

    Riak CS Administration and Users •  Interface for user creation,

    deletion, and credentials •  Configure so only admins can create users
  25. 25.

    Riak CS New Stuff in Riak 1.3 •  Multipart upload:

    parts between 5MB and 5GB •  Support for GET range queries •  Restrict access to buckets based on source IP
  26. 26.

    Riak CS

  27. 27.

    Riak CS Packages •  Debian •  Ubuntu •  FreeBSD • 

    Mac •  Red Hat Enterprise •  Fedora •  SmartOS •  Solaris •  Source
  28. 28.

    Operations

  29. 29.

    stats DTrace
 & built-in
 support track access & storage per

    user monitor total cluster ops inspect ops with DTrace probes
  30. 30.

    OPERATIONAL STATS exposed via HTTP resource: /riak-cs/stats block bucket object

    GET, PUT, DELETE LIST KEYS, CREATE, DELETE, GET/PUT ACL GET, PUT, DELETE HEAD, GET/PUT ACL HISTOGRAMS & COUNTERS
  31. 31.

    TRACK INDIVIDUAL USER’S
 THE “USAGE” BUCKET ACCESS STORAGE

  32. 32.

    QUERY USAGE STATS Storage and access statistics tracked on per-user

    basis, as rollups for slices of time •  Operations, Count, BytesIn, BytesOut, + system and user error •  Objects, Bytes
  33. 33.

    Partnerships

  34. 34.

    Citrix CloudStack •  Combined platform for compute and storage • 

    Summer ‘13: integrated authentication support •  Videos on our blog
  35. 35.

    Enterprise

  36. 36.

    Multi-Datacenter Replication •  For active backups, availability zones, disaster recovery,

    global traffic •  Real-time or full-sync •  24/7 support •  Per-node or storage-based pricing
  37. 37.

    basho.com SIGN UP FOR AN ENTERPRISE DEVELOPER TRIAL http://docs.basho.com/

  38. 38.

    RICON.io A distributed systems conference RICON25Web for 25% off

  39. 39.

    github.com/basho
 twitter.com/basho
 docs.basho.com

  40. 40.

    Q&A