What's New in Riak CS 1.4

Slides from the "What's New in Riak CS 1.4" webcast from Aug. 23, 2013

Transcript

1. Simple, Available Cloud Storage
2. @basho
 basho.com
 docs.basho.com
 github.com/basho

3. Overview
4. On March 27, 2012
 Basho
 announced a new
 product called
 Riak CS
5. On March 20, 2013
 Riak CS
 became open source
6. Riak CS is... enterprise cloud storage Riak S3-compatibility multi-tenancy per user reporting built on top of large object storage
7. Enabling you to host your own PUBLIC PRIVATE & CLOUDS or…. Reliable Storage Behind Apps
8. About Riak
9. Riak Dynamo-inspired key/value store Written in Erlang with C/C++ Open source under Apache 2 license Thousands of production deployments
10. Riak High availability Low-latency Horizontal scalability Fault-tolerance Ops friendliness
11. Riak Masterless •  No master/slave or different roles •  All nodes are equal •  Write availability and scalability •  All nodes can accept/route requests
12. Riak No Sharding •  Consistent hashing •  Prevents “hot spots” •  Lowers operational burden of scale •  Data rebalanced automatically
13. Riak Availability and Fault-Tolerance •  Automatically replicates data •  Read and write data during hardware failure and network partition •  Hinted handoff
14. How It Works
15. Riak CS Riak Stanchion
16. Riak CS node for every 
 node of Riak 1
17. Riak
 Node Riak
 Node Riak
 Node Riak
 Node Riak
 Node Large Object Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API 1. User uploads an object 1 MB 2. Riak CS
 breaks object into 1 MB chunks 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 3. Riak CS
 streams chunks to Riak nodes 4. Riak replicates and stores chunks
18. USERS multi-tenancy: Riak CS will track individual usage/stats access_key secret_key users identified by users authenticated by
19. BUCKETS users create buckets. buckets are like folders. store objects in buckets. names are globally unique.
20. OBJECTS stored in buckets. objects are opaque. store any file type.
21. Features
22. Riak CS Large Object Support •  Started with 5GB / object •  Now have multipart upload •  Content agnostic
23. Riak CS S3-Compatible API •  Use existing S3 libraries and tools •  RESTful operations •  Multipart upload •  S3-style ACLs for object/bucket permissions •  S3 authentication scheme
24. Riak CS Administration and Users •  Interface for user creation, deletion, and credentials •  Configure so only admins can create users
25. Riak CS
26. Riak CS Packages •  Debian •  Ubuntu •  FreeBSD •  Mac •  Red Hat Enterprise •  Fedora •  SmartOS •  Solaris •  Source
27. Riak CS 1.4
28. Riak CS 1.4 More Flexible Users API •  Editable fields •  Operators can more easily manage user accounts
29. Riak CS 1.4 Performance Improvements for Bucket Queries •  Leverages Riak 1.4 •  Returns objects directly from keys •  Using secondary indexing pagination, can request N number of keys •  Disabled by default
30. Riak CS 1.4 Faster Object Block Retrieval •  Only contacts 1 vnode instead of all 3 •  Decreases intracluster bandwidth by 67% •  Improves download performance when handling many concurrent requests •  Disabled by default
31. Riak CS 1.4 Other Updates and Bug Fixes •  Content-MD5 validation •  Lager syslog support •  Configurable Protocol Buffer client timeouts •  Multipart upload fixes •  Check out Github/release notes for full list
32. Operations
33. stats DTrace
 & built-in
 support track access & storage per user monitor total cluster ops inspect ops with DTrace probes
34. OPERATIONAL STATS exposed via HTTP resource: /riak-cs/stats block bucket object GET, PUT, DELETE LIST KEYS, CREATE, DELETE, GET/PUT ACL GET, PUT, DELETE HEAD, GET/PUT ACL HISTOGRAMS & COUNTERS
35. TRACK INDIVIDUAL USER’S
 THE “USAGE” BUCKET ACCESS STORAGE
36. QUERY USAGE STATS Storage and access statistics tracked on per-user basis, as rollups for slices of time •  Operations, Count, BytesIn, BytesOut, + system and user error •  Objects, Bytes
37. Partnerships
38. Citrix CloudStack •  Combined platform for compute and storage •  Videos on our blog
39. Rackspace OpenStack •  Announced with Riak CS 1.4 •  Integration with Object Storage API •  Keystone authentication integration to share user credentials
40. Enterprise
41. Multi-Datacenter Replication •  For active backups, availability zones, disaster recovery, global traffic •  Real-time or full sync •  Per-bucket replication •  24/7 support •  Per-node or storage-based pricing
42. Riak CS 1.4 Enterprise •  Increased storage efficiencies •  Multiple TCP connections between clusters – takes advantage of all network’s available resources •  Full support for Version 3 replication (released with Riak 1.4 Enterprise)
43. basho.com SIGN UP FOR AN ENTERPRISE DEVELOPER TRIAL http://docs.basho.com/
44. RICON.io A distributed systems conference RICON25Web for 25% off
45. @basho
 basho.com
 docs.basho.com
 github.com/basho