Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Riak CS Introduction
Search
Basho Technologies
April 02, 2013
Technology
7
3.7k
Riak CS Introduction
Intro to Riak CS presentation. Covers architecture, features, operations, stats and interfaces.
Basho Technologies
April 02, 2013
Tweet
Share
More Decks by Basho Technologies
See All by Basho Technologies
Ringpop by Uber
basho
1
7.3k
Realtime Systems for Social Data Analysis (RICON East 2013)
basho
3
800
How Do You Eat An Elephant? (RICON East 2013)
basho
0
1.2k
Revolution in Storage (RICON East 2013)
basho
3
1.5k
Automatically Scalable Computation (RICON East 2013)
basho
2
1.5k
Riak Enterprise Revisited (RICON East 2013)
basho
0
310
Large Scale Data Service as a Service (RICON East 2013)
basho
0
1.2k
Optimizing LevelDB for Performance and Scale (RICON East 2013)
basho
5
2.5k
Firefighting Riak at Scale (RICON East 2013)
basho
1
480
Other Decks in Technology
See All in Technology
Command-line interface tool design / PHPerKaigi 2024
k1low
4
1k
調整さんの調整結果をカレンダーへ登録するGPTsを作った話
hrsano645
1
160
プロデザ! BY リクルートvol.17_『じゃらんnet』公式アプリの高速リニューアル事例を大公開
recruitengineers
PRO
5
110
AWS IAM の結果整合性を避けるためセッションポリシーを用いてポリシーの動作確認を行う、を解説する
yukihirochiba
0
370
UIからの自動テスト事例
tomasagi
8
3.3k
パフォーマンスを改善するには仕様変更が1番はやい
yamamotohiroya
12
4.6k
どうやってWebサービスのページ表示速度を1/3にしたか / how-to-reduce-display-speed
pinkumohikan
2
470
B+木入門:PHPで理解する データベースインデックスの仕組み/b-plus-tree-101
hanhan1978
5
2.7k
出張! #DevelopersIO IT技術ブログの中の人が語る勉強会 「【速報】AWSの生成AIサービスであるAmazon Bedrock がリリースされたので朝イチで触ってみた」について語る
oshanqq
0
290
S3成長記録@Storage-JAWS#3
p0n
0
130
Automate your changelogs! Release Drafter
onenashev
PRO
2
410
MLOpsのエッセンスを取り⼊れて評価 pipelineを再構築している件
sansantech
PRO
1
230
Featured
See All Featured
Designing the Hi-DPI Web
ddemaree
275
33k
The Illustrated Children's Guide to Kubernetes
chrisshort
28
46k
Building Adaptive Systems
keathley
29
1.8k
Bash Introduction
62gerente
604
210k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
8
8.2k
Rebuilding a faster, lazier Slack
samanthasiow
72
8.1k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
319
20k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
18
6.8k
Typedesign – Prime Four
hannesfritz
36
2k
Fireside Chat
paigeccino
19
2.5k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
39
4.3k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
14
1.3k
Transcript
Simple, Available Cloud Storage
github.com/basho twitter.com/basho docs.basho.com
Overview
On March 27, 2012 Basho announced a new product called
Riak CS
On March 20, 2013 Riak CS became open source
Riak CS is... enterprise cloud storage Riak S3-compatibility multi-tenancy per
user reporting built on top of large object storage
Enabling you to host your own PUBLIC PRIVATE & CLOUDS
or…. Reliable Storage Behind Apps
About Riak
Riak Dynamo-inspired key/value store Written in Erlang with C/C++ Open
source under Apache 2 license Thousands of production deployments
Riak High availability Low-latency Horizontal scalability Fault-tolerance Ops friendliness
Riak Masterless • No master/slave or different roles • All
nodes are equal • Write availability and scalability • All nodes can accept/route requests
Riak No Sharding • Consistent hashing • Prevents “hot spots”
• Lowers operational burden of scale • Data rebalanced automatically
Riak Availability and Fault-Tolerance • Automatically replicates data • Read
and write data during hardware failure and network partition • Hinted handoff
How It Works
Riak CS Riak Stanchion
Riak CS node for every node of Riak 1
Riak Node Riak Node Riak Node Riak Node Riak Node
Large Object Riak CS S3 API Reporting API Riak CS S3 API Reporting API Riak CS S3 API Reporting API Riak CS S3 API Reporting API Riak CS S3 API Reporting API 1. User uploads an object 1 MB 2. Riak CS breaks object into 1 MB chunks 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 3. Riak CS streams chunks to Riak nodes 4. Riak replicates and stores chunks
USERS multi-tenancy: Riak CS will track individual usage/stats access_key secret_key
users identified by users authenticated by
BUCKETS users create buckets. buckets are like folders. store objects
in buckets. names are globally unique.
OBJECTS stored in buckets. objects are opaque. store any file
type.
Features
Riak CS Large Object Support • Started with 5GB /
object • Now have multipart upload • Content agnostic
Riak CS S3-Compatible API • Use existing S3 libraries and
tools • RESTful operations • Multipart upload • S3-style ACLs for object/bucket permissions • S3 authentication scheme
Riak CS Administration and Users • Interface for user creation,
deletion, and credentials • Configure so only admins can create users
Riak CS New Stuff in Riak 1.3 • Multipart upload:
parts between 5MB and 5GB • Support for GET range queries • Restrict access to buckets based on source IP
Riak CS
Riak CS Packages • Debian • Ubuntu • FreeBSD •
Mac • Red Hat Enterprise • Fedora • SmartOS • Solaris • Source
Operations
stats DTrace & built-in support track access & storage per
user monitor total cluster ops inspect ops with DTrace probes
OPERATIONAL STATS exposed via HTTP resource: /riak-cs/stats block bucket object
GET, PUT, DELETE LIST KEYS, CREATE, DELETE, GET/PUT ACL GET, PUT, DELETE HEAD, GET/PUT ACL HISTOGRAMS & COUNTERS
TRACK INDIVIDUAL USER’S THE “USAGE” BUCKET ACCESS STORAGE
QUERY USAGE STATS Storage and access statistics tracked on per-user
basis, as rollups for slices of time • Operations, Count, BytesIn, BytesOut, + system and user error • Objects, Bytes
Partnerships
Citrix CloudStack • Combined platform for compute and storage •
Summer ‘13: integrated authentication support • Videos on our blog
Enterprise
Multi-Datacenter Replication • For active backups, availability zones, disaster recovery,
global traffic • Real-time or full-sync • 24/7 support • Per-node or storage-based pricing
basho.com SIGN UP FOR AN ENTERPRISE DEVELOPER TRIAL http://docs.basho.com/
RICON.io A distributed systems conference RICON25Web for 25% off
github.com/basho twitter.com/basho docs.basho.com
Q&A