Storage Policies in Openstack Swift (coming soon)

These slides were part of a small talk + demo at http://www.meetup.com/Indian-OpenStack-User-Group/events/173701902/.

Transcript

1. Storage Policies in Openstack Swift (Coming Soon) Prashanth Pai Red Hat
2. 2 What is OpenStack Swift ? • Object is { Data + Meta-data + Identifier } • Alternative to Amazon S3 • Decoupled/Independent from OpenStack • Unstructured data • Scales horizontally Swift is a highly available, distributed, eventually consistent object store. But you can't.. • Mount it • Have file hierarchies Hierarchy Account -> Containers -> Objects
4. 4 All operations are carried out by sending HTTP requests. Each object’s access path consists of exactly three elements: /account/container/object GET 'X-Auth-Token: blah_blah' http://127.0.0.1:8080/v1/AUTH_test/c1/a/b/c/d/z Proxy-server Account Container Object Request method Request header
5. 5 Path = account/container/object Hash = md5sum( prefix + Path + suffix) pipeline = catch_errors healthcheck proxy-logging cache proxy-logging tempauth account_quotas proxy-server
6. 6 Trying to understand how the Swift ring works http://openstackreactions.enovance.com/
7. 7 Before SP One could set... • Replica count • Drive weight • Region and Affinity With SP Define policies based on... • Geography • Hardware properties • EC vs Replica • Backend Storage (like GlusterFS)
8. 8 Swift Storage Policy, Where, When ? And how to contribute... Blueprint: https://blueprints.launchpad.net/swift/+spec/storage-policies Trello: https://trello.com/b/LlvIFIQs/swift-erasure-codes-and-storage-policies Code: https://github.com/openstack/swift/tree/feature/ec Docs: (under review) https://review.openstack.org/85824
9. 9 Demo Swift + Storage Policy + GlusterFS Setup • SAIO: 4 node, 3 replica Swift cluster based on XFS • Two storage policies – default and glusterfs • One GlusterFS volume • Gluster-Swift object-server