Slide 1

Slide 1 text

BUILDING COMPLETE PRIVATE CLOUDS WITH APACHE CLOUDSTACK + RIAK CS John Burwell ([email protected] | @john_burwell) Wednesday, October 23, 13

Slide 2

Slide 2 text

Who Am I • Consulting Engineer @ Basho Technologies • Member, Apache CloudStack PMC • Ran operations and designed automated provisioning for hybrid analytic/virtualization clouds • Led architectural design and server-side development of a SaaS physical security platform Wednesday, October 23, 13

Slide 3

Slide 3 text

... but I submitted a ticket. Wednesday, October 23, 13

Slide 4

Slide 4 text

Shifting Role Of IT From Cost Center To Business Opportunity Wednesday, October 23, 13

Slide 5

Slide 5 text

Wednesday, October 23, 13

Slide 6

Slide 6 text

Agility Exploitation Requires Rapid Execution Infrastructure management must be delegated Wednesday, October 23, 13

Slide 7

Slide 7 text

Agility Exploitation Requires Rapid Execution Infrastructure management must be delegated Infrastructure Must Become Boring Wednesday, October 23, 13

Slide 8

Slide 8 text

Composable Infrastructure • Resource Pooling • Rapid Elasticity • Self Service • Metering/Charge Back Wednesday, October 23, 13

Slide 9

Slide 9 text

Got It ... Why Go Private? • Leverage existing infrastructure investment • Customization and Control • Regulatory/Security Requirements • Cost Wednesday, October 23, 13

Slide 10

Slide 10 text

Doesn’t vSphere/ XCP/XenServer already do that? Wednesday, October 23, 13

Slide 11

Slide 11 text

Traditional Workload Management Network Hypervisor Cluster Hypervisor Cluster Shared

Slide 12

Slide 12 text

Traditional Workload Management Network Hypervisor Cluster Hypervisor Cluster Shared

Slide 13

Slide 13 text

Software Is Eating Hardware • Moore’s Law has pulled fault tolerance up the stack • Commodity Hardware • Reduced cost • Services more workload types • Dynamic resource allocation Wednesday, October 23, 13

Slide 14

Slide 14 text

Software Is Eating Hardware • Moore’s Law has pulled fault tolerance up the stack • Commodity Hardware • Reduced cost • Services more workload types • Dynamic resource allocation Specialized Hardware Reduces Agility Wednesday, October 23, 13

Slide 15

Slide 15 text

Cloud Workload • Reliable • Fault Tolerant • Commodity Hardware • Self-Service provisioning • Control Plane -> Dynamic scale out model SDN Rack Rack Object

Slide 16

Slide 16 text

Cloud Workload • Reliable • Fault Tolerant • Commodity Hardware • Self-Service provisioning • Control Plane -> Dynamic scale out model SDN Rack Rack Object

Slide 17

Slide 17 text

Traditional Workload Cloud Workload Reality Wednesday, October 23, 13

Slide 18

Slide 18 text

Complete Private Cloud + Compute Services Object Storage Services Wednesday, October 23, 13

Slide 19

Slide 19 text

What Is Apache CloudStack? §Open source software that deploys and manages large networks of virtual machines, as a highly available, highly scalable Infrastructure as a Service (IaaS) cloud computing platform. §CloudStack is a Top-Level Project at the Apache Software Foundation. Wednesday, October 23, 13

Slide 20

Slide 20 text

What Is Apache CloudStack? §Open source software that deploys and manages large networks of virtual machines, as a highly available, highly scalable Infrastructure as a Service (IaaS) cloud computing platform. §CloudStack is a Top-Level Project at the Apache Software Foundation. Wednesday, October 23, 13

Slide 21

Slide 21 text

Apache CloudStack Users Wednesday, October 23, 13

Slide 22

Slide 22 text

Anatomy Of CloudStack • Management Server Farm • Management and provisioning tasks • Zone • Collection of pods, network offerings and secondary storage • Pod • Collection of clusters in the same failure boundary • Cluster • A grouping of hosts and their associated storage • Hosts • Servers onto which services will be provisioned • Primary Storage • VM disk storage • Network • Logical network associated with service offerings • Secondary Storage • Template, snapshot and ISO storage Zone CloudStack Pod Cluster Host Host Network Primary Storage VM VM CloudStack Pod Cluster Secondary Storage Wednesday, October 23, 13

Slide 23

Slide 23 text

Primary Vs Secondary Storage • Random access read/write • Changes often • Zone Scoped • Focused on throughput • Write once/read many • Append only • Zone or Region Scoped • Focused on reliability Wednesday, October 23, 13

Slide 24

Slide 24 text

Primary Vs Secondary Storage • Random access read/write • Changes often • Zone Scoped • Focused on throughput • Write once/read many • Append only • Zone or Region Scoped • Focused on reliability Secondary Storage is the lifeboat. Wednesday, October 23, 13

Slide 25

Slide 25 text

What Is Riak CS? • Simple, reliable storage of large objects accessed using the S3 or Swift API • Objects are stored in buckets with a unique key • Multi-tenant security model with per object ACLs • Usage Accounting and Reporting • Open Source (Apache2 Licensed) Wednesday, October 23, 13

Slide 26

Slide 26 text

What Is Riak CS? • Simple, reliable storage of large objects accessed using the S3 or Swift API • Objects are stored in buckets with a unique key • Multi-tenant security model with per object ACLs • Usage Accounting and Reporting • Open Source (Apache2 Licensed) Your Own Private S3 Wednesday, October 23, 13

Slide 27

Slide 27 text

Anatomy Of Riak CS • S3/Swift API Proxy + Riak key-value store • Peer-to-Peer Design: Any node can service any read or accept any write request • Maintains multiple replicas (default 3) spread across multiple nodes • Ops Friendly Wednesday, October 23, 13

Slide 28

Slide 28 text

Anatomy Of Riak CS • S3/Swift API Proxy + Riak key-value store • Peer-to-Peer Design: Any node can service any read or accept any write request • Maintains multiple replicas (default 3) spread across multiple nodes • Ops Friendly Horizontally scaleable storage on commodity hardware Wednesday, October 23, 13

Slide 29

Slide 29 text

Riak CS Use Cases • Secondary Storage for VM snapshot and template data • Database Backup Storage • Serving Static Content • Application Log Storage Wednesday, October 23, 13

Slide 30

Slide 30 text

Achieving Commodity Reliability • Create a zone per power source/backbone network connection • Establish independent primary storage in each zone • Utilize intra-datacenter block-level replication between zones • Distribute Riak CS nodes evenly across zones Wednesday, October 23, 13

Slide 31

Slide 31 text

The Complete Private Cloud Management Network Hypervisor Cluster Hypervisor Cluster Shared

Slide 32

Slide 32 text

Up And Running With Riak CS • Learn more @ http://basho.com/riak-cloud-storage • Grab it @ http://docs.basho.com/riakcs/latest/riakcs- downloads/ • Follow us @basho • Help from the [email protected] mailing list or on FreeNode @ #riak • Contribute @ http://github.com/basho/riak_cs Wednesday, October 23, 13

Slide 33

Slide 33 text

Join Our Community • Learn more @ http://cloudstack.apache.org • Grab it @ http://cloudstack.apache.org/downloads.html • Follow us @cloudstack • Help from the [email protected] mailing list or on Freenode @ #cloudstack • Contribute on the [email protected] mailing list or on Freenode @ #cloudstack-dev Wednesday, October 23, 13

Slide 34

Slide 34 text

Thoughts? Questions? Wednesday, October 23, 13

Slide 35

Slide 35 text

Thank you! Deck http://slideshare.net/JohnBurwell1 Follow @ john_burwell Email [email protected] Wednesday, October 23, 13