2018_Ottawa_Q2_CNCF_Meetup Using Rook for PV in K8s

This talk will walk through the deployment of the Rook Operator tool, and how it creates a Ceph storage cluster on your Kubernetes infrastructure. I will showcase the monitoring of the solution with Prometheus, and show read/write speed results when using Rook PV's.

Transcript

1. USING ROOK FOR PERSISTENTVOLUMES RAYMOND MAIKA MAY 15TH, 2018
2. Agenda • What is Rook? • Rook Architecture • Deploying Ceph with Rook • Monitoring Ceph on K8s • Demo of I/O and monitoring • Upcoming Rook Features
3. What is Rook? “Rook is an open source orchestrator for distributed storage systems running in Kubernetes.”
4. Current State • Alpha v0.7.1 – Focus on Ceph storage • Alpha v0.8.0 in progress (June) – Extending rook-operator to support other storage backends • v0.9.0 will be Beta status – Improved state durability – recovering from node loss – Snapshotting Ref: https://github.com/rook/rook/blob/master/ROADMAP.md
5. etcd etcd Rook Design Kubernetes API kubectl etcd Rook Operator Rook Agent Flexvolume Driver Kubelet Rook vol. plugin Attach & Mount Operations Management & Health API New Object: Volume Attachment New Objects: Storage Clusters Storage Pools Object Store File Store Ref: https://rook.io/docs/rook/master/
6. Rook Architecture - Ceph Container Container Container Container Volume Claim Volume Claim Rook-agent Rook-agent Rook-agent Rook-agent Rook-agent Operator Ref: https://rook.io/docs/rook/master/
7. Monitoring Ceph on K8s • Ceph Manager Daemon (ceph-mgr) – Became required since 12.x (luminous) release – Used to provide monitoring interfaces – Has a Prometheus plugin • http://docs.ceph.com/docs/mast er/mgr/prometheus/
8. Demo • Show Cluster and Pool CRDs • Rook-tools Pod usage • Write 10GB to 10 separate volumes using 10 Jobs • Read 10GB from each volume using 10 Jobs
9. Next Features for Rook • Alternate storage backends – Minio Operator (v0.8.0) – CockroachDB Operator (v0.8.0) – Demo at KubeCon • Ceph CSI plugin support (v0.9.0) – Removes many dependencies from rook-agent