Kubernetes_volume_provisioning_using_Ceph_distributed_storage.pdf

Transcript

1. Kubernetes volume provisioning using Ceph distributed storage GCPUG.TW Kyle bai R&D @ inwinSTACK www.inwinstack.com © 2017 Kyle Bai Theme. All Rights Reserved. kairen(kyle.b@inwinstack.com) https://kairen.github.io/
2. About Me Kyle Bai Job R&D@ inwinSTACK Description 早期在校主要撰寫 java 與 objc 程式語⾔言，並專注於 Mobile 應⽤用程式開發，具備四年年開發經驗。次要研讀 Hadoop 與 Spark 資料運算框架，以及 Linux 相關技術。 研替⼯工作期間則專注於 OpenStack、Ceph 與 Container 相關等 Cloud Native 技術與開源專案，閒暇之餘會參參與相 關專案社區及貢獻，並利利⽤用部落落格、GitHub 與 GitBook 做筆記。 Drink Coffee Mobile Love Good! #7727 Buttocks
3. Thursday - 7:30 PM Ceph on Kubernetes Deploy a Ceph cluster on to a Kubernetes cluster. Ceph in Kubernetes Kubernetes integration with Ceph storage. Thursday - 7:35 PM Thursday - 7:40 PM Thursday - 7:55 PM Ceph storage Ceph uniquely delivers object, block, and file storage in one unified system. Let’s Go Agenda Today I will talk about
4. Ceph storage Ceph uniquely delivers object, block, and file storage in one unified system.
5. Ceph distributed storage • “A Scalable, High-Performance Distributed File System” • “performance, reliability, and scalability” • A distributed object, block, and file storage platform • All components scale horizontally • No single point of failure • Hardware agnostic, commodity hardware • No vendor lock-in! • Open source (LGPL) Total downloads 160,015,454 Commits 77,799 Contributors 700+
6. Ceph RADOS http://events.linuxfoundation.org/sites/events/files/slides/2015-03-13-vault_0.pdf
7. Ceph cluster http://events.linuxfoundation.org/sites/events/files/slides/2015-03-13-vault_0.pdf
8. Ceph Monitor • ~5 per cluster (small odd number) • Maintain cluster membership and state • Consensus for decision making • Not part of data path
9. Ceph OSD • 10s to 1000s per cluster • One per disk (HDD, SSD, NVMe) • Serve data to clients • Intelligently peer for replication & recovery
10. Ceph MDS • Manages metadata for a POSIX- compliant shared filesystem • MDS stores metadata in RADOS • Clients stripe le data in RADOS • Only required for shared filesystem
11. Ceph data placement http://events.linuxfoundation.org/sites/events/files/slides/2015-03-13-vault_0.pdf
12. Ceph on Kubernetes Deploy a Ceph cluster on to a Kubernetes cluster.
13. K8S Cluster with Local Storage
14. K8S Cluster with External Storage
15. K8S Cluster with Converged Storage
16. K8S Cluster with External K8S Storage
17. Ceph on Kubernetes • ceph-docker:Docker files and images to run Ceph in containers. • openstack-helm:Helm charts for deploying OpenStack on Kubernetes. • rook.io: File, Block, and Object Storage Services for your Cloud-Native Environment.
18. Ceph running in the Kubernetes
19. Ceph in Kubernetes Kubernetes integration with Ceph storage. https://github.com/kairen/ceph-in-k8s
20. Block vs Share file • Stripe images across entire cluster (pool) • Copy-on-write clones • Read-only snapshots • Incremental backup (relative to snapshots) • Back-end for cloud solutions • KVM/libvirt support • POSIX-compliant semantics • Separates metadata from data • Dynamic rebalancing • FUSE support • NFS/CIFS deployable • Use with Hadoop (replace HDFS)
21. Volumes
22. Volumes
23. Persistent Volumes for CephFS
24. Persistent Volumes for RBD
25. Storage Classes for RBD
26. Storage Classes for CephFS
27. 27 有任何問題與想法，可以⼀一起討論唷。 Thank You!!