Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Kubernetes_volume_provisioning_using_Ceph_distributed_storage.pdf

Kyle Bai
September 17, 2017

 Kubernetes_volume_provisioning_using_Ceph_distributed_storage.pdf

Kyle Bai

September 17, 2017
Tweet

More Decks by Kyle Bai

Other Decks in Technology

Transcript

  1. Kubernetes volume provisioning using Ceph distributed storage GCPUG.TW Kyle bai

    R&D @ inwinSTACK www.inwinstack.com © 2017 Kyle Bai Theme. All Rights Reserved. kairen([email protected]) https://kairen.github.io/
  2. About Me Kyle Bai Job R&D@ inwinSTACK Description 早期在校主要撰寫 java

    與 objc 程式語⾔言,並專注於 Mobile 應⽤用程式開發,具備四年年開發經驗。次要研讀 Hadoop 與 Spark 資料運算框架,以及 Linux 相關技術。 研替⼯工作期間則專注於 OpenStack、Ceph 與 Container 相關等 Cloud Native 技術與開源專案,閒暇之餘會參參與相 關專案社區及貢獻,並利利⽤用部落落格、GitHub 與 GitBook 做筆記。 Drink Coffee Mobile Love Good! #7727 Buttocks
  3. Thursday - 7:30 PM Ceph on Kubernetes Deploy a Ceph

    cluster on to a Kubernetes cluster. Ceph in Kubernetes Kubernetes integration with Ceph storage. Thursday - 7:35 PM Thursday - 7:40 PM Thursday - 7:55 PM Ceph storage Ceph uniquely delivers object, block, and file storage in one unified system. Let’s Go Agenda Today I will talk about
  4. Ceph distributed storage • “A Scalable, High-Performance Distributed File System”

    • “performance, reliability, and scalability” • A distributed object, block, and file storage platform • All components scale horizontally • No single point of failure • Hardware agnostic, commodity hardware • No vendor lock-in! • Open source (LGPL) Total downloads 160,015,454 Commits 77,799 Contributors 700+
  5. Ceph Monitor • ~5 per cluster (small odd number) •

    Maintain cluster membership and state • Consensus for decision making • Not part of data path
  6. Ceph OSD • 10s to 1000s per cluster • One

    per disk (HDD, SSD, NVMe) • Serve data to clients • Intelligently peer for replication & recovery
  7. Ceph MDS • Manages metadata for a POSIX- compliant shared

    filesystem • MDS stores metadata in RADOS • Clients stripe le data in RADOS • Only required for shared filesystem
  8. Ceph on Kubernetes • ceph-docker:Docker files and images to run

    Ceph in containers. • openstack-helm:Helm charts for deploying OpenStack on Kubernetes. • rook.io: File, Block, and Object Storage Services for your Cloud-Native Environment.
  9. Block vs Share file • Stripe images across entire cluster

    (pool) • Copy-on-write clones • Read-only snapshots • Incremental backup (relative to snapshots) • Back-end for cloud solutions • KVM/libvirt support • POSIX-compliant semantics • Separates metadata from data • Dynamic rebalancing • FUSE support • NFS/CIFS deployable • Use with Hadoop (replace HDFS)