Salient Features Enables capacity and clients/IOPS/throughput scaling No block is over-written Disaggregated Block Storage Suitable for Endurance of Enterprise/DataCenter grade SSD Sub-millisecond latency and 9GB/controller throughput User space NVMe drivers RDMA backend network SSD friendly log-structured write Persistent Memory Kernel bypass High Availability
Kit (SPDK) Intel driven and open-source user space NVMe driver highly parallel access directly to an SSD avoids all locks in the I/O path by message passing a full block stack as a user space library NVMe-oF support
Service Scaling Stateless services Provides multipathing for client connections Serves metadata of shards of volumes determined by hashing Shards of different volumes are distributed among these services Shared-CPU Pools with floating affinity to server CPUs Resilient to controller failures Performs Garbage Collection for space reclamation Controller Nodes Scale
Service Scaling Resilient metadata+storage services Controller Nodes Scale Stateless services Provides multipathing for client connections Serves metadata of shards of volumes determined by hashing Shards of different volumes are distributed among these services Shared-CPU Pools with floating affinity to server CPUs Resilient to controller failures Performs Garbage Collection for space reclamation
Service Scaling Controller Nodes Resilient metadata+storage services Gets distributed as more controller nodes are added but manages the same shards of volumes Resilient to controller failures by re-distribution among active nodes