scale-out NAS for enterprise and HPC workloads Founded: 1999 by Garth Gibson, co-author of Berkeley RAID paper CEO: Faye Pairman Headquarters: Sunnyvale, CA (with sales offices in Europe and Asia) R&D: Sunnyvale, CA and Pittsburgh, PA Markets: Manufacturing, Life Sciences, Media & Entertainment, Energy, Government, Academic Research Global Presence: More than 500 customer deployments globally Financials: Privately held
Performance Panasas Storage Metadata Services • Data and metadata separated • High speed metadata services • Clients access storage directly and in parallel • Consistent performance with no bottlenecks Bulk User Data Traffic CLIENT SYSTEMS PanFS Parallel File System Storage Nodes Director Node
8 - Announced Nov 13, 2018 Fast Simple Flexible Cost-Effective Up to 75GB/s per rack Delivered as an appliance with PanFS8 - the only plug-and-play portable parallel file-system Competitive cost of acquisition and the lowest cost to maintain and administer Seamlessly adapts to changing workloads; Linux and COTS hardware for rapid technology adoption
ActiveStor Ultra with PanFS 8 BeeGFS (COTS HW) IBM Spectrum Scale DDN Lustre Fast ü ü ü ü Simple ü Flexible ü ü ü Cost Effective ü ü * ü * *Limited to cost of acquisition
BEFORE AFTER Fast = Performance over manageability and reliability OR Simple = Manageability and reliability over performance Fast AND Simple Highest Performance, Manageability and Reliability
Future of HPC Storage Reliability Features Benefits Re-engineered PanFS 8 Fast & flexible Intelligent 3-tier data placement Exceptional mixed workload performance Industry standard commodity hardware Flexible & cost-effective Flexible networking options Many different speeds and protocols to match various compute cluster infrastructures Manageability
Intelligent Parallel Filesystem POSIX Filesystem Standard APIs & ease-of-use Object Backend Massive scale-out performance Parallel Filesystem Peak transfer performance Automated Recovery Simplicity of self-managed failure recovery Erasure Coding Distributed for extreme reliability Per-File Striping Spread & defuse all hotspots Ethernet, InfiniBand, OmniPath Flexible connectivity options Single GUI/CLI Simple to manage at any scale Intelligent Data Placement Metadata, small files and large files stored separately
Fast Simple Flexible Cost-Effective Separation of metadata, small files & large files • Higher bandwidth & lower latency • Fast snapshots • Faster recon, better reliability • Transparent to applications • Better mixed workloads • Use the right type of device for each type of content • Balanced architecture Choice of networks • Faster Ethernet speeds • InfiniBand & OmniPath • Pre-configured • Matches compute cluster • Just the bandwidth you need • Direct connectivity Linux-based • Get the most from the H/W • Wide range of H/W supported • Still an appliance • Faster adoption of new technology • Industry standard H/W • More price/performance options to choose from
Administrative effort remains low, regardless of scale Panasas Competition Administrative effort increases with scale ~ $200K over 5 years for a 5PB system ~ $3M over 5 years for a 5PB system
Budgetary Costs Indirect Costs of Lower Availability Set-up and installation • Cost of expert manpower for weeks • Training cost for system administrators Lost productivity • Fatter storage nodes increase impact of outage • Lack of resiliency in the face of change and errors Ongoing system administration • Cost of recruiting highly skilled personnel • Salaries of highly skilled and in-demand staff Failure recovery • Elongated reconstruction times after outage • Crashes can lead to multi-week outages Tuning, retuning, optimization • Requires specialized IT expertise • Constant (re)tuning for changing workloads • Productivity impact of constant tuning Customer support • Dependent upon the community for information and resolutions • Extended time to problem resolution
Hardware • Intel Xeon E5-1630v4 3.7GHz 4-core Broadwell CPU • 96GB DDR4 RAM • 8GB NVDIMM • 2x40/4x10 GE Chelsio NIC • IPMI including web interface • Dual redundant 1600W power • 500GB SSD for local storage • 2U chassis with 4 nodes 12/4/18 L 25
Ethernet Single Realm with ActiveStor Prime and ActiveStor Ultra DirectFlow Over Ethernet High B/W DirectFlow Clients (Linux, Mac) Standard Protocol Clients (Linux, Mac, Win) ActiveStor Prime BladeSet ActiveStor Ultra BladeSet Massively Scale-Out Object Store ActiveStor Directors Metadata Processing & Protocol Gateways Low Latency DirectFlow Clients (Linux) DirectFlow Over InfiniBand or OmniPath
PanFS 8 - The Future of HPC Storage • Portable parallel filesystem on industry standard commodity hardware • Highest levels of performance • Plug-and-play simplicity • Lowest TCO
Simple Flexible 75GB/s per rack Consistently fast, regardless of complexity Dock to data in 1 hour Linearly scale performance without limitation Automated data reliability; no intervention needed No tuning or retuning required as workloads change Quickly adopt new features and technologies Forward and backward compatibility Cost-Effective Competitive cost for exceptional performance One admin at any scale Increased productivity (no tuning/retuning, minimized downtime) Exceptional at mixed workloads