SOLUTION Liqid Matrix Software & Fabric Technology for Composable Infrastructure VALUE PROP Increase Infrastructure Flexibility, Agility and Efficiency from Core to Edge OPPORTUNITY Transform the Data Center to Software Defined Infrastructure TARGET MARKETS HPC – $38B Cloud – $38B AI – $43B Edge – $33B 100’s of CUSTOMERS Key Awards OFFICES HQ: Broomfield, CO Offices: California, New York, and Texas and UK PATENTS ~85 Patents & IP Filed – ~55 Patents & IP Issued
converged server …then compose and reconfigure …that’s a revolution.” Jensen Huang, NVIDIA CEO Three-Tier Hyperconverged Software Composable Software Defined Data Center Source: Gartner Datacenter Transformation
Servers Enable New Configurations Independent Scaling of Resources Improve SW License Efficiency Decouple Purchasing Decisions Pay As You Grow 2x-3x Extend Product Life Cycle Improved Resource Utilization Benefits of Composable
Composable AI Platform Data Pool Data Ingest Data Clean and Tag Training Inference Dynamic Resource Allocation for Each Stage of AI Workflow Liqid Mgmt. SW
Confidential Liqid Matrix Software and Fabric Servers Nodes Composable Resources (GPU, SSD, NIC, etc.) Liqid Matrix Software and Fabric Dynamic Resource Allocation for Each Stage of A.I. Workflow Use Case: Composable AI Platform
Over Fabric • Plug and Play Performance • Add Up to 20 GPU/Server • Scale Throughput on Demand 16GB/s Throughput 32GB/s Throughput 64GB/s Throughput Liqid EX-4410 PCIe HBA 1U Server
Published Performance for Nvidia Based Solution World Record AI Benchmark Performance 8-Way NVLink = ~22K Images/Sec Source: Orange https://www.liqid.com/blog/orange-silicon-valley-composed-fastest-single-node-gpu-supercomputers-with-liqid-matrix
Confidential Compute Pool Storage Pool PCIe Fabric Storage Pool Networking Pool Accelerators Ethernet Fabric Data Path Control Path Fabric-A PCIe Switch Fabric-B Eth Switch Fabric-A Connection Fabric-B Connection Liqid Mgmt. SW Multi-Fabric Composability
Confidential Vision: Enable Every Server With Composable Software Infrastructure Has Become Software Composable Every server should have dynamically configurable resources to best meet the application layer requirements …. Liqid software is the solution Software Defined Everything
Non-Production Oversized Idle Time Overspent Low Infrastructure Utilization rate THE SPEND: $266.4 Billion THE WASTE: 44% 40% 76% 50% THE SOLUTION: Achieve Up to 90% Datacenter Utilization
Confidential 20% of the world’s electricity by 2025 Massive Amounts of Water Consumption 1,600T Gallons Consumption Per Year 1MW = 8.5M Gallons of Water Per Year 190GW Global Datacenter Power Consumption 8MM+ Datacenters Today 500k Datacenters in 2012 Liqid Enables Up To 2-3x Datacenter Utilization Liqid Enables Up To 75%+ Reduction in Power The Problem: Massive Inefficiency in the Data Center Increasing Power Needs Datacenter Footprint Growth
Confidential Comment: Exascale Compute Requires Massive amounts of water and energy Annual Energy and Water Consumption Statistic: • 40 MW @ $0.10 kWh = $35M Per Year • 6,000 GPM @ 90% Efficiency = ~320M Gallons Per Year Exascale Computing * 6,000 gallons per minute = ~3.15B gallons of water per year * 90% of water is recycled = ~320M gallons lost to evaporation https://www.eia.gov/electricity/state/
Confidential ESG White Paper ESG White Paper on the benefits of composable architectures on sustainability https://cdi.liqid.com/esg- showcase-liqid-sustainability
““Durham University is using cutting-edge CDI to accelerate research, improve resource utilisation, and reduce the university’s carbon footprint” Alastair Basden, Technical Manager DiRAC Memory Intensive Service at Durham University What: • The COSmology MAchine (COSMA8), an HPC system for studying the origin and development of the universe Challenge: • Needed to increase speed and efficiency of COSMA8. • Improve utilisation of GPUs Why Liqid • Maximize utilisation of small number of GPUs • Populate servers with GPUs with the click of a button
- Liqid Awarded as Prime Contractor - Consumes over 85K CPU cores & ~600x GPUs - Liqid was Selected as the Prime Contractor - Listed on Top 200 List for Supercomputers Deployment: ARL - Liqid Awarded as Prime Contractor - Consumes over 100K CPU cores & ~300x GPUs - Liqid was Selected as the Prime Contractor - Listed on Top 200 List for Supercomputers https://blocksandfiles.com/2020/09/24/compose-this-liqid-bags-another-supercomputer-deal/
Top TelCo provider in EMEA … over 300,000 employees worldwide • Goal is to deliver faster but also smarter and more efficient Edge Service • First Goal: Replace cloud-based AI workloads with On-Prem deployments • Second Goal: Offer GPU as a service for Edge deployments … premium product offering • Dynamic edge pod will enable the flexibility needed to meet the most demanding SLAs
Confidential • Multi-Fabric Support PCIe Gen-4, Gen-5, CXL, Ethernet, IB • Multi-Device Support CPU, GPU, FPGA, Storage, Networking • Advanced Protocol Support NVMe-oF and GPU-oF • Software-only Composability Compose devices directly from existing servers • Secure Multitenancy Support Role based access control and advanced security policy • Northbound Integration Compose via Slurm, VMware, K8s • P2P Direct Performance SSD, NIC, GPU, & CPU • Multi-cloud Integration Multi-site Multi-pod composability • Fabric Management & Telemetry Single Pane of Glass UI, CLI, and API • Bare-metal and Virtualized Compose for multiple workload types Increase Flexibility Improve IT Agility Unlock New Levels of Datacenter Efficiency Liqid Matrix Software Features
Confidential PCIe Interconnect Evolution *Bandwidth is for x16 lanes, bi-directional **Transfer Rate is GT/s x1 lane Compute Express Link (CXL) • Provides coherency and memory semantics on top of PCIe Gen 5.0 • High bandwidth/low latency between host processors and devices • Accelerators • Memory buffers • Smart I/O devices PCIe Gen 3.0 • Bandwidth: 32GB/s • Transfer Rate: 8GT/s PCIe Gen 4.0 • Bandwidth: 64GB/s • Transfer Rate: 16GT/s PCIe Gen 5.0 • Bandwidth: 128GB/s • Transfer Rate: 32GT/s Intel Sapphire Rapids & AMD Genoa Servers likely in 1H-2023
Preview Demo • What are we demonstrating? • Liqid Matrix software updated to support CXL fabric type and CXL connected memory endpoints • CXL connected hosts • CXL fabric interconnects • CXL connected memory devices • Results of the demonstration: • Integrate CXL fabric-type into the Liqid Matrix software for composable infrastructure • Utilize a CXL fabric for memory composition to a host • Demonstrate the disaggregation of DRAM from the CPU complex • Proof of concept for end-to-end composable memory from host to memory end-point device
10x FHFL Double-width Gen4 4U 20x FHFL Single-width Gen3 1U 32x U.2 Drives Model Number LQD400x10 LQD400x20 LQD300x32 PCIe Generation Gen 4 Gen 4 Gen 3 Connectivity PCIe PCIe PCIe or Ethernet Device Types Supported GPU | FPGA| NIC | AIC SSD FHFL GPU | FPGA| NIC | AIC SSD FHFL SSD Device Quantity 10x Double Wide 20x Single Wide 32x 2.5" Device Interface PCIe Gen 4.0 x16 PCIe Gen 4.0 x8 PCIe Gen 3.0 x16 Interface Ports 4x PCIe Gen 4.0 x16 4x PCIe Gen 4.0 x16 PCIe: Up to 4x Gen 3.0 x16 Eth: Up to 2x 200GbE NICs Bandwidth - Port Up to 64 GB/s – Full Duplex Up to 64 GB/s – Full Duplex Up to 32GB/s – Full Duplex Bandwidth - Total Up to 256 GB/s – Full Duplex Up to 256 GB/s – Full Duplex Up to 128GB/s – Full Duplex PCIe Fabric Latency 100 ns 100 ns 150 ns Liqid Management Port 2x PCIe Gen 4.0 x1 ports 2x PCIe Gen 4.0 x1 ports N/A Power - Chassis 4 x 2400W 4 x 2400W Dual 1000W w/PMBus PCIe Slot Power Mgmt. Yes Yes N/A Liqid Expansion Chassis Portfolio
LQD9448 LQD9424 Ports 48 Ports 24 Ports Protocol PCIe Gen 4.0 Managed Switching Fabric PCIe Gen 4.0 Managed Switching Fabric Port Bandwidth 16GB/s (Full Duplex) per x4 Port 16GB/s (Full Duplex) per x4 Port Total Bandwidth 768GB/s (Full Duplex) 384GB/s (Full Duplex) Port Latency 100ns 100ns Port Configuration x4, x8, or x16 (SRIS Ready) x4, x8, or x16 (SRIS Ready) Cable Connections Photonics and/or Copper over MiniSAS HD Cabling Photonics and/or Copper over MiniSAS HD Cabling Management Secured, 1 GBASE-T Secured, 1 GBASE-T Failover N+1 Support via Multi Switch N+1 Support via Multi Switch Scalability Supported Supported Form Factor 1U 1U Liqid PCIe Fabric Switches
Confidential Data Traversing CPU/RAM Impacts Performance • Data flows through x86 Root Complex • Bottlenecks Throughput • Injects Latency CPU Memory PCIe Fabric GPU SSD
Confidential Eliminate Costly Data Bottlenecks with Liqid Host CPU Memory PCIe Fabric GPU SSD NIC • Information flows between devices on PCIe bus • Improves throughput • Minimizes latency
Technology Leadership: ~7 years of software code and feature development – major first mover advantage Strategic Partnership: Strong strategic partnerships with OEMs, technology providers, and distribution channel Customer Traction: Significant customer adoption – strong product market fit for core technology Patent Portfolio: >85 Patents Filed and >55 Patents Issued Liqid Market Leadership Competitive Advantage