Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Liqid - IT Press Tour June 2021

Liqid - IT Press Tour June 2021

The IT Press Tour

June 10, 2021
Tweet

More Decks by The IT Press Tour

Other Decks in Technology

Transcript

  1. © 2021 Liqid, Inc. All rights reserved. 2 Proprietary &

    Confidential Three-Tier Hyperconverged Software Composable Disaggregate the converged server… Then compose and reconfigure… That’s a revolution. Jensen Huang, CEO of Nvidia Datacenter Transformation Software Defined Data Center Source: Gartner
  2. © 2021 Liqid, Inc. All rights reserved. 3 Proprietary &

    Confidential Storage NVMe Flash / Optane Hosts Intel / AMD / ARM Networking NIC Accelerators GPU / FPGA / DPU Dynamically Configured Servers Disaggregated Resource Pools Composable Software & Fabric Static Servers Legacy Infrastructure Modern Infrastructure Composable Infrastructure Statically Configured Dynamically Configurable
  3. © 2021 Liqid, Inc. All rights reserved. 4 Proprietary &

    Confidential Benefits of Composable Dynamically Configured Servers Enable New Configurations Independent Scaling of Resources Improve SW License Efficiency Decouple Purchasing Decisions Pay As You Grow 2x-3x Extend Product Life Cycle Improved Resource Utilization
  4. © 2021 Liqid, Inc. All rights reserved. 5 Proprietary &

    Confidential Dynamic Cloud Computing Command Center Storage Pool Compute Pool Networking Pool Accelerator Pool Fabric Bare Metal Server-1 Bare Metal Server-2 Bare Metal Server-N
  5. © 2021 Liqid, Inc. All rights reserved. 6 Proprietary &

    Confidential Cloud Flexibility at Lower Cost
  6. © 2021 Liqid, Inc. All rights reserved. 7 Proprietary &

    Confidential 6/10/21 7 (Night Workload) (Day Workload) (GPU Pool) Dynamic Reallocate Resources to Enable Improved Hardware Utilization Video Rendering A.I. Engineering Media & Entertainment
  7. © 2021 Liqid, Inc. All rights reserved. 8 Proprietary &

    Confidential Composable AI Workflow
  8. © 2021 Liqid, Inc. All rights reserved. 9 Proprietary &

    Confidential Liqid Matrix Software and Fabric Servers Nodes Composable Resources (GPU, SSD, NIC, etc.) Liqid Matrix Software and Fabric Dynamic Resource Allocation for Each Stage of A.I. Workflow Use Case: Composable AI Platform
  9. © 2021 Liqid, Inc. All rights reserved. 10 Proprietary &

    Confidential Liqid Comprehensive Composable Portfolio PCIe Fabric Resource Expansion Management & Matrix Software 48-Port PCIe Fabric Switch 32-Bay JBOX 10/20 Slot JBOX 16-Port Director 1U 1U 4U 1U GPU | FPGA | SSD | NIC SSD | Storage Class Memory (SCM)
  10. © 2021 Liqid, Inc. All rights reserved. 11 Proprietary &

    Confidential Putting it All Together Host Expansion Chassis Fabric Switch PCIe or Ethernet Adapter Card (rear)
  11. © 2021 Liqid, Inc. All rights reserved. 12 Proprietary &

    Confidential Disaggregated Composable Infrastructure Optane Memory Expansion GPU | FPGA NVMe | NIC | DPU Hosts Command Center Hosts NVMe Flash
  12. © 2021 Liqid, Inc. All rights reserved. 13 Proprietary &

    Confidential Composable Rack Scale Reference Design 48TB Storage Class Memory 144x Hardware Accelerators (GPUs, FPGAs, NICs, etc) 1.1PB NVMe Storage 96x High-Performance Compute Nodes Liqid Matrix Fabric Switch Legacy IB/Eth Networking
  13. © 2021 Liqid, Inc. All rights reserved. 14 Proprietary &

    Confidential Deployment: ERDC - Award was Granted in September - Consumes over 85K CPU cores & ~600x GPUs - Liqid was Selected as the Prime Contractor - Top 20 Supercomputer on Top 200 List Deployment: ARL - Award was Granted in August - Consumes over 100K CPU cores & ~300x GPUs - Liqid was Selected as the Prime Contractor - Top 20 Supercomputer on Top 200 List https://blocksandfiles.com/2020/09/24/compose-this-liqid-bags-another-supercomputer-deal/
  14. © 2021 Liqid, Inc. All rights reserved. 15 Proprietary &

    Confidential Full Stack Composability PCI Express (Gen 4) Fabric Layer (Commodity HW) Device Layer (Commodity HW) Application & Virtualization Layer Ethernet InfiniBand PCI Express (Gen 5) Gen Z CXL Accelerators Liqid Matrix SW Layer Networking Pool Storage Pool CPU Pool FPGA Pool Future (i.e. DPUs etc) Memory GPU Pool
  15. © 2021 Liqid, Inc. All rights reserved. 16 Proprietary &

    Confidential Compute Pool Storage Pool PCIe Fabric Storage Pool Networking Pool Accelerators Ethernet Fabric Data Path Control Path Fabric-A PCIe Switch Fabric-B Eth Switch Fabric-A Connection Fabric-B Connection Liqid Mgmt. SW Multi-Fabric Composability
  16. © 2021 Liqid, Inc. All rights reserved. 17 Proprietary &

    Confidential Host 1 Host 2 Host N Storage Host NIC GPU Rest API Liqid Mgmt. SW Resource Pools Bare Metal Hosts Data Center Orchestration
  17. © 2021 Liqid, Inc. All rights reserved. 18 Proprietary &

    Confidential VMWare vCenter Integration
  18. © 2021 Liqid, Inc. All rights reserved. 19 Proprietary &

    Confidential Machine Containers and Templates
  19. © 2021 Liqid, Inc. All rights reserved. 20 Proprietary &

    Confidential Policy Based Management
  20. © 2021 Liqid, Inc. All rights reserved. 21 Proprietary &

    Confidential Enable High Performance GPU Scale-Out Solutions Resnet ð Octane ð V-Ray Benchmark Record Holder 20x 1x GPU CPU 960 1,908 3,747 7,369 13,386 15,814 0 2000 4000 6000 8000 10000 12000 14000 16000 18000 1 2 4 8 16 20 NVIDIA RTX8000 GPU 20 GPU Supercomputer Resnet50 – Images/Sec
  21. © 2021 Liqid, Inc. All rights reserved. 22 Proprietary &

    Confidential Unlock Previously Impossible GPU Configurations 20x RTX8000 GPUs 1x CPU Resnet ð Octane ð V-Ray Benchmark Record Holder 20x 1x GPU CPU
  22. © 2021 Liqid, Inc. All rights reserved. 23 Proprietary &

    Confidential Liqid Compute and GPU Scalable Solutions 20x 4x GPU CPU 20x 2x GPU CPU 20x 1x GPU CPU
  23. © 2021 Liqid, Inc. All rights reserved. 24 Proprietary &

    Confidential RDMA Peer-2-Peer Delivers Up To 10x Higher Performance Peer-to-Peer Performance
  24. © 2021 Liqid, Inc. All rights reserved. 25 Proprietary &

    Confidential Bandwidth P2P Disabled = 9 GB/s P2P Enabled = 25 GB/s (~300% increase) Latency P2P Disabled = 20 us P2P Enabled = 2 us (~90% reduction) Peer-to-Peer Performance