Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Liqid - IT Press Tour June 2021

Liqid - IT Press Tour June 2021

Avatar for The IT Press Tour

The IT Press Tour

June 10, 2021
Tweet

More Decks by The IT Press Tour

Other Decks in Technology

Transcript

  1. © 2021 Liqid, Inc. All rights reserved. 2 Proprietary &

    Confidential Three-Tier Hyperconverged Software Composable Disaggregate the converged server… Then compose and reconfigure… That’s a revolution. Jensen Huang, CEO of Nvidia Datacenter Transformation Software Defined Data Center Source: Gartner
  2. © 2021 Liqid, Inc. All rights reserved. 3 Proprietary &

    Confidential Storage NVMe Flash / Optane Hosts Intel / AMD / ARM Networking NIC Accelerators GPU / FPGA / DPU Dynamically Configured Servers Disaggregated Resource Pools Composable Software & Fabric Static Servers Legacy Infrastructure Modern Infrastructure Composable Infrastructure Statically Configured Dynamically Configurable
  3. © 2021 Liqid, Inc. All rights reserved. 4 Proprietary &

    Confidential Benefits of Composable Dynamically Configured Servers Enable New Configurations Independent Scaling of Resources Improve SW License Efficiency Decouple Purchasing Decisions Pay As You Grow 2x-3x Extend Product Life Cycle Improved Resource Utilization
  4. © 2021 Liqid, Inc. All rights reserved. 5 Proprietary &

    Confidential Dynamic Cloud Computing Command Center Storage Pool Compute Pool Networking Pool Accelerator Pool Fabric Bare Metal Server-1 Bare Metal Server-2 Bare Metal Server-N
  5. © 2021 Liqid, Inc. All rights reserved. 6 Proprietary &

    Confidential Cloud Flexibility at Lower Cost
  6. © 2021 Liqid, Inc. All rights reserved. 7 Proprietary &

    Confidential 6/10/21 7 (Night Workload) (Day Workload) (GPU Pool) Dynamic Reallocate Resources to Enable Improved Hardware Utilization Video Rendering A.I. Engineering Media & Entertainment
  7. © 2021 Liqid, Inc. All rights reserved. 8 Proprietary &

    Confidential Composable AI Workflow
  8. © 2021 Liqid, Inc. All rights reserved. 9 Proprietary &

    Confidential Liqid Matrix Software and Fabric Servers Nodes Composable Resources (GPU, SSD, NIC, etc.) Liqid Matrix Software and Fabric Dynamic Resource Allocation for Each Stage of A.I. Workflow Use Case: Composable AI Platform
  9. © 2021 Liqid, Inc. All rights reserved. 10 Proprietary &

    Confidential Liqid Comprehensive Composable Portfolio PCIe Fabric Resource Expansion Management & Matrix Software 48-Port PCIe Fabric Switch 32-Bay JBOX 10/20 Slot JBOX 16-Port Director 1U 1U 4U 1U GPU | FPGA | SSD | NIC SSD | Storage Class Memory (SCM)
  10. © 2021 Liqid, Inc. All rights reserved. 11 Proprietary &

    Confidential Putting it All Together Host Expansion Chassis Fabric Switch PCIe or Ethernet Adapter Card (rear)
  11. © 2021 Liqid, Inc. All rights reserved. 12 Proprietary &

    Confidential Disaggregated Composable Infrastructure Optane Memory Expansion GPU | FPGA NVMe | NIC | DPU Hosts Command Center Hosts NVMe Flash
  12. © 2021 Liqid, Inc. All rights reserved. 13 Proprietary &

    Confidential Composable Rack Scale Reference Design 48TB Storage Class Memory 144x Hardware Accelerators (GPUs, FPGAs, NICs, etc) 1.1PB NVMe Storage 96x High-Performance Compute Nodes Liqid Matrix Fabric Switch Legacy IB/Eth Networking
  13. © 2021 Liqid, Inc. All rights reserved. 14 Proprietary &

    Confidential Deployment: ERDC - Award was Granted in September - Consumes over 85K CPU cores & ~600x GPUs - Liqid was Selected as the Prime Contractor - Top 20 Supercomputer on Top 200 List Deployment: ARL - Award was Granted in August - Consumes over 100K CPU cores & ~300x GPUs - Liqid was Selected as the Prime Contractor - Top 20 Supercomputer on Top 200 List https://blocksandfiles.com/2020/09/24/compose-this-liqid-bags-another-supercomputer-deal/
  14. © 2021 Liqid, Inc. All rights reserved. 15 Proprietary &

    Confidential Full Stack Composability PCI Express (Gen 4) Fabric Layer (Commodity HW) Device Layer (Commodity HW) Application & Virtualization Layer Ethernet InfiniBand PCI Express (Gen 5) Gen Z CXL Accelerators Liqid Matrix SW Layer Networking Pool Storage Pool CPU Pool FPGA Pool Future (i.e. DPUs etc) Memory GPU Pool
  15. © 2021 Liqid, Inc. All rights reserved. 16 Proprietary &

    Confidential Compute Pool Storage Pool PCIe Fabric Storage Pool Networking Pool Accelerators Ethernet Fabric Data Path Control Path Fabric-A PCIe Switch Fabric-B Eth Switch Fabric-A Connection Fabric-B Connection Liqid Mgmt. SW Multi-Fabric Composability
  16. © 2021 Liqid, Inc. All rights reserved. 17 Proprietary &

    Confidential Host 1 Host 2 Host N Storage Host NIC GPU Rest API Liqid Mgmt. SW Resource Pools Bare Metal Hosts Data Center Orchestration
  17. © 2021 Liqid, Inc. All rights reserved. 18 Proprietary &

    Confidential VMWare vCenter Integration
  18. © 2021 Liqid, Inc. All rights reserved. 19 Proprietary &

    Confidential Machine Containers and Templates
  19. © 2021 Liqid, Inc. All rights reserved. 20 Proprietary &

    Confidential Policy Based Management
  20. © 2021 Liqid, Inc. All rights reserved. 21 Proprietary &

    Confidential Enable High Performance GPU Scale-Out Solutions Resnet ð Octane ð V-Ray Benchmark Record Holder 20x 1x GPU CPU 960 1,908 3,747 7,369 13,386 15,814 0 2000 4000 6000 8000 10000 12000 14000 16000 18000 1 2 4 8 16 20 NVIDIA RTX8000 GPU 20 GPU Supercomputer Resnet50 – Images/Sec
  21. © 2021 Liqid, Inc. All rights reserved. 22 Proprietary &

    Confidential Unlock Previously Impossible GPU Configurations 20x RTX8000 GPUs 1x CPU Resnet ð Octane ð V-Ray Benchmark Record Holder 20x 1x GPU CPU
  22. © 2021 Liqid, Inc. All rights reserved. 23 Proprietary &

    Confidential Liqid Compute and GPU Scalable Solutions 20x 4x GPU CPU 20x 2x GPU CPU 20x 1x GPU CPU
  23. © 2021 Liqid, Inc. All rights reserved. 24 Proprietary &

    Confidential RDMA Peer-2-Peer Delivers Up To 10x Higher Performance Peer-to-Peer Performance
  24. © 2021 Liqid, Inc. All rights reserved. 25 Proprietary &

    Confidential Bandwidth P2P Disabled = 9 GB/s P2P Enabled = 25 GB/s (~300% increase) Latency P2P Disabled = 20 us P2P Enabled = 2 us (~90% reduction) Peer-to-Peer Performance