Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Fungible - IT Press Tour 40 Sep./Oct. 2021

Fungible - IT Press Tour 40 Sep./Oct. 2021

The IT Press Tour

November 01, 2021
Tweet

More Decks by The IT Press Tour

Other Decks in Technology

Transcript

  1. PRESENTERS JAI MENON CHIEF SCIENTIST FUNGIBLE CEO FUNGIBLE ERIC HAYES

    BRIAN MCCLOSKEY CHIEF REVENUE OFFICER FUNGIBLE VP OF PRODUCTS FUNGIBLE TOBY OWEN
  2. AGENDA 01 02 03 Corporate Overview Product Overview DPU Deep

    Dive 04 05 06 Go-To-Market Momentum Summary Q&A
  3. ERIC HAYES CEO BERTRAND SERLET Co-Founder, COO FUNGIBLE INVENTED THE

    DPU: THE DATA-CENTRIC ERA Founded: 2015 to revolutionize the agility, security, performance, reliability, and economics of all Cloud Data Centers Technology: a new class of microprocessor, the Fungible DPU™; software, systems, and solutions built on the DPU Top-tier investors People: world class, experienced team with deep expertise in silicon, software & systems across compute, network & storage Intellectual Property: silicon, software, systems, and solutions; 60+ patents, many fundamental and ground-breaking PRADEEP SINDHU Co-Founder, CDO
  4. TWO APPROACHES TO INCREASING EFFICIENCIES - Pooling - Remove silos

    Improve Processor Efficiency - Best Tool For the Job - General-purpose Vector floating point CPU Fungible DPU™ Data-centric GPU
  5. FUNGIBLE DATA CENTER VISION: COMPOSABLE DISAGGREGATED INFRASTRUCTURE GPU Pools CPU

    Server Pools HDD Storage Pools SSD Storage Pools Data Center Composer INFRASTRUCTURE UNDERLAY IP / ETHERNET
  6. NVME/TCP OPEN STANDARD FOR ENABLING DISAGGREGATION NVME / TCP DELIVERS:

    * Source: Dell Release *2.5 to 3.5 times more IOPS *Reduces latency by up to 75% *Cuts CPU load per I/O in half over iSCSI 01 02 03
  7. UPCOMING JOINT PRESS RELEASE Coming soon in October National supercomputing

    lab Unprecedented performance with the FSC and FC200 DATE PARTNER RESULTS FUNGIBLE AND LEADING NATIONAL SUPERCOMPUTING LAB JOINS FORCES TO ACHIEVE PERFORMANCE WORLD RECORD
  8. FUNGIBLE’S GOAL – TO ENABLE COMPANIES TO: DISAGGREGATE INFRASTRUCTURE INTO

    POOLS COMPUTE | STORAGE | NETWORKS | GPUs THEN DYNAMICALLY COMPOSE RESOURCES IN BARE METAL
  9. OUTCOMES OF ACHIEVING OUR GOAL 01 Maximize efficiency of all

    infrastructure resources Increase flexibility through on-demand provisioning at Data Center Scale Reduce silos and SKU sprawl to gain greater supply leverage Enable new use cases, where scale and performance have previously made them impossible 02 03 04
  10. FUNGIBLE’S JOURNEY TOWARDS BIG FAST DATA Melding Cutting Edge Hardware

    and Software Technologies Founded in 2015 Taped out the first data-centric SoC, F1 Taped out the second data-centric SoC, S1 Fungible Storage Cluster GA NVMe/TCP Scale-out storage platform based on F1 SoC Closed Series A and Bwith $104M Closed Series C with $200M Acquired Cloudistics Composer Technology Fungible DPU GA 2015 2018 2019 2020 2021 Fungible Accelerator Card GA NVMe/TCP Storage Initiator Cards Fungible Data Center GA
  11. FUNGIBLE STORAGE CLUSTER High Performance, Scale Out, and Fully Featured

    NVMe/TCP Block Storage 13M IOPS / Node 75 GB/s / Node 120 µs 3 Nodes → Data Center 70 TB → Petabytes Compression, Thin Provisioning, Snapshots, Clones, QoS Encryption Erasure Coding, Replicated & Raw Linear Scale HIGH PERFORMANCE SCALE OUT FULL FEATURED
  12. FUNGIBLE FS1600 UNDER THE HOOD 12 x NVMe SSD HOT-PLUGGABLE

    NVMe SSD ONBOARD 6 x 100 Gbps ETHERNET ONBOARD 6 x 100 Gbps ETHERNET 12 x NVMe SSD HOT-PLUGGABLE NVMe SSD REDUNDANT POWER SUPPLY UNIT REDUNDANT POWER SUPPLY UNIT RDIMM NVDIMM FUNGIBLE DPU
  13. NVMe/TCP NVMe/TCP Single data center network Built on standard IP

    Ethernet Latency ~100µs OS driver or hardware initiator Accelerating ecosystem adoption 01 02 03 04 05
  14. FAC STORAGE INITIATOR FOR FSC • Hardware NVMe / TCP

    initiator • Built on Fungible S1 DPU • Managed by Fungible Composer • Volumes appear as local NVMe devices • Benefits • Standards compliant NVMe/TCP up to 200GE • Server CPU offload • 2M+ IOPS per Storage Client • Expand OS compatibility • In-line Compression • In-line Encryption at rest and in motion Hardware Initiator via FAC Software Initiator Native NVMe / TCP Ethernet Fabric
  15. FAC STORAGE INITIATOR BOOT FROM FSC • Fully diskless server

    environment • Boot natively from FSC volume • No change to BIOS or OS • Remote volume appears as local NVMe • Benefits • Efficiencies of shared storage • Move boot volumes on demand • Disaggregate and compose Hardware Initiator via FAC Software Initiator Native NVMe / TCP Ethernet Fabric Boot Volume
  16. IBM SPECTRUM SCALE (GPFS) ON FSC Massive Performance, Minimal Footprint

    A 2 node FS1600 cluster delivers over 10M IOPS 18 000 000 16 000 000 8 000 000 6 000 000 4 000 000 2 000 000 14 000 000 12 000 000 10 000 000 15 630 000 9 834 000 10 020 445 4K-gpfsperf 4K-FIO-File 4K-FIO-Block 4K Random Read IOPS 4K RANDOM IOPS 2x FS1600 – 48 RF2 Vols – 12Hosts – GPFS 5.0.5.1 – 1MB BS I Random Read 4K IOPS A 6 node FS1600 cluster can deliver over 30M IOPS
  17. FUNGIBLE ACCELERATOR CARDS High Performance and Flexible Fungible DPU™ Based

    Accelerator Products DPU Accelerated Storage, Network, and Security Services Up to 200GbE 2+ M IOPS, 35+ Mpps* ONE PLATFORM TO ADDRESS ALL INFRASTRUCTURE SERVICES PERFORMANCE FORM FACTOR FEATURES Full Height Half Length <45W PCIe Gen 4 FC200 - 2 x 100GbE FC100 - 2 x 50GbE FC50 - 2 x 25GbE
  18. COMPUTATIONAL STORAGE Research and Science Database Acceleration Big Data Analytics

    Edge Transformation USE CASES MOVING COMPUTE TO THE STORAGE User Supplied Code Snippets (filter example) Database Primitives (aggregate example)
  19. FUNGIBLE OFFERINGS ARE POWERED BY THE FUNGIBLE DPUTM A New

    Class of Microprocessor Purpose-Built for the Data-Centric Era – the 3rd Socket in Data Centers 1 Data-centric = stateful, multiplexed processing of high b/w data streams • Standard external interfaces – PCIe, Ethernet • Programmable in C • Many multi-threaded cores & hardware accelerators for crypto, compression, etc., General-Purpose Vector Floating Point CPU Fungible DPU™ Data-Centric GPU Enables 10x more efficient execution of data-centric tasks Implements an endpoint for a more efficient data center network The Fungible DPU is a new class of programmable microprocessor that:
  20. HOW THE FUNGIBLE DPUTM ACHIEVES 10X SPEED-UP FOR DATA-CENTRIC TASKS

    F1 DPU runs 192 hardware CPU threads and dozens of high-speed accelerators in parallel Lots of cores and lots of accelerators that are tightly coupled
  21. FUNGIBLE DPUS HAVE UNIQUE ARCHITECTURAL ADVANTAGES 10X Faster at Data-Centric

    Tasks Alternative Architectures • Stateful work mostly on General-Purpose CPUs • General-Purpose CPUs don’t perform well • Classical coherency only • Caches get destroyed by streaming data • Latency intolerant • Loose Coupling between CPUs and Accelerators • Communication via interrupts/traps is slow • Separate memory slows communication • Switching to/from GP-CPUs is inefficient Fungible DPU • Tightly coupled DP-CPUs & Accelerators • Very fast interactions • Purpose-built memory systems & fabrics • Purpose-Built Data-Path CPUs • Heavily threaded • Latency-tolerant • Specialized accelerators (> 12) • Multi-threaded • Fully integrated with memory systems PCI ETH High-Performance Any-to-Any “Call-Continue” Fabric PCI ETH Accelerated Path (Can’t do general stateful computations) GP-CPUs (8-16) SLOW PCIe Switch MMU Interrupt/Trap
  22. FUNGIBLE DPU COMPARISON: PERFORMANCE VS FLEXIBILITY For Three Different Architectures:

    FPGA, Generic DPU, Fungible DPU Flexibility Relative Performance at constant silicon area FPGA Hardware Accelerators P4 Pipeline General-Purpose CPUs (ARM/X86) used for Data-Path CPUs customized for Data-Path Fungible DPU “Generic DPU” 100 1 10 30 FPGA+CPU Competitive Differentiation
  23. FUNGIBLE DPU-BASED FUNGIBLE STORAGE CLUSTER (FSC) NVMe Over TCP Based

    Elastic Block Store Fungible Storage Initiator Benefits • Built with Fungible S1 DPU in a PCIe adapter • Standards compliant NVMe/TCP up to 200GE • Pool Storage via Disaggregation (no local storage) • Fewer Server SKUs without loss of performance • Remote boot capability (Diskless Server) • 2.3M IOPS per Storage Client • End to end Encryption • End to end compression Fungible Storage Cluster Benefits • Built with Fungible F1 DPU as a storage appliance • Pooled Storage w/ high storage utilization • Independent storage scaling • Networked storage @ local SSD performance • Grow as you need; pay as you grow • Best-in-class compression w/o performance loss • Security with Line-rate encryption • Rack scale resiliency, high reliability @ low cost • Agility – Supports VMs, containers and bare-metal • Agility – Multi-tenancy (per volume flexibility, QoS) Fungible FS1600 Racks COTS Compute Servers X86 Clients with Fungible DPU All Data Network Connections are 100GE NVMe over TCP IP over Ethernet 3 types of volumes raw, durable with EC, durable with RF DPU Provided Differentiation
  24. FUNGIBLE DPU-BASED DATA CENTER ARCHITECTURE Reliability, Scalability, Security with Performance

    X86 Clients with Fungible DPU X86 Clients with Fungible DPU X86 Clients with Fungible DPU Restful API Single Point of Management NVMe/TCP Networking Offload Inline Security GPU Disaggregation K8s Plug-in OpenStack Plug-in Cloud Orchestrator IP Over Ethernet Fabric NVMe/TCP Networking Offload Inline Security GPU Disaggregation Fungible FS1600 Racks Fungible DPU Fungible DPU GPU Servers • Standard NVMe/TCP • 2.3M IOPS (industry best) • Free up host CPU cores • Remote Boot Capability • Inline compression • Inline Encryption • Switching & Routing • 35M pps • Line-rate up to 200G • Free up host CPU cores • Secure Root of Trust • Security acceleration • Improved GPU Util. • <5% perf drop for most ML with large batch sizes • Independent scaling of CPUs & GPUs • Servers w/ larger # of GPUs than physically possible X86 Clients with Fungible DPU DPU Provided Differentiation
  25. PORTFOLIO SALES MOTION + + Full Stack Storage Full Stack

    Networking Fungible Storage Cluster • 15M IOPs per 2RU • EBS for the rest of us Hyperscalers – Direct and OEM + Fungible Accelerator Cards • BMV, Storage Initiator • Security, PCIe Proxy • Lookaside offload from X86 & GPU + FunOS Private & Public Clouds - Indirect and OEM + Data Center Composer Software MSPs, GSIs and Enterprise - Indirect Software Target Markets & Route To Market Fungible Data Center & GPU Disaggregation
  26. INDUSTRY RECOGNITION 01 Best Upstart of the year…10/23/20 Recognized for

    the Fungible DPU™ and TrueFabric™ Most Innovative Hyperscaler Implementation… Best of Show… 11/10/20 Recognized for Fungible Storage Cluster The 10 Hottest Data Storage Startups of 2020 The 10 Hottest Semiconductor Startups of 2020 Cloud Storage Innovation of the Year… 12/03/20 Digital Transformation Company of the Year 12/03/20 02 03 04
  27. SALES MOMENTUM Field coverage established in US, Europe, China, and

    India Customers and partners in US, Europe, China, and India across Dedicated global Channel Resource Investing in more field teams, channel programs and recruitment, and dedicated alliance resource
  28. CUSTOMER VALIDATION "We are excited about the unparalleled, near-native performance

    we were able to achieve by offloading as much as possible. These results show great promise for the FS1600 and client-side DPUs." Jouke Roorda, High Performing Systems Engineer "The performance, QOS, and compression capabilities of Fungible's NVMe/TCP storage platform made it a clear choice to be a key foundational component of our next generation infrastructure design." Sr. Director, Core Infrastructure “The co-design of software and hardware to support data services and data analysis is integral to meeting our efficiency targets and advancing our national security mission.” Brad Settlemyer, Sr. Scientist, LANL HPC Design Group “Fungible's host initiator and storage cluster offer our customers the performance of locally attached NVMe combined with the operational efficiency and capacity optimization of centralized storage.” Jacob Farmer, CTO LARGE E-RETAILER
  29. KEY SOLUTION FOCUS AREAS Fungible Storage Cluster Large, multi-tenant environments,

    high performance parallel file systems, Computational Storage, HPC shared storage Fungible Accelerator Cards F1 and S1 DPUs Storage Initiator, GPU Disaggregation, Security Offload, Network Acceleration Bespoke OEM and Hyperscaler opportunities
  30. Q&A

  31. THANK YOU! gg [email protected] www.fungible.com JAI MENON CHIEF SCIENTIST FUNGIBLE

    CEO FUNGIBLE ERIC HAYES BRIAN MCCLOSKEY CHIEF REVENUE OFFICER FUNGIBLE VP PRODUCT FUNGIBLE TOBY OWEN