DPU: THE DATA-CENTRIC ERA Founded: 2015 to revolutionize the agility, security, performance, reliability, and economics of all Cloud Data Centers Technology: a new class of microprocessor, the Fungible DPU™; software, systems, and solutions built on the DPU Top-tier investors People: world class, experienced team with deep expertise in silicon, software & systems across compute, network & storage Intellectual Property: silicon, software, systems, and solutions; 60+ patents, many fundamental and ground-breaking PRADEEP SINDHU Co-Founder, CDO
lab Unprecedented performance with the FSC and FC200 DATE PARTNER RESULTS FUNGIBLE AND LEADING NATIONAL SUPERCOMPUTING LAB JOINS FORCES TO ACHIEVE PERFORMANCE WORLD RECORD
infrastructure resources Increase flexibility through on-demand provisioning at Data Center Scale Reduce silos and SKU sprawl to gain greater supply leverage Enable new use cases, where scale and performance have previously made them impossible 02 03 04
and Software Technologies Founded in 2015 Taped out the first data-centric SoC, F1 Taped out the second data-centric SoC, S1 Fungible Storage Cluster GA NVMe/TCP Scale-out storage platform based on F1 SoC Closed Series A and Bwith $104M Closed Series C with $200M Acquired Cloudistics Composer Technology Fungible DPU GA 2015 2018 2019 2020 2021 Fungible Accelerator Card GA NVMe/TCP Storage Initiator Cards Fungible Data Center GA
NVMe SSD ONBOARD 6 x 100 Gbps ETHERNET ONBOARD 6 x 100 Gbps ETHERNET 12 x NVMe SSD HOT-PLUGGABLE NVMe SSD REDUNDANT POWER SUPPLY UNIT REDUNDANT POWER SUPPLY UNIT RDIMM NVDIMM FUNGIBLE DPU
initiator • Built on Fungible S1 DPU • Managed by Fungible Composer • Volumes appear as local NVMe devices • Benefits • Standards compliant NVMe/TCP up to 200GE • Server CPU offload • 2M+ IOPS per Storage Client • Expand OS compatibility • In-line Compression • In-line Encryption at rest and in motion Hardware Initiator via FAC Software Initiator Native NVMe / TCP Ethernet Fabric
environment • Boot natively from FSC volume • No change to BIOS or OS • Remote volume appears as local NVMe • Benefits • Efficiencies of shared storage • Move boot volumes on demand • Disaggregate and compose Hardware Initiator via FAC Software Initiator Native NVMe / TCP Ethernet Fabric Boot Volume
Accelerator Products DPU Accelerated Storage, Network, and Security Services Up to 200GbE 2+ M IOPS, 35+ Mpps* ONE PLATFORM TO ADDRESS ALL INFRASTRUCTURE SERVICES PERFORMANCE FORM FACTOR FEATURES Full Height Half Length <45W PCIe Gen 4 FC200 - 2 x 100GbE FC100 - 2 x 50GbE FC50 - 2 x 25GbE
Class of Microprocessor Purpose-Built for the Data-Centric Era – the 3rd Socket in Data Centers 1 Data-centric = stateful, multiplexed processing of high b/w data streams • Standard external interfaces – PCIe, Ethernet • Programmable in C • Many multi-threaded cores & hardware accelerators for crypto, compression, etc., General-Purpose Vector Floating Point CPU Fungible DPU™ Data-Centric GPU Enables 10x more efficient execution of data-centric tasks Implements an endpoint for a more efficient data center network The Fungible DPU is a new class of programmable microprocessor that:
Tasks Alternative Architectures • Stateful work mostly on General-Purpose CPUs • General-Purpose CPUs don’t perform well • Classical coherency only • Caches get destroyed by streaming data • Latency intolerant • Loose Coupling between CPUs and Accelerators • Communication via interrupts/traps is slow • Separate memory slows communication • Switching to/from GP-CPUs is inefficient Fungible DPU • Tightly coupled DP-CPUs & Accelerators • Very fast interactions • Purpose-built memory systems & fabrics • Purpose-Built Data-Path CPUs • Heavily threaded • Latency-tolerant • Specialized accelerators (> 12) • Multi-threaded • Fully integrated with memory systems PCI ETH High-Performance Any-to-Any “Call-Continue” Fabric PCI ETH Accelerated Path (Can’t do general stateful computations) GP-CPUs (8-16) SLOW PCIe Switch MMU Interrupt/Trap
Elastic Block Store Fungible Storage Initiator Benefits • Built with Fungible S1 DPU in a PCIe adapter • Standards compliant NVMe/TCP up to 200GE • Pool Storage via Disaggregation (no local storage) • Fewer Server SKUs without loss of performance • Remote boot capability (Diskless Server) • 2.3M IOPS per Storage Client • End to end Encryption • End to end compression Fungible Storage Cluster Benefits • Built with Fungible F1 DPU as a storage appliance • Pooled Storage w/ high storage utilization • Independent storage scaling • Networked storage @ local SSD performance • Grow as you need; pay as you grow • Best-in-class compression w/o performance loss • Security with Line-rate encryption • Rack scale resiliency, high reliability @ low cost • Agility – Supports VMs, containers and bare-metal • Agility – Multi-tenancy (per volume flexibility, QoS) Fungible FS1600 Racks COTS Compute Servers X86 Clients with Fungible DPU All Data Network Connections are 100GE NVMe over TCP IP over Ethernet 3 types of volumes raw, durable with EC, durable with RF DPU Provided Differentiation
X86 Clients with Fungible DPU X86 Clients with Fungible DPU X86 Clients with Fungible DPU Restful API Single Point of Management NVMe/TCP Networking Offload Inline Security GPU Disaggregation K8s Plug-in OpenStack Plug-in Cloud Orchestrator IP Over Ethernet Fabric NVMe/TCP Networking Offload Inline Security GPU Disaggregation Fungible FS1600 Racks Fungible DPU Fungible DPU GPU Servers • Standard NVMe/TCP • 2.3M IOPS (industry best) • Free up host CPU cores • Remote Boot Capability • Inline compression • Inline Encryption • Switching & Routing • 35M pps • Line-rate up to 200G • Free up host CPU cores • Secure Root of Trust • Security acceleration • Improved GPU Util. • <5% perf drop for most ML with large batch sizes • Independent scaling of CPUs & GPUs • Servers w/ larger # of GPUs than physically possible X86 Clients with Fungible DPU DPU Provided Differentiation
Networking Fungible Storage Cluster • 15M IOPs per 2RU • EBS for the rest of us Hyperscalers – Direct and OEM + Fungible Accelerator Cards • BMV, Storage Initiator • Security, PCIe Proxy • Lookaside offload from X86 & GPU + FunOS Private & Public Clouds - Indirect and OEM + Data Center Composer Software MSPs, GSIs and Enterprise - Indirect Software Target Markets & Route To Market Fungible Data Center & GPU Disaggregation
the Fungible DPU™ and TrueFabric™ Most Innovative Hyperscaler Implementation… Best of Show… 11/10/20 Recognized for Fungible Storage Cluster The 10 Hottest Data Storage Startups of 2020 The 10 Hottest Semiconductor Startups of 2020 Cloud Storage Innovation of the Year… 12/03/20 Digital Transformation Company of the Year 12/03/20 02 03 04
India Customers and partners in US, Europe, China, and India across Dedicated global Channel Resource Investing in more field teams, channel programs and recruitment, and dedicated alliance resource
we were able to achieve by offloading as much as possible. These results show great promise for the FS1600 and client-side DPUs." Jouke Roorda, High Performing Systems Engineer "The performance, QOS, and compression capabilities of Fungible's NVMe/TCP storage platform made it a clear choice to be a key foundational component of our next generation infrastructure design." Sr. Director, Core Infrastructure “The co-design of software and hardware to support data services and data analysis is integral to meeting our efficiency targets and advancing our national security mission.” Brad Settlemyer, Sr. Scientist, LANL HPC Design Group “Fungible's host initiator and storage cluster offer our customers the performance of locally attached NVMe combined with the operational efficiency and capacity optimization of centralized storage.” Jacob Farmer, CTO LARGE E-RETAILER