MooseFS - IT Press Tour #57 Sep. 2024

Transcript

1. When your data grows…
2. • fault tolerant • network distributed • parallel • platform independent file system or block storage MooseFS / MooseFS PRO What is this?
3. The Company Private-owned Warsaw, Poland, EU Established exclusively for: MooseFS Software Development MooseFS Worldwide Support We started as a high-school colleagues…
4. Business model Selling pro licenses and support services enables us to create cutting-edge software while offering much of it for free
5. The Mission Make our users’ data safe and accessible
6. TRUSTED SINCE 2005 MooseFS has become an integral part of many companies and operations across industries
7. file s TRUSTED SINCE 2005 History v. 1.0, Gemius’ internal distributed filesystem project v. 1.5, first public release v. 2.0, professional support v. 3.0, both PRO and open-source v. 4.0, PRO: block storage, erasure-coding v. 4.x, open-source release 2005 2008 2014 2016 2019 2024 The first cluster: Almost 20 years of uninterrupted service
8. It distributes data over many servers acting as one large disk
9. Advantages 1/6 Engineered for high-performance I/O operations, MooseFS allows parallel read/write access across multiple storage nodes, eliminating bottlenecks caused by a single central server or network connection. MooseFS Distributed Storage is designed for mission-critical applications requiring reliability, high availability, and top-tier performance. Furthermore, ensuring uninterrupted data access is one of its top priorities. High Performance Reliability
10. Advantages 2/6 You can extend your storage up to 16 exabytes, accommodating more than 2 billion files in a single cluster. By increasing the number of data nodes, you’ll see a boost in performance! MooseFS offers low total cost of ownership (TCO) thanks to its open-source nature, ease of use, scalability, and robust vendor support, making it more cost- effective than other storage solutions. Check us! Scalability Minimal TCO
11. Advantages 3/6 The MooseFS storage software is designed to support Big Data. MooseFS provides virtually limitless storage space for the most demanding distributed workloads. Our storage may easily provide data even for huge AI models. MooseFS supports both All-Flash and Hybrid storage configurations, allows mixing disks and servers from various manufacturers within a single storage system, and ensures compatibility with both legacy and modern technology. MooseFS storage can be built using commodity platform components from nearly all hardware manufacturers. It supports a variety of disks standards, including NVMe, SATA, SAS, SSD, and HDD. There is no hardware vendor lock-in. Big Data Hardware Independence Commodity Hardware Components
12. Advantages 4/6 No-Single-Point-of- Failure (SPOF) configuration ensures maximum reliability. Data is redundantly distributed across the data servers, while file system metadata is stored on redundant servers. Storage cluster is safe from concurrent disk and server failures. Administration has been streamlined for greater efficiency. Our automated monitoring and self- repair algorithms allow staff to shift away from micromanagement, while the cluster operates smoothly and reliably. Get direct support from our team of experts. With in-depth knowledge of software’s source code, we can resolve any issue swiftly and effectively. The team’s expertise ensures prompt solutions and exceptional service. High Availability Easy Administration Manufacturer Support
13. Advantages 5/6 Features like rolling, incremental upgrades, and tiering enhance hardware durability. They allow the use of older, smaller, and slower servers or disks alongside top-notch ones for more demanding tiers. MooseFS is available as open-source or a lifetime license for the PRO version. Both utilize commodity components and operating systems, making them reliable choices for lifelong use. Both keep your data lifetime safe. The pay-as-you-grow licensing model, or even a free software license, ensures a low initial investment. With scalability and rolling upgrades, you can purchase only the necessary hardware, reducing upfront costs. Extended Hardware Longevity Lifetime Usability Minimal Investment
14. Advantages 6/6 With a single, one-time license fee, you gain lifetime access to the benefits of MooseFS Pro – no subscriptions, no royalties, no hidden fees. Your license is aligned with the cluster size, with the option to expand anytime. Our software is available as open- source alongside the “Pro” licensed version. Both share over 98% of the code, allowing independent community validation of key algorithms. You can switch between MooseFS versions anytime. Thanks to advanced parity calculation algorithms, MooseFS Pro significantly saves disk space while ensuring data redundancy, with gains of at least 55% in common scenarios. Additionally, discounts are offered as storage grows. Lifetime License Safe with Open-source Low-Cost Data Safety
15. Technical highlighhts 1/6 MooseFS complies with industry- standard security protocols, offering POSIX access control along with Access Control Lists for added flexibility. This combination ensures robust security and precise control over your data. All system components are designed with redundancy in mind. The PRO version includes automatic failover mechanisms that guarantee uninterrupted service in the event of failures. Additionally customizable levels of data redundancy are available. Security Redundancy
16. Technical highlighhts 2/6 MooseFS lets you upgrade, replace, or add hardware without disrupting service. This ensures your system remains current and runs smoothly, with no downtime or complex migrations needed. Moose never sleeps! In the event of a hardware failure, the system quickly initiates data replication to maintain redundancy. This approach recovers large volumes rapidly and without interrupting data access, ensuring continuous and seamless operation. On-The-Fly Upgrades Robust Self-Healing
17. Technical highlights 3/6 The MooseFS storage software is designed to support Big Data. MooseFS provides virtually limitless storage space for the most demanding distributed workloads. Our storage may easily provide data even for huge AI models. MooseFS supports both All-Flash and Hybrid storage configurations, allows mixing disks and servers from various manufacturers within a single storage system, and ensures compatibility with both legacy and modern technology. MooseFS storage can be built using commodity platform components from nearly all hardware manufacturers. It supports a variety of disks standards, including NVMe, SATA, SAS, SSD, and HDD. There is no hardware vendor lock-in. Big Data Hardware Independence Commodity Hardware Components
18. Technical highlights 4/6 Optimize costs by assigning data categories to different storage media. Store “hot” data on fast disks and less frequently accessed data on cheaper, slower hardware. Mix SSDs, NVMe, HDDs, and RAM disks for a customized solution. MooseFS supports scheduled computations on data nodes, leveraging their idle CPU and memory resources. This allows your existing hardware to both store data and run applications efficiently. It offers instant and uninterrupted file system snapshots at any moment, making it an ideal solution for online backups. This functionality ensures that you can quickly capture and store the state of your data without any downtime. Tiered Storage Computation on Nodes Atomic Snapshots
19. Technical highlights 5/6 MooseFS delivers high- performance read and write operations by executing all I/O tasks in parallel across multiple threads on every data node. This simultaneous processing maximizes throughput and minimizes latency. A configurable space is available for temporarily storing deleted objects, facilitating recovery of accidentally deleted data. This feature improves data management and ensures effortless restoration of critical information. System administrators can establish limits to control the data storage capacity for users. This feature enhances system stability and effectively manages storage, ensuring that critical data is organized and preserved. Parallelism Global Trash Quota Limits
20. Technical highlights 6/6 MooseFS supports standard Ethernet networks at speeds of 1 Gbps, 10 Gbps, and 100 Gbps, including configurations for Link Aggregation Control Protocol (LACP), ensuring robust and flexible connectivity. MooseFS offers a suite of command- line and web-based administrative tools allowing system administrators to monitor and analyze performance. API for integration with third- party management tools is also available. MooseFS intelligently considers network topology to optimize traffic between different cluster parts, enabling you to maximize the potential of your data center. This ensures efficient communication and resource utilization across the network. Ethernet Management Interfaces Topology
21. FREE OPEN SOURCE Licensing and pricing License pricing: • for total raw disk space • lifetime • no subscription fees • expandable • discounts for size We offer support for both open-source and PRO versions Support pricing: • for total raw disk space • 1-, 2-, 3- years
22. v. 4 Community Edition 97% CE/PRO code shared • ensures data safety • manual failover • mainly SOHO THIS FALL + basic erasure coding support + improved tiering + new GUI + more
23. What’s next? Our current plan next 20 years of uninterrupted service
24. Questions? Answers…
25. Thank you contact@moosefs.com moosefs.com