the traditional storage ecosystem and leverage Data Management as one solution for Hybrid Storage solution. Therefore, to answer these strategic challenges, I design Nodeum. Aiming to accelerate the combinations and the relationships between machines and humans to get values out of the data to serve new business models. Eradicate time spent in searching data. Empower talented end-users to achieve more – to solve more of their data management challenges.
changing • The way on how information are generated is shifting drastically and this started at least from 5-10 years. • The result is an unprecedented and exponential increase of volumes of (unstructured) data that need to be managed.
CLOUD A OBJECT STORAGE TAPE STORAGE PUBLIC CLOUD B I’m comfortable to manage this single system. I’m feeling lost to manage safety, quickly, easily and cost- effectively such large volumes of data MY STORAGE
de fichiers Seconde(s) Heure(s) ou même Jour(s) 1xx TBs TB Nombre de fichiers Temps pour obtenir un résultat Billions of files Millions of files Files # Time to get a result Hours or even days seconds TRACEABILITY
to backup Databases, Applications, …. HSM Hierarchical storage management moves unused data to cost- effective storage media DATA ARCHIVING & PRESERVATION Filter on metadata to archive less demanded content. Leverage storage for long term preservation. DATA PROTECTION Fast and highly efficient file-based workflow to protect unstructured data DATA MOBILITY WORKFLOW DRIVEN High-performance, date mover which enables line-of- business creativity, productivity, and efficiency IT LINE OF BUSINESS OWNERSHIP
a technological standpoint, we already have everything we need to leverage big data to quickly and effectively develop vaccines for new viruses such as Zika… Now what we need are platforms and systems to get this data into the hands of those who can develop solutions before a public health emergency develops. ”
Migration Automate secure migration of your data between your different storage systems. Individual file reporting for audit requirements. Data Archiving Data Protection Move selected data to secondary storage tier to decrease the capacity of expensive primary storage while keeping online access to your data. Individual file-level search and access. User-centric backup approach to eliminate disruption and ensure business continuity with a reliable and easily accessible offline archive. Individual file-level search and retrieve.
NAS storage through NFS – SMB protocols Cloud Storage Public Cloud Storage and Object Storage are supported through the 2 main standard protocols: S3 & Swift. Tape Storage Tape Library Manager brings the capability to address any SCSI driven Tape Library, ACSLS Tape Library and LTO Tape Drives. Most known systems are supported. The open format LTFS is used as a standard solution for writing to tapes. NAS, CLOUD, S3 COMPATIBLE OBJECT STORAGE AND TAPE ONE SOFTWARE TO MANAGE ALL TYPE OF STORAGE
OF CHICAGO, Book capacity 3.5 million, Number of book bins 24,000, Height of retrieval cranes 55 feet, Delivery time 5 minutes NODEUM, a single pane of glass of all storage movement across any type of storage type. With data mobility and cost management. 5 minutes to execute a data movement.
MANAGE ALL OF YOUR STORAGE Achieve a high-performance workflow to gain control of your exponential data growth. Improve operations and save time Intuitive storage and process management software Handle single namespace across multiple storage silos.
Integrate a data management solution into their post-production workflows which are very complex. SOLUTION : Nodeum automate their archiving and delivery workflows. They can work on more show – movies in accelerating the archive of rushes and masters with the same team. They are able to deliver on-time content to Netflix.
aim of the project is to continue to build up a central archive with digitalized pathological data. SOLUTION: With Nodeum Data Mover, Medical University of Graz can analyze a large scale of data generated by the high throughput scanner. They are able to determine the type of disease faster (such as carcinoma of the thyroid). Nodeum reduces the time to analyze each slide allowing for increased usage of expensive medical hardware. NODEUM, DATA MOVEMENT PLATFORM FOR RESEARCH FROM 10 minutes TO 1 minute
consider it important, in addition to the optimized data structure within and between our heterogeneous system landscapes, to implement more security and an additional media break to protect our data as part of our data storage mechanisms. The use of the convenient and technically mature data mover NODEUM® ensures us efficiency and data security through the individual linking of our data sources, also via APIs and taking into account all role and authorization models. ” Malte Willert, University of Rostock, IT and Media Center, Department 2: Systems and services, project manager for the introduction of NODEUM®. KEEP CONTROL OF DATA AND LEVERAGING LTFS TAPE STORAGE TECHNOLOGY AND MEDIA BREAK EXPAND THE 3-2-1 RULE IN ARCHIVING
OF MEDIA : OBJECT STORAGE & TAPE STORAGE NEED: Integrate a data management to protect contents into 2 copies – 2 different vendors – 2 different media 2 TYPE OF STORAGE FORMAT TO BATTLE TO REDUCE RISK OF DUST - HUMIDITY - HEAT. ...) SEPARATED GEO LOCALISATION
your data when leveraging LTFS Tape Storage. Transparent access of any Tape storage technology Store content in ‘offline’ medium. SOLUTION: Enables in-house users who might be skeptical about the tape opportunity to try out Organize data movement directly to Tape and keep local disk caching for most used data Accelerate the adoption of tape storage and enables an elastic storage offering when capacity requirements scale.
SOON – January 2023 HIGHEST DATA MOVEMENT THROUGHPUT - READY FOR EXASCALE COMPUTING COMPATIBLE WITH IDENTITY PROVIDER (SERVICE AND STORAGE) BASH CLIENT TO ALLOW DATA MOVEMENT DIRECTLY FROM COMPUTE NODE SUSTAIN 5,000 REQUESTS PER SECOND AND HANDLE 10 MILLION SIMULTANEOUS TRANSFER REQUESTS DOCKER AND APP MARKETPLACE READY
Allows event-based hooks registering • Bash Command Line interfaces to communicate in REST with Nodeum • Full integration with AAI infrastructure: • local accounts for accessing file system-based storage • token-based access for the object storage What’s new ? • BANKING • HPC • And also for our current existing verticals: • Media, Post Production, Broadcasting, ... • LifeScience, Research, Genomics, ... • Geospacial For who ?
DIRECT ACCESS BY THE USERS TO ACTIVE AND ARCHIVAL DATA REPOSITORIES INTEGRATION WITH HPC WORKLOAD MANAGERS LIKE SLURM ORGANIZE THE MOVEMENT OF THE DATA FROM THE ACTIVE TO THE ARCHIVAL DATA REPOSITORY Today, supercomputing systems are so performant and scalable that the speed of data generation has never been so fast. Research centers have to store the generated content in “data repositories” that are located close to each other and that are well integrated. Two different categories of data repositories are used as storage tiers: • Active Data Repositories which provide the performance when data is written by supercomputing systems • Archival Data Repositories with interfaces used in Cloud systems, which are more suitable for data sharing Research is becoming increasingly collaborative. Sharing of data and FAIR data management is becoming mandatory. This adds to the requirements for modern data infrastructures. PROVIDE A PUBLIC API AND SDK TO FACILITATE INTEGRATION WITH SPECIFIC RESEARCH APPLICATIONS deployed deployed under deployment October 2022 November 2022 #11 top500.org #17 #82 #23 #21
Allows event-based hooks registering • Bash Command Line interfaces to communicate in REST with Nodeum • Full integration with AAI infrastructure: • local accounts for accessing file system-based storage • token-based access for the object storage What’s new ? • S3 – SWIFT – Mountable File Systems storage systems are available day 1. • Tape Storage is in the roadmap and will be released in a second step. Roadmap « The multifunctional Data Mover NODEUM® simplifies the data transfer between cloud object stores with a Swift interface and fast parallel file systems with a POSIX interface. » Fenix-ri project owner Customer Satisfaction • BANKING • HPC • And also for our current existing verticals: • Media, Post Production, Broadcasting, ... • LifeScience, Research, Genomics, ... • Geospatial For who ?
SWARM S3 ActiveScale S3 Glacier ActiveScale Cold Storage Tape Scalar File StorNext DATA PROTECTION DATA ARCHIVE DATA PROTECTION DATA ARCHIVE SCALAR LTFS REPLACEMENT Nodeum helps vendors in data archiving, protection and data migration scenarios
2018 - 2021 2023 - …. Achieved 2015 - 2016 R&D Phase Scale—up Phase Pilot Phase Product Design Made our first customer Market validation with key references and uses cases New Channel in UK and DACH Release Nodeum v2.0 Market and Channel Expansion