Architecting IT: Stellus Delivers Scale-out Storage

with NVMe & Key- Value Technology

IN THE NEWS

Published on February 20, 2020

ARCHITECTING IT: Stellus Delivers Scale-out Storage with NVMe & KV Tech

 

Chris Evans wrote an article about how Stellus has developed a protocol called KV over Fabrics.  

An excerpt is below. Read the full story on the Architecting IT website here

As we move into the era of machine-generated content, storage systems are increasingly challenged to support larger volumes and sizes of unstructured files, with highly parallel access profiles and significant throughput demands.  As we highlighted just this week on Storage Unpacked, this demand is driving the need for new storage platforms that can take advantage of new media technology.  Stellus Technologies emerged from stealth this week and released a new storage platform that hopes to address Big Data challenges, through the use of NVMe and key-value store technology.

Background

Much of the data created today comes from machine-generated sources.  Increasingly, we see the creation of more complex data sets from industries like Life Sciences, Media & Entertainment and Industrial IoT.  The access profiles for these data has become more parallel in nature.  Medical equipment, transportation and creative industries produce parallel streams of data that are in turn, accessed in parallel through analytics or post-production work. 

Modern storage systems are required to manage data across a single logical namespace, cater for small and large files alike, with high degrees of parallel access and throughput. 

Stellus Data Platform

Stellus Technologies has designed a storage system that uses a KV store for the storage of data on persistent media.  The first release of the Stellus Data Platform is based on a scale-out architecture of multiple Data Manager nodes and Key-value Store nodes, connected through a shared network fabric.

Each KV Store node houses multiple NVMe SSDs, exposing many logical KV stores across a single cluster of servers.  Host data access is delivered through Data Manager nodes.  To increase front-end performance, add more Data Manager nodes; to increase capacity, add more KV Store nodes.

The specifics on how data is split into objects and stored across a Stellus cluster is relatively complex.  Essentially, each KV node provides read/write access to KV data, managing the lifetime of keys, depending on their requirements.

Related Articles

Cognitive AI

Artificial intelligence management requires massive data sets and high-speed processing to achieve the degree of efficiency and accuracy necessary to train neural networks and establish actionable insights. Through innovative software and services, Stellus Data Platform empowers and inspires customers around the world to transform data into intelligence.

Read Solution

Media & Entertainment

The Stellus Data Platform (SDP) sets a new standard for media storage performance, empowering M&E companies to support more workloads, more simultaneous playback streams, and faster render times. Unlike architectures that waste resources on tasks irrelevant to modern storage, the SDP is an entirely new file system, built from the ground up for unstructured data and solid-state media.

Read Solution

Life Science

Stellus is rewriting the rules for life sciences computing. The Stellus Data Platform (SDP) file system is built from the ground up for storing and processing unstructured data. It enables organizations to dramatically accelerate application performance for genomic analysis. Researchers can now process more workloads in far less time and take concrete steps to enable personalized medicine therapies.

Read Solution

Stellus Data Platform

Stellus provides a modern, highly performant file storage platform that enables hyperscale throughput for digital enterprises. Based on key-value store technology and exceptionally suited for unstructured data.

Learn More

Solution Brief- Genomics

Unlock the Targeted Therapies of the Future

Read more

Solution Brief- M&E

Transform Media Economics with Breakthrough Capacity & Performance

Read more

Solution Brief- Cryo-EM

Break the Backlog for High-Speed Microscopy

Read more