Modern analytics platforms are GPU intensive and require large data sets to deliver the highest levels of accuracy to the training or analytics systems. They also require a high bandwidth, low latency storage infrastructure to ensure a GPU cluster is fully saturated with as much data as the application needs.
Typical data sets can span from terabytes to tens of petabytes, and the data access pattern for each epoch is unique and unpredictable. This calls for a data infrastructure that can instantaneously and consistently feed large amounts of random data to multiple GPU nodes in real-time, all emanating from a single shared data pool.
WekaIO Matrix is the world’s fastest and most scalable file system for these data intensive applications, whether hosted on premises or in the public cloud. It has proven scalable performance of over 10GBytes per second bandwidth to a single GPU node, delivering 10x more data than NFS and 3x more than a local NVMe SSD.
EUROstor offers this solution in server enclosures, each containing four nodes. Two of these systems (a total of 8 nodes) are minimally required.