HPE launches storage system for HPC and AI clusters

“One of the huge advantages of a parallel file system vs. a standard Enterprise NAS is that parallel file system it is able to get a lot more performance/GB per second out of each SSD through the network to, and from, the compute nodes,” Plechschmidt told me via email.

HPE picked up the ClusterStor line when it acquired Cray in 2019. At the top end, it scales to tens of petabytes of SSD storage, delivering up to 1.6 TBps and 50 million IOPS/rack. ClusterStor is used in a number of major supercomputers, including the three known exascale supercomputers: Frontier, Aurora, and El Capitan.

While the C500 has a lot in common with the ClusterStor E1000, there are also differences. Where the E1000 uses a 2U24 storage controller for the System Management Unit (SMU), the C500 uses a more cost-effective HPE ProLiant DL325 Gen11 server. It also uses fewer controllers to manage the hard drives, and the C500 enclosure offers more flexibility in how many drives are stored in it.

“Supercomputing applications require high-performance storage solutions to match the high-performance computing elements. This is especially important today because AI has introduced a new wave of supercomputing users. While some organizations may not think of it as ‘supercomputing,’ training large models on massive data sets across multiple high-speed nodes in parallel … it’s kind of the same thing, and it certainly needs high-performance storage,” said Addison Snell, CEO of Intersect360 Research, which specializes in HPC and supercomputing research.

The HPE Cray Storage Systems C500 will be available from HPE and resellers on May 27.