AI
Lustre to DAOS: Machine Learning on Intel’s Platform
Training a machine learning algorithm to accurately solve complex problems requires large amounts of data. …
Search Results for DAOs
HPC
Future Supercomputers Grow Out of File Systems, Into DAOS
In our coverage of the string of next-generation HPC systems, we have talked about the big changes on the programming, memory, and network horizons, but there is one potentially disruptive change on the way for storage—one that could tear down existing paradigms, including the concept of time-tested parallel file systems. …
HPC
Will HPC Centers Say ADIOS To POSIX I/O?
The widening performance disparity between compute and I/O is not likely to get any better in the fast-approaching exascale era. …
HPC
A Storage Model for the Exascale Crowd
One bit of news that almost got lost in the shuffle at the recent ISC 2019 conference was Intel’s announcement that it is bringing DAOS, the Distributed Asynchronous Object Storage platform, to supercomputing. …
Store
Re-Architecting Parallel File Systems in the Post-Disk Era
We spent some time at the end of 2018 getting a handle on how parallel file systems in HPC need to evolve to meet the shifting demands in workloads driven by machine learning. …
AI
HPC File Systems Fail for Deep Learning at Scale
Now that deep learning at traditional supercomputing centers is becoming a more pervasive combination, the infrastructure challenges of making both AI and simulations run efficiently on the same hardware and software stacks are emerging. …
Code
What’s So Bad About POSIX I/O?
POSIX I/O is almost universally agreed to be one of the most significant limitations standing in the way of I/O performance exascale system designs push 100,000 client nodes. …
HPC
Memory-Like Storage Means File Systems Must Change
The term software defined storage is in the new job title that Eric Barton has at DataDirect Networks, and he is a bit amused by this. …
Code
MPI and Scalable Distributed Machine Learning
MPI (Message Passing Interface) is the de facto standard distributed communications framework for scientific and commercial parallel distributed computing. …
HPC
Storage Performance Models Highlight Burst Buffers at Scale
For storage at scale, particularly for large scientific computing centers, burst buffers have become a hot topic for both checkpoint and application performance reasons. …