
Scaling Deep Learning on an 18,000 GPU Supercomputer
It is one thing to scale a neural network on a single GPU or even a single system with four or eight GPUs. …
It is one thing to scale a neural network on a single GPU or even a single system with four or eight GPUs. …
The future “Summit” pre-exascale supercomputer that is being built out in late 2017 and early 2018 for the US Department of Energy for its Oak Ridge National Laboratory looks like a giant cluster of systems that might be used for training neural networks. …
Every evolution in computing hardware brings with it big challenges for software developers. …
When one thinks about the largest supercomputing sites on the planet and the approach to examining future technologies for next-generation systems, it might seem logical to guess they are at the bleeding edge of exploring entirely new, under-the-radar architectures and approaches that could spike the curve of Moore’s Law. …
In the wake of today’s announcement of the codes selected to be tuned for the 2018 Summit supercomputer at Oak Ridge National Lab, questions around how application teams are thinking about the massive amount of memory across new tiers, the swapping out of PCIe for a new interconnect, and the pervasive GPUs were first to mind. …
All Content Copyright The Next Platform