AI
Scaling Deep Learning on an 18,000 GPU Supercomputer
It is one thing to scale a neural network on a single GPU or even a single system with four or eight GPUs. …
Summit
Compute
Details Emerge On “Summit” Power Tesla AI Supercomputer
The future “Summit” pre-exascale supercomputer that is being built out in late 2017 and early 2018 for the US Department of Energy for its Oak Ridge National Laboratory looks like a giant cluster of systems that might be used for training neural networks. …
Code
Exascale HPC Needs An Application Innovation Spark
Every evolution in computing hardware brings with it big challenges for software developers. …
HPC
For Next Generation Supercomputers, What’s Old is New Again
When one thinks about the largest supercomputing sites on the planet and the approach to examining future technologies for next-generation systems, it might seem logical to guess they are at the bleeding edge of exploring entirely new, under-the-radar architectures and approaches that could spike the curve of Moore’s Law. …
Code
Programming Challenges on the Road to Summit’s Peak
In the wake of today’s announcement of the codes selected to be tuned for the 2018 Summit supercomputer at Oak Ridge National Lab, questions around how application teams are thinking about the massive amount of memory across new tiers, the swapping out of PCIe for a new interconnect, and the pervasive GPUs were first to mind. …