A research team from Nvidia has provided interesting insight about using mixed precision on deep learning training across very large training sets and how performance and scalability are affected by working with a batch size of 32,000 using recurrent neural networks. …
This year at the International Supercomputing Conference we detailed some of the major quantum computing development efforts, including updates from the Microsoft team on the Q# language, and the academic Project Q environment. …
A working group formed on behalf of the Exascale Computing Project (ECP) in the U.S. …
At the height of the Hadoop era there were countless storage and analytics startups based on the Hadoop Distributed File System (HDFS), several of which were backed by venture capital firm Andreessen Horowitz, which was committed to the Hadoop and open source-driven big data startup cause when that was all the rage in 2010 until around 2014 or so. …
Big things can often fit into small packages, especially if those packages are tightly bound. …
There has been much written about the potential for FPGAs to take a leadership role in accelerating deep learning but in practice, the hurdles of getting from concept to high performance hardware design are still taller than many AI shops are willing to scale, particularly when GPUs dominate in training and in a pinch, standard CPUs will do just fine for datacenter inference since they involve little developer overhead. …
This morning at Google Next computer architecture pioneers, John Hennessey and David Patterson, remarked that even though it could be revolutionary, quantum computing is still at least a decade away. …
As the rubber begins to meet the road for quantum computing, the conversation is shifting from one about the practicality of hardware to how future users will interface with quantum systems. …
Despite some of the inherent complexities of using FPGAs for implementing deep neural networks, there is a strong efficiency case for using reprogrammable devices for both training and inference. …
When it comes to building extreme scale computing platforms, there are plenty of system design options but in supercomputing, the only practical choice for an OS is Linux. …
All Content Copyright 2017 The Next Platform
