Nvidia DGX1-V Appliance Crushes NLP Training Baselines
A research team from Nvidia has provided interesting insight about using mixed precision on deep learning training across very large training sets and how performance and scalability are affected by working with a batch size of 32,000 using recurrent neural networks. …