Video: Baidu Releases Fast Allreduce Library for Deep Learning

In this video, from Andrew Gibiansky from Baidu describes baidu-allreduce, a newly released C library that enables faster training of neural network models across many GPUs. The library demonstrates the allreduce algorithm, which you can embed into any MPI-enabled application. ""Neural networks have grown in scale over the past several years, and training can require a massive amount of data and computational resources. To provide the required amount of compute power, we scale models to dozens of GPUs using a technique common in high-performance computing but underused in deep learning."

The post Video: Baidu Releases Fast Allreduce Library for Deep Learning appeared first on insideHPC.