Distributed Stochastic Gradient Descent

AbstractWe make distributed stochastic gradient descent faster by exchanging sparse updates instead of dense updates. Gradient updates are positively skewed as most updates are near zero, so we map the …...