2,689 research outputs found
Asynchronous decentralized accelerated stochastic gradient descent
In this work, we introduce an asynchronous decentralized accelerated
stochastic gradient descent type of method for decentralized stochastic
optimization, considering communication and synchronization are the major
bottlenecks. We establish (resp.,
) communication complexity and
(resp., ) sampling
complexity for solving general convex (resp., strongly convex) problems
- …