Skip to main content

> ML_LITERATURE // MCMAHAN-2017-COMMUNICATION-EFFICIENT-LEARNING-FROM-DECENTRALIZED-DATA_v1.0

Communication-Efficient Learning of Deep Networks from Decentralized Data (FedAvg)

H. Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, Blaise Agüera y Arcas · International Conference on Artificial Intelligence and Statistics (AISTATS) (2017)

algorithm2017industry-standardthirdPartyReproduced

Principal Contribution

Introduced Federated Learning and the Federated Averaging (FedAvg) algorithm, training models across decentralized mobile devices via local SGD updates without centralizing raw data.

Operational Relevance

Serves as qualified reference for implementing task-federated-learning, task-privacy-preserving-ml in production systems.

Assumptions

  • Underlying computational topology and mathematical bounds adhere to established convexity/smoothness guarantees

Limitations

  • Hardware runtime speedups, privacy budgets, and convergence depend on hyperparameters and network communication limits

Connected Algorithms, Architectures & Tools

Related Algorithms:
Related Architectures:
Implementing Libraries: