awesome-distributed-deep-learning
github.com/bharathgs/awesome-distributed-deep-learning ↗A curated list of awesome Distributed Deep Learning resources.
Use this list with your AI agent
Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:
"Show me synchronization: resources from awesome-distributed-deep-learning"
Installation instructions →What's inside
Model Consistency:
- 1-Bit SGDSynchronization:
- A Fast Learning Algorithm for Deep Belief Nets.Synchronization:
- Asynchronous Parallel Stochastic Gradient DescentSynchronization:
- Asynchronous Parallel Stochastic Gradient for Nonconvex OptimizationSynchronization:
Volume 2. 2737–2745.
- Asynchronous stochastic gradient descent for DNN trainingSynchronization:
- A Unified Analysis of HOGWILD!-style Algorithms.Synchronization:
Volume 2. 2674–2682.
Blogs
- Accelerating Deep Learning Using Distributed SGD — An Overview
- distributed-deep-learning-part-1-an-introduction-to-distributed-training-of-neural-networks/
- Intro to Distributed Deep Learning Systems
- Keras + Horovod = Distributed Deep Learning on Steroids
- Meet Horovod: Uber’s Open Source Distributed Deep Learning Framework for TensorFlow
Frameworks
- deeplearning4j
Distributed Deep Learning Platform for Java, Clojure, Scala.
- Distributed Machine learning Tool Kit (DMTK)
A distributed machine learning (parameter server) framework by Microsoft. Enables training models on large data sets across multiple machines. Current tools bundled with it include: LightLDA and Distributed (Multisense) Word Embedding.
- Elephas
Elephas is an extension of Keras, which allows you to run distributed deep learning models at scale with Spark.
- go-mxnet-predictor
Go binding for MXNet c_predict_api to do inference with pre-trained model.
- Horovod
Distributed training framework for TensorFlow.
- MXNet
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
Showing a sample of 47 resources. View the full list on GitHub →