pursueorigin / ChocoSGD

Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356

CHOCO-SGD

The code repository for the main experiments in the paper Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication and Decentralized Deep Learning with Arbitrary Communication Compression.

Please refer to the folders convex_code and dl_code for more details.

Reference

If you use the code, please cite the following papers:

@inproceedings{ksj2019choco,
    author = {Anastasia Koloskova and Sebastian U. Stich and Martin Jaggi},
    title = {Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication},
    booktitle = {ICML 2019 - Proceedings of the 36th International Conference on Machine Learning},
    url = {http://proceedings.mlr.press/v97/koloskova19a.html},
    series = {Proceedings of Machine Learning Research},
    publisher = {PMLR}, 
    volume = {97},
    pages = {3479--3487},
    year = {2019}
}

and

@article{koloskova2019decentralized,
  title={Decentralized Deep Learning with Arbitrary Communication Compression},
  author={Koloskova, Anastasia and Lin, Tao and Stich, Sebastian U and Jaggi, Martin},
  journal={arXiv preprint arXiv:1907.09356},
  year={2019}
}