The code repository for the main experiments in the paper Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication and Decentralized Deep Learning with Arbitrary Communication Compression.
Please refer to the folders convex_code
and dl_code
for more details.
If you use the code, please cite the following papers:
@inproceedings{ksj2019choco,
author = {Anastasia Koloskova and Sebastian U. Stich and Martin Jaggi},
title = {Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication},
booktitle = {ICML 2019 - Proceedings of the 36th International Conference on Machine Learning},
url = {http://proceedings.mlr.press/v97/koloskova19a.html},
series = {Proceedings of Machine Learning Research},
publisher = {PMLR},
volume = {97},
pages = {3479--3487},
year = {2019}
}
and
@article{koloskova2019decentralized,
title={Decentralized Deep Learning with Arbitrary Communication Compression},
author={Koloskova, Anastasia and Lin, Tao and Stich, Sebastian U and Jaggi, Martin},
journal={arXiv preprint arXiv:1907.09356},
year={2019}
}