Posts by Collection

New Results on AVCs with Omniscient and Myopic Adversaries

Published in ISIT 2022, 2022

This paper is about communication capacity in the presence of a malicious jamming adversary.

Recommended citation: A. K. Yadav, M. Alimohammadi, Y. Zhang, A. J. Budkuley and S. Jaggi, "New Results on AVCs with Omniscient and Myopic Adversaries" 2022 IEEE International Symposium on Information Theory (ISIT), 2022. https://ieeexplore.ieee.org/document/9834632

L-GreCo: A Framework for Layerwise Adaptive Gradient Compression

Published in , 2022

In this paper, we addressed optimal gradient compression in distributed training of neural networks. Our proposed algorithm, called L-GreCo, uses dynamic programming to find the optimal layer-wise compression. L-GreCo preserves the model accuracy while providing training-time speed-ups under different compression schemes on multiple tasks and architectures. We are currently working towards submission to MlSys 2023.

[New Results on AVCs With Omniscient and Myopic Adversaries]

Published: June 30, 2022