Kavli Affiliate: Jia Liu | First 5 Authors: Menglu Yu, Bo Ji, Hridesh Rajan, Jia Liu, | Summary: Powered by advances in deep learning (DL) techniques, machine learning and artificial intelligence have achieved astonishing successes. However, the rapidly growing needs for DL also led to communication- and resource-intensive distributed training jobs for large-scale DL training, […]