Kavli Affiliate: Yi Zhou | First 5 Authors: Hong Li, Xingyu Li, Pengbo Hu, Yinuo Lei, Chunxiao Li | Summary: While the field of multi-modal learning keeps growing fast, the deficiency of the standard joint training paradigm has become clear through recent studies. They attribute the sub-optimal performance of the jointly trained model to the […]
Continue.. Boosting Multi-modal Model Performance with Adaptive Gradient Modulation