Kavli Affiliate: Yi Zhou | First 5 Authors: Lei Huang, Yi Zhou, Tian Wang, Jie Luo, Xianglong Liu | Summary: Batch normalization (BN) is a milestone technique in deep learning. It normalizes the activation using mini-batch statistics during training but the estimated population statistics during inference. This paper focuses on investigating the estimation of population […]
Continue.. Delving into the Estimation Shift of Batch Normalization in a Network