Kavli Affiliate: Yi Zhou | First 5 Authors: Yufeng Yang, Erin Tripp, Yifan Sun, Shaofeng Zou, Yi Zhou | Summary: Recent studies have shown that many nonconvex machine learning problems meet a so-called generalized-smooth condition that extends beyond traditional smooth nonconvex optimization. However, the existing algorithms designed for generalized-smooth nonconvex optimization encounter significant limitations in […]
Continue.. Independently-Normalized SGD for Generalized-Smooth Nonconvex Optimization