Kavli Affiliate: Yi Zhou | First 5 Authors: Qi Zhang, Yi Zhou, Shaofeng Zou, , | Summary: This paper provides the first tight convergence analyses for RMSProp and Adam in non-convex optimization under the most relaxed assumptions of coordinate-wise generalized smoothness and affine noise variance. We first analyze RMSProp, which is a special case of […]
Kavli Affiliate: Feng Wang | First 5 Authors: Feng Wang, Kurt Webber, David Radford, Luca di Mare, Marcus Meyer | Summary: This paper develops a numerical procedure to accelerate the convergence of the Favre-averaged Non-Linear Harmonic (FNLH) method. The scheme provides a unified mathematical framework for solving the sparse linear systems formed by the mean […]
Kavli Affiliate: Feng Wang | First 5 Authors: Feng Wang, Kurt Webber, David Radford, Luca di Mare, Marcus Meyer | Summary: This paper develops a numerical procedure to accelerate the convergence of the Favre-averaged Non-Linear Harmonic (FNLH) method. The scheme provides a unified mathematical framework for solving the sparse linear systems formed by the mean […]
Kavli Affiliate: Peter W. Graham | First 5 Authors: Peter W. Graham, Harikrishnan Ramani, , , | Summary: There is a large and growing interest in observations of small-scale structure in dark matter. We propose a new way to probe dark matter structures in the $sim 10 – 10^8 , M_odot$ range. This allows us […]
Kavli Affiliate: Peter W. Graham | First 5 Authors: Peter W. Graham, Harikrishnan Ramani, , , | Summary: There is a large and growing interest in observations of small-scale structure in dark matter. We propose a new way to probe dark matter structures in the $sim 10 – 10^8 , M_odot$ range. This allows us […]
Kavli Affiliate: Yi Zhou | First 5 Authors: Qi Zhang, Yi Zhou, Ashley Prater-Bennette, Lixin Shen, Shaofeng Zou | Summary: Distributionally robust optimization (DRO) is a powerful framework for training robust models against data distribution shifts. This paper focuses on constrained DRO, which has an explicit characterization of the robustness level. Existing studies on constrained […]
Kavli Affiliate: Dheeraj R. Pasham | First 5 Authors: Shubham Kejriwal, Vojtech Witzany, Michal Zajacek, Dheeraj R. Pasham, Alvin J. K. Chua | Summary: Extreme-mass-ratio inspirals (EMRIs) are one of the primary targets for the recently adopted millihertz gravitational-wave (GW) observatory LISA. Some previous studies have argued that a fraction of all EMRIs form in […]
Kavli Affiliate: Dheeraj R. Pasham | First 5 Authors: Shubham Kejriwal, Vojtech Witzany, Michal Zajacek, Dheeraj R. Pasham, Alvin J. K. Chua | Summary: Extreme-mass-ratio inspirals (EMRIs) are one of the primary targets for the recently adopted millihertz gravitational-wave (GW) observatory LISA. Some previous studies have argued that a fraction of all EMRIs form in […]
Kavli Affiliate: Dheeraj R. Pasham | First 5 Authors: Shubham Kejriwal, Vojtech Witzany, Michal Zajacek, Dheeraj R. Pasham, Alvin J. K. Chua | Summary: Extreme-mass-ratio inspirals (EMRIs) are one of the primary targets for the recently adopted millihertz gravitational-wave (GW) observatory LISA. Some previous studies have argued that a fraction of all EMRIs form in […]
Kavli Affiliate: Dheeraj R. Pasham | First 5 Authors: Shubham Kejriwal, Vojtech Witzany, Michal Zajacek, Dheeraj R. Pasham, Alvin J. K. Chua | Summary: Extreme-mass-ratio inspirals (EMRIs) are one of the primary targets for the recently adopted millihertz gravitational-wave (GW) observatory LISA. Some previous studies have argued that a fraction of all EMRIs form in […]