SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation

Kavli Affiliate: Zheng Zhu | First 5 Authors: Yi Wei, Linqing Zhao, Wenzhao Zheng, Zheng Zhu, Yongming Rao | Summary: Depth estimation from images serves as the fundamental step of 3D perception for autonomous driving and is an economical alternative to expensive depth sensors like LiDAR. The temporal photometric constraints enables self-supervised depth estimation without […]


Continue.. SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation

Valley hydrodynamics in gapped graphene

Kavli Affiliate: Mamoru Matsuo | First 5 Authors: Ryotaro Sano, Daigo Oue, Mamoru Matsuo, , | Summary: Recent experiments have revealed that novel nonequilibrium states consistent with the hydrodynamic description of electrons are realized in ultrapure graphene, which hosts the valley degrees of freedom. Here, we formulate a theory of electron hydrodynamics including dissipation processes […]


Continue.. Valley hydrodynamics in gapped graphene

Data Sampling Affects the Complexity of Online SGD over Dependent Data

Kavli Affiliate: Yi Zhou | First 5 Authors: Shaocong Ma, Ziyi Chen, Yi Zhou, Kaiyi Ji, Yingbin Liang | Summary: Conventional machine learning applications typically assume that data samples are independently and identically distributed (i.i.d.). However, practical scenarios often involve a data-generating process that produces highly dependent data samples, which are known to heavily bias […]


Continue.. Data Sampling Affects the Complexity of Online SGD over Dependent Data

A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization

Kavli Affiliate: Yi Zhou | First 5 Authors: Ziyi Chen, Bhavya Kailkhura, Yi Zhou, , | Summary: Many important machine learning applications involve regularized nonconvex bi-level optimization. However, the existing gradient-based bi-level optimization algorithms cannot handle nonconvex or nonsmooth regularizers, and they suffer from a high computation complexity in nonconvex bi-level optimization. In this work, […]


Continue.. A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization

A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization

Kavli Affiliate: Yi Zhou | First 5 Authors: Ziyi Chen, Bhavya Kailkhura, Yi Zhou, , | Summary: Many important machine learning applications involve regularized nonconvex bi-level optimization. However, the existing gradient-based bi-level optimization algorithms cannot handle nonconvex or nonsmooth regularizers, and they suffer from a high computation complexity in nonconvex bi-level optimization. In this work, […]


Continue.. A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization

A quantum-inspired tensor network method for constrained combinatorial optimization problems

Kavli Affiliate: Cheng Peng | First 5 Authors: Tianyi Hao, Xuxin Huang, Chunjing Jia, Cheng Peng, | Summary: Combinatorial optimization is of general interest for both theoretical study and real-world applications. Fast-developing quantum algorithms provide a different perspective on solving combinatorial optimization problems. In this paper, we propose a quantum inspired algorithm for general locally […]


Continue.. A quantum-inspired tensor network method for constrained combinatorial optimization problems

A quantum-inspired tensor network method for constrained combinatorial optimization problems

Kavli Affiliate: Cheng Peng | First 5 Authors: Tianyi Hao, Xuxin Huang, Chunjing Jia, Cheng Peng, | Summary: Combinatorial optimization is of general interest for both theoretical study and real-world applications. Fast-developing quantum algorithms provide a different perspective on solving combinatorial optimization problems. In this paper, we propose a quantum-inspired tensor-network-based algorithm for general locally […]


Continue.. A quantum-inspired tensor network method for constrained combinatorial optimization problems

Decoupled Multi-task Learning with Cyclical Self-Regulation for Face Parsing

Kavli Affiliate: Zheng Zhu | First 5 Authors: Qingping Zheng, Jiankang Deng, Zheng Zhu, Ying Li, Stefanos Zafeiriou | Summary: This paper probes intrinsic factors behind typical failure cases (e.g. spatial inconsistency and boundary confusion) produced by the existing state-of-the-art method in face parsing. To tackle these problems, we propose a novel Decoupled Multi-task Learning […]


Continue.. Decoupled Multi-task Learning with Cyclical Self-Regulation for Face Parsing

Delving into the Estimation Shift of Batch Normalization in a Network

Kavli Affiliate: Yi Zhou | First 5 Authors: Lei Huang, Yi Zhou, Tian Wang, Jie Luo, Xianglong Liu | Summary: Batch normalization (BN) is a milestone technique in deep learning. It normalizes the activation using mini-batch statistics during training but the estimated population statistics during inference. This paper focuses on investigating the estimation of population […]


Continue.. Delving into the Estimation Shift of Batch Normalization in a Network