On Fine-Grained I/O Complexity of Attention Backward Passes

Posted by klaurent Peking

Kavli Affiliate: Li Xin Li| First 5 Authors: [#item_custom_name[1, [#item_custom_name[2, [#item_custom_name[3, [#item_custom_name[4, [#item_custom_name[5| Summary:Large Language Models (LLMs) exhibit exceptional proficiency in handling extensive context windows in natural language. Nevertheless, the quadratic scaling of attention computation relative to sequence length creates substantial efficiency bottlenecks, necessitating the development of I/O-optimized algorithms. In this work, we conduct a […]


Continue.. On Fine-Grained I/O Complexity of Attention Backward Passes

ESVO2: Direct Visual-Inertial Odometry with Stereo Event Cameras

Posted by dbos UCAS

Kavli Affiliate: Yi Zhou | First 5 Authors: Junkai Niu, Sheng Zhong, Xiuyuan Lu, Shaojie Shen, Guillermo Gallego | Summary: Event-based visual odometry is a specific branch of visual Simultaneous Localization and Mapping (SLAM) techniques, which aims at solving tracking and mapping subproblems (typically in parallel), by exploiting the special working principles of neuromorphic (i.e., […]


Continue.. ESVO2: Direct Visual-Inertial Odometry with Stereo Event Cameras