Efficient Sparse Attention needs Adaptive Token Release

Kavli Affiliate: Dan Luo | First 5 Authors: Chaoran Zhang, Lixin Zou, Dan Luo, Min Tang, Xiangyang Luo | Summary: In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide array of text-centric tasks. However, their `large’ scale introduces significant computational and storage challenges, particularly in managing the key-value states of […]


Continue.. Efficient Sparse Attention needs Adaptive Token Release

Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning

Kavli Affiliate: Xiang Zhang | First 5 Authors: Yixiao Wang, Yifei Zhang, Mingxiao Huo, Ran Tian, Xiang Zhang | Summary: The increasing complexity of tasks in robotics demands efficient strategies for multitask and continual learning. Traditional models typically rely on a universal policy for all tasks, facing challenges such as high computational costs and catastrophic […]


Continue.. Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning

Learning Robust 3D Representation from CLIP via Dual Denoising

Kavli Affiliate: Wei Gao | First 5 Authors: Shuqing Luo, Bowen Qu, Wei Gao, , | Summary: In this paper, we explore a critical yet under-investigated issue: how to learn robust and well-generalized 3D representation from pre-trained vision language models such as CLIP. Previous works have demonstrated that cross-modal distillation can provide rich and useful […]


Continue.. Learning Robust 3D Representation from CLIP via Dual Denoising

Efficient state preparation for the quantum simulation of molecules in first quantization

Kavli Affiliate: Birgitta Whaley | First 5 Authors: William J. Huggins, Oskar Leimkuhler, Torin F. Stetina, K. Birgitta Whaley, | Summary: The quantum simulation of real molecules and materials is one of the most highly anticipated applications of quantum computing. Algorithms for simulating electronic structure using a first-quantized plane wave representation are especially promising due […]


Continue.. Efficient state preparation for the quantum simulation of molecules in first quantization

$mathbb{Z}_4$ transitions in quantum loop models on a zig-zag ladder

Kavli Affiliate: Natalia Chepiga | First 5 Authors: Bowy M. La Rivière, Natalia Chepiga, , , | Summary: We study the nature of quantum phase transitions out of $mathbb{Z}_4$ ordered phases in quantum loop models on a zig-zag ladder. We report very rich critical behaviour that includes a pair of Ising transitions, a multi-critical Ashkin-Teller […]


Continue.. $mathbb{Z}_4$ transitions in quantum loop models on a zig-zag ladder

$mathbb{Z}_4$ transitions in quantum loop models on a zig-zag ladder

Kavli Affiliate: Natalia Chepiga | First 5 Authors: Bowy M. La Rivière, Natalia Chepiga, , , | Summary: We study the nature of quantum phase transitions out of $mathbb{Z}_4$ ordered phases in quantum loop models on a zig-zag ladder. We report very rich critical behavior that includes a pair of Ising transitions, a multi-critical Ashkin-Teller […]


Continue.. $mathbb{Z}_4$ transitions in quantum loop models on a zig-zag ladder

YuLan: An Open-source Large Language Model

Kavli Affiliate: Feng Wang | First 5 Authors: Yutao Zhu, Kun Zhou, Kelong Mao, Wentong Chen, Yiding Sun | Summary: Large language models (LLMs) have become the foundation of many applications, leveraging their extensive capabilities in processing and understanding natural language. While many open-source LLMs have been released with technical reports, the lack of training […]


Continue.. YuLan: An Open-source Large Language Model

YuLan: An Open-source Large Language Model

Kavli Affiliate: Feng Wang | First 5 Authors: Yutao Zhu, Kun Zhou, Kelong Mao, Wentong Chen, Yiding Sun | Summary: Large language models (LLMs) have become the foundation of many applications, leveraging their extensive capabilities in processing and understanding natural language. While many open-source LLMs have been released with technical reports, the lack of training […]


Continue.. YuLan: An Open-source Large Language Model

ML-Powered FPGA-based Real-Time Quantum State Discrimination Enabling Mid-circuit Measurements

Kavli Affiliate: Irfan Siddiqi | First 5 Authors: Neel R. Vora, Yilun Xu, Akel Hashim, Neelay Fruitwala, Ho Nam Nguyen | Summary: Similar to reading the transistor state in classical computers, identifying the quantum bit (qubit) state is a fundamental operation to translate quantum information. However, identifying quantum state has been the slowest and most […]


Continue.. ML-Powered FPGA-based Real-Time Quantum State Discrimination Enabling Mid-circuit Measurements

ML-Powered FPGA-based Real-Time Quantum State Discrimination Enabling Mid-circuit Measurements

Kavli Affiliate: Birgitta Whaley | First 5 Authors: Neel R. Vora, Yilun Xu, Akel Hashim, Neelay Fruitwala, Ho Nam Nguyen | Summary: Similar to reading the transistor state in classical computers, identifying the quantum bit (qubit) state is a fundamental operation to translate quantum information. However, identifying quantum state has been the slowest and most […]


Continue.. ML-Powered FPGA-based Real-Time Quantum State Discrimination Enabling Mid-circuit Measurements