Causal Image Modeling for Efficient Visual Understanding

Kavli Affiliate: Feng Wang | First 5 Authors: Feng Wang, Timing Yang, Yaodong Yu, Sucheng Ren, Guoyizhe Wei | Summary: In this work, we present a comprehensive analysis of causal image modeling and introduce the Adventurer series models where we treat images as sequences of patch tokens and employ uni-directional language models to learn visual […]


Continue.. Causal Image Modeling for Efficient Visual Understanding

Ion-Assisted Nanoscale Material Engineering in Atomic Layers

Kavli Affiliate: Xiang Zhang | First 5 Authors: Hossein Taghinejad, Mohammad Taghinejad, Sajjad Abdollahramezani, Qitong Li, Eric V. Woods | Summary: Achieving deterministic control over the properties of low-dimensional materials with nanoscale precision is a long-sought goal. Mastering this capability has a transformative impact on the design of multifunctional electrical and optical devices. Here, we […]


Continue.. Ion-Assisted Nanoscale Material Engineering in Atomic Layers

How to evaluate your medical time series classification?

Kavli Affiliate: Xiang Zhang | First 5 Authors: Yihe Wang, Taida Li, Yujun Yan, Wenzhan Song, Xiang Zhang | Summary: Medical time series (MedTS) play a critical role in many healthcare applications, such as vital sign monitoring and the diagnosis of brain and heart diseases. However, the existence of subject-specific features poses unique challenges in […]


Continue.. How to evaluate your medical time series classification?

Repurposing Foundation Model for Generalizable Medical Time Series Classification

Kavli Affiliate: Xiang Zhang | First 5 Authors: Nan Huang, Haishuai Wang, Zihuai He, Marinka Zitnik, Xiang Zhang | Summary: Medical time series (MedTS) classification is critical for a wide range of healthcare applications such as Alzheimer’s Disease diagnosis. However, its real-world deployment is severely challenged by poor generalizability due to inter- and intra-dataset heterogeneity […]


Continue.. Repurposing Foundation Model for Generalizable Medical Time Series Classification

Takin-VC: Zero-shot Voice Conversion via Jointly Hybrid Content and Memory-Augmented Context-Aware Timbre Modeling

Kavli Affiliate: Xiang Zhang | First 5 Authors: Yuguang Yang, Yu Pan, Jixun Yao, Xiang Zhang, Jianhao Ye | Summary: Zero-shot voice conversion (VC) aims to transform the source speaker timbre into an arbitrary unseen one without altering the original speech content.While recent advancements in zero-shot VC methods have shown remarkable progress, there still remains […]


Continue.. Takin-VC: Zero-shot Voice Conversion via Jointly Hybrid Content and Memory-Augmented Context-Aware Timbre Modeling

PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Kavli Affiliate: Feng Wang | First 5 Authors: Tao Tan, Yining Qian, Ang Lv, Hongzhan Lin, Songhao Wu | Summary: Large language models (LLMs) enhanced with retrieval-augmented generation (RAG) have introduced a new paradigm for web search. However, the limited context awareness of LLMs degrades their performance on RAG tasks. Existing methods to enhance context […]


Continue.. PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Kavli Affiliate: Feng Wang | First 5 Authors: Tao Tan, Yining Qian, Ang Lv, Hongzhan Lin, Songhao Wu | Summary: Large language models (LLMs) enhanced with retrieval-augmented generation (RAG) have introduced a new paradigm for web search. However, the limited context awareness of LLMs degrades their performance on RAG tasks. Existing methods to enhance context […]


Continue.. PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Direct measurement of terahertz conductivity in a gated monolayer semiconductor

Kavli Affiliate: Feng Wang | First 5 Authors: Su-Di Chen, Qixin Feng, Wenyu Zhao, Ruishi Qi, Zuocheng Zhang | Summary: Two-dimensional semiconductors and their moir’e superlattices have emerged as important platforms for investigating correlated electrons. However, many key properties of these systems, such as the frequency-dependent conductivity, remain experimentally inaccessible because of the mesoscopic sample […]


Continue.. Direct measurement of terahertz conductivity in a gated monolayer semiconductor

The multi-state geometry of shift current and polarization

Kavli Affiliate: Joel E. Moore | First 5 Authors: Alexander Avdoshkin, Johannes Mitscherling, Joel E. Moore, , | Summary: The quantum metric and Berry curvature capture essential properties of non-trivial Bloch states and underpin many fascinating phenomena. However, it becomes increasingly evident that a more comprehensive understanding of quantum state geometry is necessary to explain […]


Continue.. The multi-state geometry of shift current and polarization

Theoretical insights into the role of lattice fluctuations on the excited behavior of lead halide perovskites

Kavli Affiliate: David T. Limmer | First 5 Authors: Yoonjae Park, Rohit Rana, Daniel Chabeda, Eran Rabani, David T. Limmer | Summary: Unravelling the role of charge-lattice interactions on the optoelectronic properties in lead halide perovskites is of great interest due to their unique photophysical properties. While there is broad consensus on the importance of […]


Continue.. Theoretical insights into the role of lattice fluctuations on the excited behavior of lead halide perovskites