PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Posted by dbos Berkeley

Kavli Affiliate: Feng Wang | First 5 Authors: Tao Tan, Yining Qian, Ang Lv, Hongzhan Lin, Songhao Wu | Summary: Large language models (LLMs) enhanced with retrieval-augmented generation (RAG) have introduced a new paradigm for web search. However, the limited context awareness of LLMs degrades their performance on RAG tasks. Existing methods to enhance context […]


Continue.. PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Posted by dbos Berkeley

Kavli Affiliate: Feng Wang | First 5 Authors: Tao Tan, Yining Qian, Ang Lv, Hongzhan Lin, Songhao Wu | Summary: Large language models (LLMs) enhanced with retrieval-augmented generation (RAG) have introduced a new paradigm for web search. However, the limited context awareness of LLMs degrades their performance on RAG tasks. Existing methods to enhance context […]


Continue.. PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Gravitational Wave Astronomy With TianQin

Posted by dbos Peking

Kavli Affiliate: Kohei Inayoshi | First 5 Authors: En-Kun Li, Shuai Liu, Alejandro Torres-Orjuela, Xian Chen, Kohei Inayoshi | Summary: The opening of the gravitational wave window has significantly enhanced our capacity to explore the universe’s most extreme and dynamic sector. In the mHz frequency range, a diverse range of compact objects, from the most […]


Continue.. Gravitational Wave Astronomy With TianQin

Gravitational Wave Astronomy With TianQin

Posted by dbos Peking

Kavli Affiliate: Kohei Inayoshi | First 5 Authors: En-Kun Li, Shuai Liu, Alejandro Torres-Orjuela, Xian Chen, Kohei Inayoshi | Summary: The opening of the gravitational wave window has significantly enhanced our capacity to explore the universe’s most extreme and dynamic sector. In the mHz frequency range, a diverse range of compact objects, from the most […]


Continue.. Gravitational Wave Astronomy With TianQin

Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMs

Posted by dbos Caltech

Kavli Affiliate: Wei Gao | First 5 Authors: Fengzhu Zeng, Wenqian Li, Wei Gao, Yan Pang, | Summary: Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic datasets generated by AI technologies. However, the generalizability of […]


Continue.. Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMs

Magnetic field of the roAp star KIC~10685175: observations versus theory

Posted by dbos Peking

Kavli Affiliate: Huawei Zhang | First 5 Authors: Fangfei Shi, Huawei Zhang, Swetlana Hubrig, Silva Jarvinen, Huiling Chen | Summary: KIC 10685175 is a roAp star whose polar magnetic field is predicted to be 6 kG through a non-adiabatic axisymmetric pulsation theoretical model. In this work, we aim to measure the magnetic field strength of […]


Continue.. Magnetic field of the roAp star KIC~10685175: observations versus theory

Dysregulation of the fluid homeostasis system by aging

Posted by dbos UCSF

Kavli Affiliate: Zachary Knight | Authors: Heeun Jang, Alexis Behne Sharma, Usan Dan, Jasmine H. Wong, Zachary A. Knight and Jennifer L. Garrison | Summary: Chronic dehydration is a leading cause of morbidity for the elderly, but how aging alters the fluid homeostasis system is not well understood. Here, we used a combination of physiologic, […]


Continue.. Dysregulation of the fluid homeostasis system by aging

Holographic Renyi entropies in KdV generalized ensembles

Posted by dbos UCAS

Kavli Affiliate: Huajia Wang | First 5 Authors: Liangyu Chen, Anatoly Dymarsky, Jia Tian, Huajia Wang, | Summary: The eigenstate thermalization hypothesis (ETH) in chaotic two dimensional CFTs is subtle due to infinitely many conserved KdV charges. Previous works have demonstrated that primary CFT eigenstates have flat entanglement spectrum, which is very different from the […]


Continue.. Holographic Renyi entropies in KdV generalized ensembles

Holographic Renyi entropies in KdV generalized ensembles

Posted by dbos UCAS

Kavli Affiliate: Huajia Wang | First 5 Authors: Liangyu Chen, Anatoly Dymarsky, Jia Tian, Huajia Wang, | Summary: The eigenstate thermalization hypothesis (ETH) in chaotic two dimensional CFTs is subtle due to infinitely many conserved KdV charges. Previous works have demonstrated that primary CFT eigenstates have flat entanglement spectrum, which is very different from the […]


Continue.. Holographic Renyi entropies in KdV generalized ensembles

Holographic Renyi entropy of 2d CFT in KdV generalized ensemble

Posted by dbos UCAS

Kavli Affiliate: Huajia Wang | First 5 Authors: Liangyu Chen, Anatoly Dymarsky, Jia Tian, Huajia Wang, | Summary: The eigenstate thermalization hypothesis (ETH) in chaotic two dimensional CFTs is subtle due to infinitely many conserved KdV charges. Previous works have demonstrated that primary CFT eigenstates have flat entanglement spectrum, which is very different from the […]


Continue.. Holographic Renyi entropy of 2d CFT in KdV generalized ensemble