PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Posted by dbos Berkeley

Kavli Affiliate: Feng Wang | First 5 Authors: Tao Tan, Yining Qian, Ang Lv, Hongzhan Lin, Songhao Wu | Summary: Large language models (LLMs) enhanced with retrieval-augmented generation (RAG) have introduced a new paradigm for web search. However, the limited context awareness of LLMs degrades their performance on RAG tasks. Existing methods to enhance context […]


Continue.. PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Posted by dbos Berkeley

Kavli Affiliate: Feng Wang | First 5 Authors: Tao Tan, Yining Qian, Ang Lv, Hongzhan Lin, Songhao Wu | Summary: Large language models (LLMs) enhanced with retrieval-augmented generation (RAG) have introduced a new paradigm for web search. However, the limited context awareness of LLMs degrades their performance on RAG tasks. Existing methods to enhance context […]


Continue.. PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Gravitational Wave Astronomy With TianQin

Posted by dbos Peking

Kavli Affiliate: Kohei Inayoshi | First 5 Authors: En-Kun Li, Shuai Liu, Alejandro Torres-Orjuela, Xian Chen, Kohei Inayoshi | Summary: The opening of the gravitational wave window has significantly enhanced our capacity to explore the universe’s most extreme and dynamic sector. In the mHz frequency range, a diverse range of compact objects, from the most […]


Continue.. Gravitational Wave Astronomy With TianQin

Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMs

Posted by dbos Caltech

Kavli Affiliate: Wei Gao | First 5 Authors: Fengzhu Zeng, Wenqian Li, Wei Gao, Yan Pang, | Summary: Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic datasets generated by AI technologies. However, the generalizability of […]


Continue.. Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMs

Magnetic field of the roAp star KIC~10685175: observations versus theory

Posted by dbos Peking

Kavli Affiliate: Huawei Zhang | First 5 Authors: Fangfei Shi, Huawei Zhang, Swetlana Hubrig, Silva Jarvinen, Huiling Chen | Summary: KIC 10685175 is a roAp star whose polar magnetic field is predicted to be 6 kG through a non-adiabatic axisymmetric pulsation theoretical model. In this work, we aim to measure the magnetic field strength of […]


Continue.. Magnetic field of the roAp star KIC~10685175: observations versus theory