Kavli Affiliate: Long Zhang | First 5 Authors: Yang Sun, Yang Sun, , , | Summary: Retrieval-augmented generation (RAG) incorporates external knowledge into large language models (LLMs), improving their adaptability to downstream tasks and enabling information updates. Surprisingly, recent empirical evidence demonstrates that injecting noise into retrieved relevant documents paradoxically facilitates exploitation of external knowledge […]
Continue.. LFD: Layer Fused Decoding to Exploit External Knowledge in Retrieval-Augmented Generation