Abstract

Retrieval-Augmented Generation (RAG) can alleviate hallucinations of LargeLanguage Models (LLMs) by referencing external documents. However, themisinformation in external documents may mislead LLMs' generation. To addressthis issue, we explore the task of "credibility-aware RAG", in which LLMsautomatically adjust the influence of retrieved documents based on theircredibility scores to counteract misinformation. To this end, we introduce aplug-and-play method named $\textbf{Cr}$edibility-aware $\textbf{A}$ttention$\textbf{M}$odification (CrAM). CrAM identifies influential attention heads inLLMs and adjusts their attention weights based on the credibility of thedocuments, thereby reducing the impact of low-credibility documents.Experiments on Natual Questions and TriviaQA using Llama2-13B, Llama3-8B, andQwen1.5-7B show that CrAM improves the RAG performance of LLMs againstmisinformation pollution by over 20%, even surpassing supervised fine-tuningmethods.