TY - JOUR
T1 - U-RAG
T2 - Utility-aware Retrieval-Augmented Generation via marginal gain modeling
AU - Yao, Guohui
AU - Tang, Ying
AU - Wu, Haiming
AU - Cao, Jingxu
AU - Sui, Yi
AU - Song, Dawei
AU - Ji, Songkun
N1 - Publisher Copyright:
© 2026 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license. http://creativecommons.org/licenses/by/4.0/
PY - 2027/2
Y1 - 2027/2
N2 - Retrieval-Augmented Generation (RAG) mitigates hallucinations in Large Language Models (LLMs) by grounding generation in external documents, but retrieving more documents does not always improve answer quality. Additional documents may introduce redundancy or conflicting evidence, leading to non-monotonic performance gains. To address this issue, we propose U-RAG, a Utility-Aware RAG framework that explicitly models the marginal gain of each retrieved document. U-RAG introduces a Utility Scoring Model that estimates the expected improvement in generation quality when a candidate document is added to the current context. Based on this utility estimation, U-RAG adaptively selects useful documents and determines when retrieval should stop, resulting in an average retrieval length of 2.42 under a maximum budget of three. This design enables the model to estimate a local stopping boundary between beneficial and non-beneficial one-step retrieval actions, rather than assuming that more documents are always better. We evaluate U-RAG on five open-domain question answering datasets: 2WikiMultiHopQA, HotpotQA, NaturalQA, TriviaQA, and WebQuestions. Experimental results show that U-RAG achieves the best average performance across these datasets, yielding an average relative improvement of approximately 8.5% in the combined EM/F1 metric over standard RAG. Notably, U-RAG obtains the strongest results among the compared methods on 2WikiMultiHopQA, TriviaQA, and WebQuestions, while remaining competitive with strong retrieval baselines on NaturalQA and HotpotQA.
AB - Retrieval-Augmented Generation (RAG) mitigates hallucinations in Large Language Models (LLMs) by grounding generation in external documents, but retrieving more documents does not always improve answer quality. Additional documents may introduce redundancy or conflicting evidence, leading to non-monotonic performance gains. To address this issue, we propose U-RAG, a Utility-Aware RAG framework that explicitly models the marginal gain of each retrieved document. U-RAG introduces a Utility Scoring Model that estimates the expected improvement in generation quality when a candidate document is added to the current context. Based on this utility estimation, U-RAG adaptively selects useful documents and determines when retrieval should stop, resulting in an average retrieval length of 2.42 under a maximum budget of three. This design enables the model to estimate a local stopping boundary between beneficial and non-beneficial one-step retrieval actions, rather than assuming that more documents are always better. We evaluate U-RAG on five open-domain question answering datasets: 2WikiMultiHopQA, HotpotQA, NaturalQA, TriviaQA, and WebQuestions. Experimental results show that U-RAG achieves the best average performance across these datasets, yielding an average relative improvement of approximately 8.5% in the combined EM/F1 metric over standard RAG. Notably, U-RAG obtains the strongest results among the compared methods on 2WikiMultiHopQA, TriviaQA, and WebQuestions, while remaining competitive with strong retrieval baselines on NaturalQA and HotpotQA.
KW - Marginal gain
KW - Retrieval-Augmented Generation
KW - Utility-aware retrieval
UR - https://www.scopus.com/pages/publications/105052191175
U2 - 10.1016/j.ipm.2026.105186
DO - 10.1016/j.ipm.2026.105186
M3 - Article
AN - SCOPUS:105052191175
SN - 0306-4573
VL - 64
JO - Information Processing and Management
JF - Information Processing and Management
IS - 2
M1 - 105186
ER -