跳到主要导航 跳到搜索 跳到主要内容

G-CoS: An Interpretable Gain-Cost Framework for User Satisfaction Estimation in Generative Information Retrieval

  • Beijing Institute of Technology

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

User satisfaction serves as a key indicator of search experience in Generative Information Retrieval (GenIR) systems, and its accurate estimation is essential for system optimization. Extensive research in traditional IR has established interaction signals (e.g., dwell time, clicks, query reformulations) as reliable indicators of user satisfaction. However, prevailing approaches for satisfaction estimation in GenIR (e.g., LLM-as-a-judge) primarily rely on textual content and fail to account for user interactions during the search process. In this work, empirical analysis of real-world data shows that user satisfaction correlates negatively with interaction signals reflecting interaction cost, and positively with response quality. Building on these findings, we propose the Gain-aware Cost-sensitive Satisfaction estimator (G-CoS), an interpretable gain-cost framework for user satisfaction estimation in GenIR. G-CoS models user satisfaction as a dynamic trade-off between Response Quality and multidimensional Interaction Cost. Experimental results demonstrate that G-CoS outperforms LLM-as-a-judge methods, interaction sequence models, as well as machine learning models using the same gain and cost features. Moreover, the learned parameters reveal interpretable associations between gain-cost dynamics and user satisfaction. This work contributes an interpretable framework for user satisfaction estimation and offers insights for GenIR system optimization.

源语言英语
主期刊名SIGIR 2026 - Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval
出版商Association for Computing Machinery, Inc
4110-4115
页数6
ISBN(电子版)9798400725999
DOI
出版状态已出版 - 19 7月 2026
活动49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026 - Melbourne, 澳大利亚
期限: 20 7月 202624 7月 2026

丛书

姓名SIGIR 2026 - Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval

会议

会议49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026
国家/地区澳大利亚
Melbourne
时期20/07/2624/07/26

学术指纹

探究 'G-CoS: An Interpretable Gain-Cost Framework for User Satisfaction Estimation in Generative Information Retrieval' 的科研主题。它们共同构成独一无二的学术指纹。

引用此