A cooperative neural information retrieval pipeline with knowledge enhanced automatic query reformulation

Xiangsheng Li, Jiaxin Mao, Weizhi Ma, Zhijing Wu*, Yiqun Liu*, Min Zhang, Shaoping Ma, Zhaowei Wang, Xiuqiang He

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

12 Citations (Scopus)

Abstract

This paper presents a neural information retrieval pipeline that integrates cooperative learning of query reformulation and neural retrieval models. Our pipeline first exploits an automatic query reformulator to reformulate the user-issued query and then submits the reformulated query to the neural retrieval model. We simultaneously optimize the quality of reformulated queries and ranking performance with an alternate training strategy where query reformulator and neural retrieval model learn from the feedback of each other. Besides, we incorporate knowledge information into automatic query reformulation. The reformulated queries are further improved and contribute to a better ranking performance of the following neural retrieval model. We study two representative neural retrieval models KNRM and BERT in our pipeline. Experiments on two datasets show that our pipeline consistently improves the retrieval performance of the original neural retrieval models while only increases negligible time on automatic query reformulation.

Original languageEnglish
Title of host publicationWSDM 2022 - Proceedings of the 15th ACM International Conference on Web Search and Data Mining
PublisherAssociation for Computing Machinery, Inc
Pages553-561
Number of pages9
ISBN (Electronic)9781450391320
DOIs
Publication statusPublished - 11 Feb 2022
Externally publishedYes
Event15th ACM International Conference on Web Search and Data Mining, WSDM 2022 - Virtual, Online, United States
Duration: 21 Feb 202225 Feb 2022

Publication series

NameWSDM 2022 - Proceedings of the 15th ACM International Conference on Web Search and Data Mining

Conference

Conference15th ACM International Conference on Web Search and Data Mining, WSDM 2022
Country/TerritoryUnited States
CityVirtual, Online
Period21/02/2225/02/22

Keywords

  • Knowledge graph
  • Neural ir
  • Query reformulation

Fingerprint

Dive into the research topics of 'A cooperative neural information retrieval pipeline with knowledge enhanced automatic query reformulation'. Together they form a unique fingerprint.

Cite this