Boosting legal case retrieval by query content selection with large language models

Youchao Zhou, Heyan Huang*, Zhijing Wu

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

Legal case retrieval, which aims to retrieve relevant cases to a given query case, benefits judgment justice and attracts increasing attention. Unlike generic retrieval queries, legal case queries are typically long and the definition of relevance is closely related to legal-specific elements. Therefore, legal case queries may suffer from noise and sparsity of salient content, which hinders retrieval models from perceiving correct information in a query. While previous studies have paid attention to improving retrieval models and understanding relevance judgments, we focus on enhancing legal case retrieval by utilizing the salient content in legal case queries. We first annotate the salient content in queries manually and investigate how sparse and dense retrieval models attend to those content. Then we experiment with various query content selection methods utilizing large language models (LLMs) to extract or summarize salient content and incorporate it into the retrieval models. Experimental results show that reformulating long queries using LLMs improves the performance of both sparse and dense models in legal case retrieval.

Original languageEnglish
Title of host publicationSIGIR-AP 2023 - Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region
PublisherAssociation for Computing Machinery, Inc
Pages176-184
Number of pages9
ISBN (Electronic)9798400704086
DOIs
Publication statusPublished - 26 Nov 2023
Event11th International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, SIGIR-AP 2023 - Beijing, China
Duration: 26 Nov 202328 Nov 2023

Publication series

NameSIGIR-AP 2023 - Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region

Conference

Conference11th International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, SIGIR-AP 2023
Country/TerritoryChina
CityBeijing
Period26/11/2328/11/23

Keywords

  • Content selection
  • Large language models
  • Legal case retrieval
  • Query reformulation

Fingerprint

Dive into the research topics of 'Boosting legal case retrieval by query content selection with large language models'. Together they form a unique fingerprint.

Cite this