Late-Interaction InfoNCE: A Novel Contrastive Loss Function with Combined Similarity Metrics

  • Yunhan Bu
  • , Lun Wang
  • , Tianwei Huang
  • , Askar Hamdulla
  • , Huaping Zhang*
  • , Quan Zhang*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Multi-hop reasoning presents significant challenges in natural language processing, particularly due to asymmetric retrieval where evidence within a reasoning chain varies greatly in retrieval difficulty. Implicit evidence, which lacks explicit retrieval identifiers, is often overshadowed by more readily retrievable explicit evidence, leading models to favor superficial associations over deeper semantic reasoning. To address this, we propose Late-Interaction InfoNCE, a novel contrastive loss function that integrates both dot product and Hadamard product interactions to enhance the representation of semantic relationships between queries and evidence samples. This method improves the model's ability to capture fine-grained feature couplings and global semantic alignments simultaneously. Additionally, we introduce a false negative masking strategy to reduce interference from semantically related negative samples. Experiments on the EX-FEVER dataset demonstrate that our approach achieves state-of-the-art performance across multiple retrieval metrics, including Recall and MRR, validating its effectiveness in complex asymmetric retrieval scenarios.

Original languageEnglish
Title of host publication2025 10th International Conference on Computer and Information Processing Technology, ISCIPT 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages631-635
Number of pages5
ISBN (Electronic)9798331595906
DOIs
Publication statusPublished - 2025
Externally publishedYes
Event10th International Conference on Computer and Information Processing Technology, ISCIPT 2025 - Fushun, China
Duration: 12 Sept 202514 Sept 2025

Publication series

Name2025 10th International Conference on Computer and Information Processing Technology, ISCIPT 2025

Conference

Conference10th International Conference on Computer and Information Processing Technology, ISCIPT 2025
Country/TerritoryChina
CityFushun
Period12/09/2514/09/25

Keywords

  • Asymmetric Retrieval
  • Late Interaction
  • Multi-hop Reasoning

Fingerprint

Dive into the research topics of 'Late-Interaction InfoNCE: A Novel Contrastive Loss Function with Combined Similarity Metrics'. Together they form a unique fingerprint.

Cite this