Skip to main navigation Skip to search Skip to main content

From Implicit Heuristics to Explicit Optimization: A Unified Framework for In-Context Relation Extraction

  • Xin Sun*
  • , Muyu Li
  • , Jianfei Zhao
  • , Xinyang Liu
  • *Corresponding author for this work
  • Beijing Institute of Technology
  • Beijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In-context learning (ICL) for relation extraction is often undermined by its reliance on implicit heuristics. This weakness is critical in two stages: (1) example selection, where semantic similarity serves as a poor proxy for utility; (2) model reasoning, which depends on unguided attention mechanisms. This reliance on non-optimizable strategies leads to unreliable performance and hinders interpretability. This paper advocates for a fundamental shift from implicit heuristics to explicit optimization and guidance. We introduce CLARE (Contribution-driven Learning and Adaptive REasoning), a unified framework that introduces core innovations to both the example selection and model reasoning stages. For example selection, we propose Predictive Contribution Estimation (PCE), a novel method that trains a retriever to directly optimize for an example’s utility by quantifying its impact on the model’s prediction confidence. For model reasoning, we introduce Adaptive Inference Modulation (AIM), which transforms the unguided inference process into a steerable one by dynamically modulating the model’s internal attention scores. This ensures that the most valuable demonstration information is precisely leveraged. Experiments on four challenging datasets validate that CLARE significantly outperforms mainstream ICL baselines by leveraging explicit contribution estimation and guided inference.

Original languageEnglish
Title of host publicationDatabase Systems for Advanced Applications - 31st International Conference, DASFAA 2026, Proceedings
EditorsHyungsoo Jung, Tianzheng Wang, Masashi Toyoda, Hyuk-Yoon Kwon, Jae-woong Lee
PublisherSpringer Science and Business Media Deutschland GmbH
Pages54-69
Number of pages16
ISBN (Print)9789819203772
DOIs
Publication statusPublished - 2026
Externally publishedYes
Event31st International Conference on Database Systems for Advanced Applications, DASFAA 2026 - Jeju, Korea, Republic of
Duration: 27 Apr 202630 Apr 2026

Publication series

NameLecture Notes in Computer Science
Volume16540 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference31st International Conference on Database Systems for Advanced Applications, DASFAA 2026
Country/TerritoryKorea, Republic of
CityJeju
Period27/04/2630/04/26

Keywords

  • Attention
  • Contrastive Learning
  • In-context Learning
  • Relation Extraction

Fingerprint

Dive into the research topics of 'From Implicit Heuristics to Explicit Optimization: A Unified Framework for In-Context Relation Extraction'. Together they form a unique fingerprint.

Cite this