跳到主要导航 跳到搜索 跳到主要内容

Continuous Reliability-Calibrated Alignment for Remote Sensing Image-Text Retrieval

  • Bofan Zhang
  • , Peibing Liu
  • , Hao Wu*
  • *此作品的通讯作者
  • Beijing Institute of Technology

科研成果: 期刊稿件文章同行评审

摘要

Remote Sensing Image-Text Retrieval (RSITR) is the task of learning a shared representation to measure the semantic similarity between remote sensing (RS) images and their textual descriptions. This technology is critical for applications such as disaster assessment and urban management. However, this task is highly challenging due to the varying degrees of alignment reliability between information-dense RS images and their sparse textual descriptions, ranging from explicit mismatches to weak correspondences, thereby fundamentally limiting model retrieval accuracy and robustness. Mainstream embedding-based methods typically rely on discrete supervision paradigms that fail to handle this continuous spectrum of reliability alignment. To resolve this, we propose the continuous reliability-calibrated alignment (CRCA) framework, which pioneers a reliability-aware learning paradigm. The core of our approach is a new supervision framework featuring two key innovations: reliability-calibration weighting (RCW) module, which assigns continuous weights to each pair, with a confidence-gated triplet fusion (CGTF) loss for stable and discriminative learning. To provide a robust foundation for RCW’s assessment, we first employ attentive token condensation (ATC) to purify features by filtering background noise. Furthermore, to deepen the model’s fine-grained semantic understanding, we introduce a Text-guided visual reconstruction (TVR) auxiliary task that compels the model to learn robust local region–word correspondences. Extensive experiments on the RSICD and RSITMD benchmarks demonstrate that CRCA achieves highly competitive performance, with remarkable mR scores of 38.62% and 50.80%, respectively.

源语言英语
期刊International Journal of Remote Sensing
DOI
出版状态已接受/待刊 - 2026
已对外发布

学术指纹

探究 'Continuous Reliability-Calibrated Alignment for Remote Sensing Image-Text Retrieval' 的科研主题。它们共同构成独一无二的学术指纹。

引用此