TY - JOUR
T1 - Continuous Reliability-Calibrated Alignment for Remote Sensing Image-Text Retrieval
AU - Zhang, Bofan
AU - Liu, Peibing
AU - Wu, Hao
N1 - Publisher Copyright:
© 2026 Informa UK Limited, trading as Taylor & Francis Group.
PY - 2026
Y1 - 2026
N2 - Remote Sensing Image-Text Retrieval (RSITR) is the task of learning a shared representation to measure the semantic similarity between remote sensing (RS) images and their textual descriptions. This technology is critical for applications such as disaster assessment and urban management. However, this task is highly challenging due to the varying degrees of alignment reliability between information-dense RS images and their sparse textual descriptions, ranging from explicit mismatches to weak correspondences, thereby fundamentally limiting model retrieval accuracy and robustness. Mainstream embedding-based methods typically rely on discrete supervision paradigms that fail to handle this continuous spectrum of reliability alignment. To resolve this, we propose the continuous reliability-calibrated alignment (CRCA) framework, which pioneers a reliability-aware learning paradigm. The core of our approach is a new supervision framework featuring two key innovations: reliability-calibration weighting (RCW) module, which assigns continuous weights to each pair, with a confidence-gated triplet fusion (CGTF) loss for stable and discriminative learning. To provide a robust foundation for RCW’s assessment, we first employ attentive token condensation (ATC) to purify features by filtering background noise. Furthermore, to deepen the model’s fine-grained semantic understanding, we introduce a Text-guided visual reconstruction (TVR) auxiliary task that compels the model to learn robust local region–word correspondences. Extensive experiments on the RSICD and RSITMD benchmarks demonstrate that CRCA achieves highly competitive performance, with remarkable mR scores of 38.62% and 50.80%, respectively.
AB - Remote Sensing Image-Text Retrieval (RSITR) is the task of learning a shared representation to measure the semantic similarity between remote sensing (RS) images and their textual descriptions. This technology is critical for applications such as disaster assessment and urban management. However, this task is highly challenging due to the varying degrees of alignment reliability between information-dense RS images and their sparse textual descriptions, ranging from explicit mismatches to weak correspondences, thereby fundamentally limiting model retrieval accuracy and robustness. Mainstream embedding-based methods typically rely on discrete supervision paradigms that fail to handle this continuous spectrum of reliability alignment. To resolve this, we propose the continuous reliability-calibrated alignment (CRCA) framework, which pioneers a reliability-aware learning paradigm. The core of our approach is a new supervision framework featuring two key innovations: reliability-calibration weighting (RCW) module, which assigns continuous weights to each pair, with a confidence-gated triplet fusion (CGTF) loss for stable and discriminative learning. To provide a robust foundation for RCW’s assessment, we first employ attentive token condensation (ATC) to purify features by filtering background noise. Furthermore, to deepen the model’s fine-grained semantic understanding, we introduce a Text-guided visual reconstruction (TVR) auxiliary task that compels the model to learn robust local region–word correspondences. Extensive experiments on the RSICD and RSITMD benchmarks demonstrate that CRCA achieves highly competitive performance, with remarkable mR scores of 38.62% and 50.80%, respectively.
KW - fine-grained representation
KW - masked visual-language modelling
KW - Remote Sensing Image-text Retrieval (RSITR); reliability-aware learning; adaptive sample weighting
UR - https://www.scopus.com/pages/publications/105044063125
U2 - 10.1080/01431161.2026.2691984
DO - 10.1080/01431161.2026.2691984
M3 - Article
AN - SCOPUS:105044063125
SN - 0143-1161
JO - International Journal of Remote Sensing
JF - International Journal of Remote Sensing
ER -