跳到主要导航 跳到搜索 跳到主要内容

When Infrared Meets Text: Frequency-Enhanced Alignment with Uncertainty Quantification for Infrared Image-Text Retrieval

  • Beijing Institute of Technology
  • CAS - Institute of Software
  • University of Technology Sydney

科研成果: 期刊稿件文章同行评审

摘要

Infrared imaging extends human perception beyond the visible spectrum, yet it introduces an Infrared Semantic Contradiction (ISC), where physical thermal attributes fundamentally diverge from the descriptive semantics of natural language. This mismatch creates a critical bottleneck for cross-modal retrieval, as conventional models fail to extract discriminative features from infrared imagery due to its inherent semantic sparsity. To bridge this gap, we propose FIRE-UQ, a framework designed to robustly align text with noisy thermal cues. We incorporate a frequency-domain branch to recover structural details typically lost in the spatial domain, and introduce an uncertainty-aware contrastive learning mechanism to dynamically down-weight unreliable correlations. To further reinforce semantic discrimination, we integrate a saliency-guided negative mining strategy that compels the model to distinguish core thermal targets from environmental distractions. Furthermore, we establish the first comprehensive Infrared Image-Text Retrieval (II-TR) Benchmark via multi-source construction strategies. Extensive experiments demonstrate that FIRE-UQ significantly outperforms state-of-the-art baselines by effectively resolving the semantic challenges of the infrared domain.

源语言英语
期刊IEEE Transactions on Multimedia
DOI
出版状态已接受/待刊 - 2026
已对外发布

学术指纹

探究 'When Infrared Meets Text: Frequency-Enhanced Alignment with Uncertainty Quantification for Infrared Image-Text Retrieval' 的科研主题。它们共同构成独一无二的学术指纹。

引用此