跳到主要导航 跳到搜索 跳到主要内容

Multimodal Image Registration via Contrastive Learning and Multi-Scale Progressive Deformation Estimation

  • Hengyu Shen*
  • , Jiajing Chen
  • , Zhiqiang Zhou
  • *此作品的通讯作者
  • Beijing Institute of Technology

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Multimodal images can provide richer scene information. However, due to differences in imaging mechanisms, infrared and visible images often exhibit significant modality differences and spatial misalignments, which pose challenges for registration and subsequent fusion tasks. To address this issue, this paper proposes a multimodal image registration method based on contrastive learning and multiscale progressive deformation estimation-CMPE. The method first introduces a Contrastive Learning Module (CLM) to extract cross-modal shared semantic features, significantly reducing the modality gap between infrared and visible images. Subsequently, a multiscale progressive registration framework based on an encoder-decoder structure is designed, and a Global-Local Attention Module (GLAM) is employed at each scale to adaptively select the features, which are then used to predict the deformation field at each scale. The multiscale predicted deformation fields are adaptively weighted and smoothed through a Dynamic Field Fusion Module (DFFM) and vector field integration, ensuring the continuity of the output deformation. Extensive experiments demonstrate that CMPE outperforms existing methods in both qualitative and quantitative evaluations.

源语言英语
主期刊名38th Chinese Control and Decision Conference, CCDC 2026
出版商Institute of Electrical and Electronics Engineers Inc.
2558-2565
页数8
ISBN(电子版)9798331550707
DOI
出版状态已出版 - 2026
已对外发布
活动38th Chinese Control and Decision Conference, CCDC 2026 - Nanjing, 中国
期限: 15 5月 202618 5月 2026

丛书

姓名38th Chinese Control and Decision Conference, CCDC 2026

会议

会议38th Chinese Control and Decision Conference, CCDC 2026
国家/地区中国
Nanjing
时期15/05/2618/05/26

学术指纹

探究 'Multimodal Image Registration via Contrastive Learning and Multi-Scale Progressive Deformation Estimation' 的科研主题。它们共同构成独一无二的学术指纹。

引用此