Skip to main navigation Skip to search Skip to main content

Multimodal Image Registration via Contrastive Learning and Multi-Scale Progressive Deformation Estimation

  • Hengyu Shen*
  • , Jiajing Chen
  • , Zhiqiang Zhou
  • *Corresponding author for this work
  • Beijing Institute of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Multimodal images can provide richer scene information. However, due to differences in imaging mechanisms, infrared and visible images often exhibit significant modality differences and spatial misalignments, which pose challenges for registration and subsequent fusion tasks. To address this issue, this paper proposes a multimodal image registration method based on contrastive learning and multiscale progressive deformation estimation-CMPE. The method first introduces a Contrastive Learning Module (CLM) to extract cross-modal shared semantic features, significantly reducing the modality gap between infrared and visible images. Subsequently, a multiscale progressive registration framework based on an encoder-decoder structure is designed, and a Global-Local Attention Module (GLAM) is employed at each scale to adaptively select the features, which are then used to predict the deformation field at each scale. The multiscale predicted deformation fields are adaptively weighted and smoothed through a Dynamic Field Fusion Module (DFFM) and vector field integration, ensuring the continuity of the output deformation. Extensive experiments demonstrate that CMPE outperforms existing methods in both qualitative and quantitative evaluations.

Original languageEnglish
Title of host publication38th Chinese Control and Decision Conference, CCDC 2026
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2558-2565
Number of pages8
ISBN (Electronic)9798331550707
DOIs
Publication statusPublished - 2026
Externally publishedYes
Event38th Chinese Control and Decision Conference, CCDC 2026 - Nanjing, China
Duration: 15 May 202618 May 2026

Publication series

Name38th Chinese Control and Decision Conference, CCDC 2026

Conference

Conference38th Chinese Control and Decision Conference, CCDC 2026
Country/TerritoryChina
CityNanjing
Period15/05/2618/05/26

Keywords

  • contrastive learning
  • Multimodal image registration
  • progressive deformation estimation

Fingerprint

Dive into the research topics of 'Multimodal Image Registration via Contrastive Learning and Multi-Scale Progressive Deformation Estimation'. Together they form a unique fingerprint.

Cite this