UFFusion: An Unified Feature Space for Infrared-Visible Image Fusion Network Based on Dynamic Domain Transformation

Yuhao Wang, Weiyi Chen*, Lingjuan Miao, Zhiqiang Zhou, Yajun Qiao, Lei Zhang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Infrared-visible images have a high information complementarity, making fusing them highly valuable for various applications. However, infrared-visible images also exhibit strong differences, which are crucial factors limiting fusion performance. To address this issue, we propose a unified feature space in which can transfer the infrared domain to the visible domain using the dynamic domain transformation method. This approach eliminates the modality differences and provides high-quality features for image reconstructor. Notably, we propose a dense attention module used to extract common and unique features. The method permits the model to learn the correlation of different layer features, thereby enhancing the model's performance. Moreover, we design a S3IM loss function to enhance dynamic range of fused images. The qualitative and quantitative experiments on publicly available datasets demonstrate the superiority of our UFFusion over the state-of-the-art, in terms of both visual effect and quantitative metrics.

Original languageEnglish
Title of host publicationProceedings - 2023 China Automation Congress, CAC 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3200-3205
Number of pages6
ISBN (Electronic)9798350303759
DOIs
Publication statusPublished - 2023
Event2023 China Automation Congress, CAC 2023 - Chongqing, China
Duration: 17 Nov 202319 Nov 2023

Publication series

NameProceedings - 2023 China Automation Congress, CAC 2023

Conference

Conference2023 China Automation Congress, CAC 2023
Country/TerritoryChina
CityChongqing
Period17/11/2319/11/23

Keywords

  • Image fusion
  • dynamic domain transformation
  • infrared image
  • unified feature space

Fingerprint

Dive into the research topics of 'UFFusion: An Unified Feature Space for Infrared-Visible Image Fusion Network Based on Dynamic Domain Transformation'. Together they form a unique fingerprint.

Cite this