Infrared and Visible Image Fusion Using Detail Enhanced Channel Attention Network

Yinghan Cui, Huiqian Du*, Wenbo Mei

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

12 Citations (Scopus)

Abstract

Fusion of infrared and visible images aims to maintain thermal radiation information and detailed texture information on a single image. Previous deep learning based methods require complex architecture of networks to extract features of both sources. In these methods, convolution filters act equally on each channel so the feature maps containing different brightness and gradient information are treated equally across channels, which reduces the representational ability of networks. In this paper, we innovatively introduce channel-attention mechanism to the fusion network. We propose a detail enhanced channel attention(DECA) block and apply it to the fusion network. DECA block takes into account the average of brightness and gradient information to rescale the feature maps. It allows network selectively emphasize useful features and suppress less useful ones. The proposed fusion network has relatively simple architecture and low operational complexity. This end-to-end network can generate fused images directly from source images. The experimental results on fusion of infrared and visible images demonstrate that our proposed method outperforms the state-of-the-art fusion methods.

Original languageEnglish
Article number8931544
Pages (from-to)182185-182197
Number of pages13
JournalIEEE Access
Volume7
DOIs
Publication statusPublished - 2019

Keywords

  • Channel-wise attention
  • DECA
  • image fusion

Fingerprint

Dive into the research topics of 'Infrared and Visible Image Fusion Using Detail Enhanced Channel Attention Network'. Together they form a unique fingerprint.

Cite this