Skip to main navigation Skip to search Skip to main content

Joint Sparse Representations and Coupled Dictionary Learning in Multisource Heterogeneous Image Pseudo-Color Fusion

  • Long Bai
  • , Shilong Yao
  • , Kun Gao
  • , Yanjun Huang
  • , Ruijie Tang
  • , Hong Yan
  • , Max Q.H. Meng
  • , Hongliang Ren*
  • *Corresponding author for this work
  • Chinese University of Hong Kong
  • Southern University of Science and Technology
  • Beijing Institute of Technology
  • National University of Singapore

Research output: Contribution to journalArticlepeer-review

Abstract

Considering that coupled dictionary learning (CDL) method can obtain a reasonable linear mathematical relationship between resource images, we propose a novel CDL-based synthetic aperture radar (SAR) and multispectral pseudo-color fusion method. First, the traditional Brovey transform is employed as a preprocessing method on the paired SAR and multispectral images. Then, CDL is used to capture the correlation between the preprocessed image pairs based on the dictionaries generated from the source images via enforced joint sparse coding. Afterward, the joint sparse representation in the pair of dictionaries is utilized to construct an image mask via calculating the reconstruction errors and therefore generate the final fusion image. The experimental verification results of the SAR images from the Sentinel-1 satellite and the multispectral images from the Landsat-8 satellite show that the proposed method can achieve superior visual effects and excellent quantitative indicators in terms of spectral distortion, correlation coefficient, mean square error (mse), natural image quality evaluator (NIQE), Blind/Referenceless Image Spatial QUality Evaluator (BRISQUE), and perception-based image quality evaluator (PIQE).

Original languageEnglish
Pages (from-to)30620-30632
Number of pages13
JournalIEEE Sensors Journal
Volume23
Issue number24
DOIs
Publication statusPublished - 15 Dec 2023
Externally publishedYes

Keywords

  • Brovey transform
  • coupled dictionary learning (CDL)
  • multispectral image
  • pseudo-color fusion
  • remote sensing
  • synthetic aperture radar (SAR)

Fingerprint

Dive into the research topics of 'Joint Sparse Representations and Coupled Dictionary Learning in Multisource Heterogeneous Image Pseudo-Color Fusion'. Together they form a unique fingerprint.

Cite this