摘要
To address the problems of inadequate adaptability and poor visual quality in existing infrared and visible image fusion methods under varying luminance conditions, this paper proposes a fusion method based on Retinex theory. First, the dimension of visible light images is enhanced using an encoder, followed by the decomposition of these images into reflectance and illuminance feature maps, which is consistent with Retinex theory. Second, the reflectance feature is combined with the infrared image feature obtained via the encoder,which enhanced using a structure tensor representation. In addition, convolution kernels with varying sizes are employed to extract multiscale features, which enriches the image’s hierarchical information. Finally, the decoder reduces the feature map’s dimensionality, and a learnable gamma transform layer is introduced to improve the contrast of the fused image. The model’s performance is validated using multiple evaluation metrics on the LLVIP public dataset. The experimental results demonstrate that the proposed method enables adaptive fusion of visible and infrared images under different luminance environments, achieving superior fusion results in terms of both visual perception and quantitative assessment.
| 投稿的翻译标题 | Luminance-Adaptive Infrared and Visible Image Fusion Based on Retinex Theory (Invited) |
|---|---|
| 源语言 | 繁体中文 |
| 期刊论文编号 | 2011011 |
| 期刊 | Laser and Optoelectronics Progress |
| 卷 | 61 |
| 期 | 20 |
| DOI | |
| 出版状态 | 已出版 - 10月 2024 |
关键词
- Retinex theory
- brightness self-adaptation
- human visual characteristic
- image fusion
- learnable gamma transform
学术指纹
探究 '基于 Retinex 理论的亮度自适应红外与可见光图像融合(特邀)' 的科研主题。它们共同构成独一无二的学术指纹。引用此
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver