TY - JOUR
T1 - Infrared and visible image fusion based on contrast enhancement guided filter and infrared feature decomposition
AU - Zhang, Bozhi
AU - Gao, Meijing
AU - Chen, Pan
AU - Shang, Yucheng
AU - Li, Shiyu
AU - Bai, Yang
AU - Liao, Hongping
AU - Liu, Zehao
AU - Li, Zhilong
N1 - Publisher Copyright:
© 2022 Elsevier B.V.
PY - 2022/12
Y1 - 2022/12
N2 - Infrared (IR) and visible (VIS) images represent the features of the scene at different wavelengths, and the features they contain have different properties. Therefore, the traditional weighted fusion strategy is challenging to preserve the different types of feature information. In addition, VIS images are highly susceptible to bad weather, which also seriously affects the quality of fused images in complex environments. To solve the above problems, we propose a feature enhancement fusion method. First, a fusion model called contrast enhancement guided filter (CEGF) is proposed. The new model enables the texture information of VIS images to be presented with the intensity of infrared pixels, which solves the problem of combining different attribute features and removes the influence of harsh lighting conditions. To improve the visibility of texture details under different lighting conditions, a contrast modulation factor is added to the cost function design of the filter to enhance the contrast of visible details. Second, we use a dual-scale decomposition strategy to enhance the infrared feature information of the fusion results. Finally, we apply the method of this paper with ten classical image fusion algorithms in two types of datasets. The visual effect and objective evaluation of the fusion results verify that the proposed method preserves the characteristics of the high contrast of IR images and improves the visibility of infrared scenes for subsequent target identification and detection.
AB - Infrared (IR) and visible (VIS) images represent the features of the scene at different wavelengths, and the features they contain have different properties. Therefore, the traditional weighted fusion strategy is challenging to preserve the different types of feature information. In addition, VIS images are highly susceptible to bad weather, which also seriously affects the quality of fused images in complex environments. To solve the above problems, we propose a feature enhancement fusion method. First, a fusion model called contrast enhancement guided filter (CEGF) is proposed. The new model enables the texture information of VIS images to be presented with the intensity of infrared pixels, which solves the problem of combining different attribute features and removes the influence of harsh lighting conditions. To improve the visibility of texture details under different lighting conditions, a contrast modulation factor is added to the cost function design of the filter to enhance the contrast of visible details. Second, we use a dual-scale decomposition strategy to enhance the infrared feature information of the fusion results. Finally, we apply the method of this paper with ten classical image fusion algorithms in two types of datasets. The visual effect and objective evaluation of the fusion results verify that the proposed method preserves the characteristics of the high contrast of IR images and improves the visibility of infrared scenes for subsequent target identification and detection.
KW - Guided filter
KW - Image fusion
KW - Infrared feature decomposition
KW - Infrared image
KW - Visible image
UR - http://www.scopus.com/inward/record.url?scp=85140473793&partnerID=8YFLogxK
U2 - 10.1016/j.infrared.2022.104404
DO - 10.1016/j.infrared.2022.104404
M3 - Article
AN - SCOPUS:85140473793
SN - 1350-4495
VL - 127
JO - Infrared Physics and Technology
JF - Infrared Physics and Technology
M1 - 104404
ER -