TY - GEN
T1 - UFFusion
T2 - 2023 China Automation Congress, CAC 2023
AU - Wang, Yuhao
AU - Chen, Weiyi
AU - Miao, Lingjuan
AU - Zhou, Zhiqiang
AU - Qiao, Yajun
AU - Zhang, Lei
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Infrared-visible images have a high information complementarity, making fusing them highly valuable for various applications. However, infrared-visible images also exhibit strong differences, which are crucial factors limiting fusion performance. To address this issue, we propose a unified feature space in which can transfer the infrared domain to the visible domain using the dynamic domain transformation method. This approach eliminates the modality differences and provides high-quality features for image reconstructor. Notably, we propose a dense attention module used to extract common and unique features. The method permits the model to learn the correlation of different layer features, thereby enhancing the model's performance. Moreover, we design a S3IM loss function to enhance dynamic range of fused images. The qualitative and quantitative experiments on publicly available datasets demonstrate the superiority of our UFFusion over the state-of-the-art, in terms of both visual effect and quantitative metrics.
AB - Infrared-visible images have a high information complementarity, making fusing them highly valuable for various applications. However, infrared-visible images also exhibit strong differences, which are crucial factors limiting fusion performance. To address this issue, we propose a unified feature space in which can transfer the infrared domain to the visible domain using the dynamic domain transformation method. This approach eliminates the modality differences and provides high-quality features for image reconstructor. Notably, we propose a dense attention module used to extract common and unique features. The method permits the model to learn the correlation of different layer features, thereby enhancing the model's performance. Moreover, we design a S3IM loss function to enhance dynamic range of fused images. The qualitative and quantitative experiments on publicly available datasets demonstrate the superiority of our UFFusion over the state-of-the-art, in terms of both visual effect and quantitative metrics.
KW - Image fusion
KW - dynamic domain transformation
KW - infrared image
KW - unified feature space
UR - http://www.scopus.com/inward/record.url?scp=85189310551&partnerID=8YFLogxK
U2 - 10.1109/CAC59555.2023.10451013
DO - 10.1109/CAC59555.2023.10451013
M3 - Conference contribution
AN - SCOPUS:85189310551
T3 - Proceedings - 2023 China Automation Congress, CAC 2023
SP - 3200
EP - 3205
BT - Proceedings - 2023 China Automation Congress, CAC 2023
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 17 November 2023 through 19 November 2023
ER -