TY - GEN
T1 - Integration of Multidimensional Features for Infrared Image Enhancement
AU - Yang, Zhidong
AU - Li, Yuzhao
AU - Liu, Zhikun
AU - Zhao, Zilun
AU - Gao, Xiaofeng
AU - Zhang, Ruiheng
N1 - Publisher Copyright:
© 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.
PY - 2023/12/22
Y1 - 2023/12/22
N2 - Due to the characteristics and equipment limitations, infrared images often experience a series of degradations, such as noise and low contrast. Deep learning-based image enhancement methods are both efficient and flexible, often involving a progressive reduction in image size to extract crucial features. However, due to the simplicity of infrared image composition, that's not viable. Compressing the resolution may result in the loss of spatial details, making it hard to recover high-quality images through feature extraction. In this context, we propose a new architecture designed to keep the infrared image size consistent throughout the network, thereby preserving spatial accuracy. Additionally, it integrates complementary contextual information from low-resolution representations. For feature integration, we introduce a self-attention mechanism, aggregating two aspects of features: (1)Multi-scale parallel feature streams, which reflect spatial details at different resolutions; (2)Sooner and subsequent feature streams, which reflect contextual details. Despite the limited information capacity of infrared images, our method can capture rich features, achieving multiple image enhancement while maintaining the original details. Our model sets a new standard in enhancing infrared images, proven by tests on various datasets.
AB - Due to the characteristics and equipment limitations, infrared images often experience a series of degradations, such as noise and low contrast. Deep learning-based image enhancement methods are both efficient and flexible, often involving a progressive reduction in image size to extract crucial features. However, due to the simplicity of infrared image composition, that's not viable. Compressing the resolution may result in the loss of spatial details, making it hard to recover high-quality images through feature extraction. In this context, we propose a new architecture designed to keep the infrared image size consistent throughout the network, thereby preserving spatial accuracy. Additionally, it integrates complementary contextual information from low-resolution representations. For feature integration, we introduce a self-attention mechanism, aggregating two aspects of features: (1)Multi-scale parallel feature streams, which reflect spatial details at different resolutions; (2)Sooner and subsequent feature streams, which reflect contextual details. Despite the limited information capacity of infrared images, our method can capture rich features, achieving multiple image enhancement while maintaining the original details. Our model sets a new standard in enhancing infrared images, proven by tests on various datasets.
KW - Feature Fusion
KW - Image enhancement
KW - Infrared Image
UR - http://www.scopus.com/inward/record.url?scp=85185827694&partnerID=8YFLogxK
U2 - 10.1145/3639631.3639676
DO - 10.1145/3639631.3639676
M3 - Conference contribution
AN - SCOPUS:85185827694
T3 - ACM International Conference Proceeding Series
SP - 267
EP - 272
BT - ACAI 2023 - Conference Program
PB - Association for Computing Machinery
T2 - 6th International Conference on Algorithms, Computing and Artificial Intelligence, ACAI 2023
Y2 - 22 December 2023 through 24 December 2023
ER -