TY - JOUR
T1 - Recurrent Large Kernel Attention Network for Efficient Single Infrared Image Super-Resolution
AU - Liu, Gangping
AU - Zhou, Shuaijun
AU - Chen, Xiaxu
AU - Yue, Wenjie
AU - Ke, Jun
N1 - Publisher Copyright:
© 2023 The Authors.
PY - 2024
Y1 - 2024
N2 - Infrared imaging has broad and important applications. However, the infrared detector manufacture technique limits the detector resolution and the resolution of infrared images. In this work, we design a Recurrent Large Kernel Attention Neural Network (RLKA-Net) for single infrared image super-resolution(SR), and then demonstrate its superior performance. Compared to other SR networks, RLKA-Net is a lightweight network capable of extracting spatial and temporal features from infrared images. To extract spatial features, we use multiple stacked Recurrent Learning Units (RLUs) to expand the network's receptive field, while the large kernel attention mechanism in RLUs is used to obtain attention maps at various granularity. To extract temporal features, RLKA-Net uses the recurrent learning strategy to keep persistent memory of extracted features, which contribute to more precise reconstruction results. Moreover, RLKA-Net employs an Attention Gate (AG) to reduce the number of parameters and expedite the training process. We demonstrate the efficacy of the Recurrent Learning Stages (RLS), Large Kernel Attention Block (LKAB), and Attention Gate mechanisms through ablation studies. We test RLKA-Net on several infrared image datasets. The experimental results demonstrate that RLKA-Net presents state-of-the-art performance compared to existing SR models. The code and models are available at https://github.com/ZedFm/ RLKA-Net.
AB - Infrared imaging has broad and important applications. However, the infrared detector manufacture technique limits the detector resolution and the resolution of infrared images. In this work, we design a Recurrent Large Kernel Attention Neural Network (RLKA-Net) for single infrared image super-resolution(SR), and then demonstrate its superior performance. Compared to other SR networks, RLKA-Net is a lightweight network capable of extracting spatial and temporal features from infrared images. To extract spatial features, we use multiple stacked Recurrent Learning Units (RLUs) to expand the network's receptive field, while the large kernel attention mechanism in RLUs is used to obtain attention maps at various granularity. To extract temporal features, RLKA-Net uses the recurrent learning strategy to keep persistent memory of extracted features, which contribute to more precise reconstruction results. Moreover, RLKA-Net employs an Attention Gate (AG) to reduce the number of parameters and expedite the training process. We demonstrate the efficacy of the Recurrent Learning Stages (RLS), Large Kernel Attention Block (LKAB), and Attention Gate mechanisms through ablation studies. We test RLKA-Net on several infrared image datasets. The experimental results demonstrate that RLKA-Net presents state-of-the-art performance compared to existing SR models. The code and models are available at https://github.com/ZedFm/ RLKA-Net.
KW - Infrared image super-resolution
KW - attention mechanism
KW - image processing
KW - recurrent neural network
UR - http://www.scopus.com/inward/record.url?scp=85181574882&partnerID=8YFLogxK
U2 - 10.1109/ACCESS.2023.3344830
DO - 10.1109/ACCESS.2023.3344830
M3 - Article
AN - SCOPUS:85181574882
SN - 2169-3536
VL - 12
SP - 923
EP - 935
JO - IEEE Access
JF - IEEE Access
ER -