TY - JOUR
T1 - SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope image
AU - Gao, Meijing
AU - Bai, Yang
AU - Xie, Yunjia
AU - Zhang, Bozhi
AU - Li, Shiyu
AU - Li, Zhilong
N1 - Publisher Copyright:
© 2024, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.
PY - 2024
Y1 - 2024
N2 - Due to the low spatial resolution of the existing optical micro-scanning thermal microscope imaging system, the acquired micro-scanning infrared images have inferior image quality and low contrast. Deep learning methods, represented by SRGAN, have shown promising results in super-resolution. However, this method still has artifacts, blurriness, low spatial resolution, and slow reconstruction speed. Therefore, we propose the SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope images in this study. Firstly, we enhance the model’s attention to features and improve the details and clarity of the reconstructed images. Removing the BN layer in residual blocks, replacing the ReLU with SMU, and introducing the CBAM to construct the SMC module. Secondly, we incorporate the attention mechanism SEnet into the Bottleneck structure of MobileNetV2. Reducing the channels in the first 1 × 1 convolution layer to 1/4 and creating the SE-MobileNetV2 module. It can enhance the model’s focus on essential features, computational efficiency, and accuracy. Finally, to validate the effectiveness of our method, we compare it with four other super-resolution algorithms on public datasets and images obtained from the optical micro-scanning thermal microscope imaging system. Experimental results indicate that our method improves image clarity, preserving details, and textures. Comprehensively considering super-resolved image quality and time costs, our method is superior to other methods.
AB - Due to the low spatial resolution of the existing optical micro-scanning thermal microscope imaging system, the acquired micro-scanning infrared images have inferior image quality and low contrast. Deep learning methods, represented by SRGAN, have shown promising results in super-resolution. However, this method still has artifacts, blurriness, low spatial resolution, and slow reconstruction speed. Therefore, we propose the SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope images in this study. Firstly, we enhance the model’s attention to features and improve the details and clarity of the reconstructed images. Removing the BN layer in residual blocks, replacing the ReLU with SMU, and introducing the CBAM to construct the SMC module. Secondly, we incorporate the attention mechanism SEnet into the Bottleneck structure of MobileNetV2. Reducing the channels in the first 1 × 1 convolution layer to 1/4 and creating the SE-MobileNetV2 module. It can enhance the model’s focus on essential features, computational efficiency, and accuracy. Finally, to validate the effectiveness of our method, we compare it with four other super-resolution algorithms on public datasets and images obtained from the optical micro-scanning thermal microscope imaging system. Experimental results indicate that our method improves image clarity, preserving details, and textures. Comprehensively considering super-resolved image quality and time costs, our method is superior to other methods.
KW - Deep learning
KW - Generative adversarial network
KW - MobileNet
KW - Optical micro-scanning thermal microscope image
KW - Super-resolution
UR - http://www.scopus.com/inward/record.url?scp=85182864393&partnerID=8YFLogxK
U2 - 10.1007/s00371-023-03247-5
DO - 10.1007/s00371-023-03247-5
M3 - Article
AN - SCOPUS:85182864393
SN - 0178-2789
JO - Visual Computer
JF - Visual Computer
ER -