TY - JOUR
T1 - SISC
T2 - A Feature Interaction-Based Metric for Underwater Image Quality Assessment
AU - Chu, Xiaohui
AU - Hu, Runze
AU - Liu, Yutao
AU - Cao, Jingchao
AU - Xu, Lijun
N1 - Publisher Copyright:
© 1976-2012 IEEE.
PY - 2024/4/1
Y1 - 2024/4/1
N2 - Underwater images are important in a range of image-driven applications, such as marine biology and underwater surveillance. However, underwater imaging is subject to several factors that can severely degrade image quality, i.e., light absorption and scattering within the water column. An effective underwater image quality assessment (UIQA) metric is therefore needed to accurately quantify image quality, subsequently facilitating the follow-up of underwater vision tasks. In this article, we propose a novel feature-interaction-based UIQA framework, namely, SISC, which addresses the challenges of training data scarcity and complex underwater degradation conditions. A feature refinement module is dedicatedly designed based on self-attention to implement local and nonlocal cross-spatial feature interactions. In addition, we enhance the refined features in a cross-scale fashion using upsampling and downsampling strategies based on cross-attention. With the two stages of feature refinement and feature enhancement, the proposed SISC achieves data-efficient learning and superior performance compared to existing state-of-the-art UIQA and natural IQA (images captured in air) methods, indicating its effectiveness in extracting quality-aware features from underwater images.
AB - Underwater images are important in a range of image-driven applications, such as marine biology and underwater surveillance. However, underwater imaging is subject to several factors that can severely degrade image quality, i.e., light absorption and scattering within the water column. An effective underwater image quality assessment (UIQA) metric is therefore needed to accurately quantify image quality, subsequently facilitating the follow-up of underwater vision tasks. In this article, we propose a novel feature-interaction-based UIQA framework, namely, SISC, which addresses the challenges of training data scarcity and complex underwater degradation conditions. A feature refinement module is dedicatedly designed based on self-attention to implement local and nonlocal cross-spatial feature interactions. In addition, we enhance the refined features in a cross-scale fashion using upsampling and downsampling strategies based on cross-attention. With the two stages of feature refinement and feature enhancement, the proposed SISC achieves data-efficient learning and superior performance compared to existing state-of-the-art UIQA and natural IQA (images captured in air) methods, indicating its effectiveness in extracting quality-aware features from underwater images.
KW - Attention mechanism
KW - blind/no-reference (NR)
KW - deep learning
KW - image quality assessment (IQA)
KW - underwater image
UR - http://www.scopus.com/inward/record.url?scp=85181555434&partnerID=8YFLogxK
U2 - 10.1109/JOE.2023.3329202
DO - 10.1109/JOE.2023.3329202
M3 - Article
AN - SCOPUS:85181555434
SN - 0364-9059
VL - 49
SP - 637
EP - 648
JO - IEEE Journal of Oceanic Engineering
JF - IEEE Journal of Oceanic Engineering
IS - 2
ER -