TY - JOUR
T1 - Integrating Global Context Contrast and Local Sensitivity for Blind Image Quality Assessment
AU - Li, Xudong
AU - Hu, Runze
AU - Zheng, Jingyuan
AU - Zhang, Yan
AU - Zhang, Shengchuan
AU - Zheng, Xiawu
AU - Li, Ke
AU - Shen, Yunhang
AU - Liu, Yutao
AU - Dai, Pingyang
AU - Ji, Rongrong
N1 - Publisher Copyright:
Copyright 2024 by the author(s)
PY - 2024
Y1 - 2024
N2 - Blind Image Quality Assessment (BIQA) mirrors subjective made by human observers. Generally, humans favor comparing relative qualities over predicting absolute qualities directly. However, current BIQA models focus on mining the “local” context, i.e., the relationship between information among individual images and the absolute quality of the image, ignoring the “global” context of the relative quality contrast among different images in the training data. In this paper, we present the Perceptual Context and Sensitivity BIQA (CSIQA), a novel contrastive learning paradigm that seamlessly integrates “global” and “local” perspectives into the BIQA. Specifically, the CSIQA comprises two primary components: 1) A Quality Context Contrastive Learning module, which is equipped with different contrastive learning strategies to effectively capture potential quality correlations in the global context of the dataset. 2) A Quality-aware Mask Attention Module, which employs the random mask to ensure the consistency with visual local sensitivity, thereby improving the model's perception of local distortions. Extensive experiments on eight standard BIQA datasets demonstrate the superior performance to the state-of-the-art BIQA methods.
AB - Blind Image Quality Assessment (BIQA) mirrors subjective made by human observers. Generally, humans favor comparing relative qualities over predicting absolute qualities directly. However, current BIQA models focus on mining the “local” context, i.e., the relationship between information among individual images and the absolute quality of the image, ignoring the “global” context of the relative quality contrast among different images in the training data. In this paper, we present the Perceptual Context and Sensitivity BIQA (CSIQA), a novel contrastive learning paradigm that seamlessly integrates “global” and “local” perspectives into the BIQA. Specifically, the CSIQA comprises two primary components: 1) A Quality Context Contrastive Learning module, which is equipped with different contrastive learning strategies to effectively capture potential quality correlations in the global context of the dataset. 2) A Quality-aware Mask Attention Module, which employs the random mask to ensure the consistency with visual local sensitivity, thereby improving the model's perception of local distortions. Extensive experiments on eight standard BIQA datasets demonstrate the superior performance to the state-of-the-art BIQA methods.
UR - http://www.scopus.com/inward/record.url?scp=85203807749&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:85203807749
SN - 2640-3498
VL - 235
SP - 27920
EP - 27941
JO - Proceedings of Machine Learning Research
JF - Proceedings of Machine Learning Research
T2 - 41st International Conference on Machine Learning, ICML 2024
Y2 - 21 July 2024 through 27 July 2024
ER -