TY - JOUR
T1 - Towards Compact Single Image Dehazing via Task-related Contrastive Network
AU - Yi, Weichao
AU - Dong, Liquan
AU - Liu, Ming
AU - Hui, Mei
AU - Kong, Lingqin
AU - Zhao, Yuejin
N1 - Publisher Copyright:
© 2023 Elsevier Ltd
PY - 2024/1
Y1 - 2024/1
N2 - Single image dehazing is a challenging vision task that recovers haze-free images from observed hazy images. Recently, numerous learning-based dehazing methods have been proposed and achieved promising performance. However, most of them suffer from a heavy computation burden, and even worse, they cannot leverage negative-orient supervision information well in the training stage. To address the above issues, we propose a novel dehazing method called Task-related Contrastive Network (TC-Net). For a better trade-off between performance and parameters, we design a compact dehazing network based on autoencoder-like architecture. It mainly includes two key modules: the feature enhanced module and the attention fusion module, which can improve the feature representation capability of the network and preserve details information, respectively. More importantly, we propose a task-related contrastive learning framework to fully exploit the negative-orient supervision information. To be specific, we utilize various task-specific data augmentation approaches (e.g., blur, sharpening, color, and light enhancement) to generate informative positive samples and hard negative samples, respectively. Furthermore, we employ an efficient and task-friendly feature embedding network, i.e., the encoder of the dehazing pipeline instead of the pre-trained model, to encode augmented samples into the latent space where negative-orient supervision information can be fully leveraged by contrastive constraint. Extensive experiments demonstrate that our TC-Net can obtain remarkable performance compared with other state-of-the-art dehazing methods, by extreme PSNR gains of 1.75 dB and 0.52 dB, on SOTS and Dense-Haze datasets, respectively.
AB - Single image dehazing is a challenging vision task that recovers haze-free images from observed hazy images. Recently, numerous learning-based dehazing methods have been proposed and achieved promising performance. However, most of them suffer from a heavy computation burden, and even worse, they cannot leverage negative-orient supervision information well in the training stage. To address the above issues, we propose a novel dehazing method called Task-related Contrastive Network (TC-Net). For a better trade-off between performance and parameters, we design a compact dehazing network based on autoencoder-like architecture. It mainly includes two key modules: the feature enhanced module and the attention fusion module, which can improve the feature representation capability of the network and preserve details information, respectively. More importantly, we propose a task-related contrastive learning framework to fully exploit the negative-orient supervision information. To be specific, we utilize various task-specific data augmentation approaches (e.g., blur, sharpening, color, and light enhancement) to generate informative positive samples and hard negative samples, respectively. Furthermore, we employ an efficient and task-friendly feature embedding network, i.e., the encoder of the dehazing pipeline instead of the pre-trained model, to encode augmented samples into the latent space where negative-orient supervision information can be fully leveraged by contrastive constraint. Extensive experiments demonstrate that our TC-Net can obtain remarkable performance compared with other state-of-the-art dehazing methods, by extreme PSNR gains of 1.75 dB and 0.52 dB, on SOTS and Dense-Haze datasets, respectively.
KW - Contrastive learning
KW - Feature embedding
KW - Image dehazing
KW - Neural network
KW - Samples generation
UR - http://www.scopus.com/inward/record.url?scp=85168413634&partnerID=8YFLogxK
U2 - 10.1016/j.eswa.2023.121130
DO - 10.1016/j.eswa.2023.121130
M3 - Article
AN - SCOPUS:85168413634
SN - 0957-4174
VL - 235
JO - Expert Systems with Applications
JF - Expert Systems with Applications
M1 - 121130
ER -