CSPDAE: Colorization via SuperPixel Downsampler Denoising AutoEncoder towards enhanced color structural clarity

Wenqu Zhao, Lingxue Wang*, Miao Dong, Yi Cai

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Based on the various structural textures, sizes, and shapes of the gray image, the SuperPixel (SP)-based methods convert the rigid pixels into adaptable image patches that share common features. As a result, the SP-based colorization technique not only enhances the color appearance but also preserves the topological integrity of the images. Despite the effectiveness of neural network-based colorization methods, their integration with SP segmentation has traditionally been complex and cumbersome. To address this issue, we propose the Colorization SP Downsampler Denoising AutoEncoder (CSPDAE), where the SP downsampler integrates SP segmentation directly into the network, eliminating the need for any prior input. The SP downsampler addresses the challenges of computational complexity and small region clustering, which are the main obstacles preventing Transformer architectures from being applied to pixel-level segmentation, through the use of SP cross-attention and aggregated positional embedding (APE). Furthermore, we have incorporated a Color Weight (CW) loss, based on the CIEDE2000 color difference formula, to ensure balanced pixel sampling and to improve the precision of detailed color representation. The experimental results confirm the effectiveness of our method, demonstrating its capacity to produce colors with greater structural accuracy and visually appealing details.

Original languageEnglish
Article number129028
JournalNeurocomputing
Volume618
DOIs
Publication statusPublished - 14 Feb 2025

Keywords

  • CIEDE2000
  • Colorization
  • Deeplearning
  • Superpixel

Fingerprint

Dive into the research topics of 'CSPDAE: Colorization via SuperPixel Downsampler Denoising AutoEncoder towards enhanced color structural clarity'. Together they form a unique fingerprint.

Cite this

Zhao, W., Wang, L., Dong, M., & Cai, Y. (2025). CSPDAE: Colorization via SuperPixel Downsampler Denoising AutoEncoder towards enhanced color structural clarity. Neurocomputing, 618, Article 129028. https://doi.org/10.1016/j.neucom.2024.129028