GCL-GroW: Graph contrastive learning via group whitening

  • Chunhui Zhang
  • , Rui Miao
  • , Lizhong Ding*
  • , Pengqi Li
  • , Yuhan Guo
  • , Xingcan Li
  • , Ye Yuan
  • , Guoren Wang
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Graph Neural Networks (GNNs) effectively learn from graph structures, but their performance is constrained by scarce labeled data. Graph contrastive learning (GCL) techniques address this limitation through maximizing the mutual information of two views of the input graph, effectively reducing reliance on labeled data. Nevertheless, existing GCL methods face two main drawbacks: the use of negative samples increases training burden, while relying solely on positive samples often compels the introduction of intricate architectures. To overcome these issues, we propose a novel approach called Graph Contrastive Learning via Group Whitening (GCL-GroW), which is the first to apply feature group whitening and consistency loss to address two fundamental goals in GCL: uniformity and alignment. To ensure uniformity, we apply Zero-Phase Component Analysis (ZCA) group whitening to the positive samples, aiming to reduce feature correlations and avoid dimension collapse, in which all sample representations converge to a single point. To achieve alignment, we use the consistency loss among positive samples, as it encourages the model to generate similar representations for these samples, thereby reducing their distance in the feature space. Notably, GCL-GroW delivers these achievements without relying on asymmetric networks, projection layers, gradient halting, or complex loss functions. Extensive experiments demonstrate that GCL-GroW not only achieves competitive accuracy in node and graph classification tasks across multiple datasets, but also reduces training time and memory, validating its superiority over existing state-of-the-art methods. The code is available at: https://github.com/zhangchunhui2024/GCL-GroW.

Original languageEnglish
Article number112757
JournalPattern Recognition
Volume172
DOIs
Publication statusPublished - Apr 2026

Keywords

  • Contrastive learning
  • Graph neural networks
  • Graph representation learning
  • Group whitening

Fingerprint

Dive into the research topics of 'GCL-GroW: Graph contrastive learning via group whitening'. Together they form a unique fingerprint.

Cite this