跳到主要导航 跳到搜索 跳到主要内容

GCL-GroW: Graph contrastive learning via group whitening

  • Beijing Institute of Technology
  • Jilin University

科研成果: 期刊稿件文章同行评审

摘要

Graph Neural Networks (GNNs) effectively learn from graph structures, but their performance is constrained by scarce labeled data. Graph contrastive learning (GCL) techniques address this limitation through maximizing the mutual information of two views of the input graph, effectively reducing reliance on labeled data. Nevertheless, existing GCL methods face two main drawbacks: the use of negative samples increases training burden, while relying solely on positive samples often compels the introduction of intricate architectures. To overcome these issues, we propose a novel approach called Graph Contrastive Learning via Group Whitening (GCL-GroW), which is the first to apply feature group whitening and consistency loss to address two fundamental goals in GCL: uniformity and alignment. To ensure uniformity, we apply Zero-Phase Component Analysis (ZCA) group whitening to the positive samples, aiming to reduce feature correlations and avoid dimension collapse, in which all sample representations converge to a single point. To achieve alignment, we use the consistency loss among positive samples, as it encourages the model to generate similar representations for these samples, thereby reducing their distance in the feature space. Notably, GCL-GroW delivers these achievements without relying on asymmetric networks, projection layers, gradient halting, or complex loss functions. Extensive experiments demonstrate that GCL-GroW not only achieves competitive accuracy in node and graph classification tasks across multiple datasets, but also reduces training time and memory, validating its superiority over existing state-of-the-art methods. The code is available at: https://github.com/zhangchunhui2024/GCL-GroW.

源语言英语
期刊论文编号112757
期刊Pattern Recognition
172
DOI
出版状态已出版 - 4月 2026

学术指纹

探究 'GCL-GroW: Graph contrastive learning via group whitening' 的科研主题。它们共同构成独一无二的学术指纹。

引用此