Abstract:Graph neural network (GNN) provides a powerful expressive way to embed graph-structured data, which has been widely applied and spans many fields. This article found an interesting but unreasonable phenomenon in some classical GNNs, namely label confusion. Theoretically, the dependence between prediction label and ground-truth should gradually increase and tend to converge with training epochs. On the contrary, label confusion shows that the dependence between the predicted label and ground-truth is strong first and then weak. This article explains it from the perspective of feature-noise dependence. Specifically, traditional GNN prediction usually assumes that the ground-truth consists of a mutually independent prediction label (dependent on node features) and noise (independent of node features). However, the propagation aggregation mechanism of GNN will integrate irrelevant information from neighboring nodes into the prediction label, resulting in the prediction label no longer being completely dependent on the node feature, or the noise no longer being completely independent of the node feature. Hence, this article proposes a Label-Dependent GNN to alleviate this problem, called LDGNN. LDGNN mainly consists of two limitations, namely feature-noise (the difference between predicted label and ground-truth) independence, and expectation-variance (EV) separation. Specifically, LDGNN introduces the Hilbert-Schmidt independence criterion (HSIC) as a regularization to minimize the dependence between input features and noise. Note that the main reason for adopting HSIC is that it can measure the nonlinear relationship between any two spatial variables. In this way, HSIC can guide GNN to retain more label-dependence information. Then, LDGNN designs an EV separation to centralize nodes within a class and disperse them between classes to further retain label-dependence information. Through these two strategies, the GNN's expression ability can be enhanced. Next, we theoretically prove the essential reason why LDGNN alleviates label confusion and has been verified in experiments. To verify the performance of LDGNN, we apply it to four classical GNN models on three datasets, and experimental results demonstrate the effectiveness of LDGNN.

Generalized Equivariance and Preferential Labeling for GNN Node Classification

Label-Enhanced Graph Neural Network for Semi-Supervised Node Classification

Leveraging Label Non-Uniformity for Node Classification in Graph Neural Networks

Graph Neural Network with Curriculum Learning for Imbalanced Node Classification

ECGN: A Cluster-Aware Approach to Graph Neural Networks for Imbalanced Classification

Imbalanced Node Classification with Graph Neural Networks: A Unified Approach Leveraging Homophily and Label Information

Label-Dependent Graph Neural Network

Classifying Nodes in Graphs without GNNs

When Do Graph Neural Networks Help with Node Classification: Investigating the Homophily Principle on Node Distinguishability

When Do Graph Neural Networks Help with Node Classification? Investigating the Impact of Homophily Principle on Node Distinguishability

Incorporating Heterophily into Graph Neural Networks for Graph Classification

A gated graph attention network based on dual graph convolution for node embedding

Imbalanced Graph Classification via Graph-of-Graph Neural Networks

A Graph Neural Network-Based Node Classification Model on Class-Imbalanced Graph Data

Graph as a feature: improving node classification with non-neural graph-aware logistic regression

Enhancing Graph Neural Networks Via Auxiliary Training for Semi-Supervised Node Classification.

Learning Graph Neural Networks with Positive and Unlabeled Nodes

Correlation-Aware Graph Convolutional Networks for Multi-Label Node Classification

Self-consistent Graph Neural Networks for Semi-supervised Node Classification

Global-Local Graph Neural Networks for Node-Classification

Label Attentive Distillation for GNN-Based Graph Classification