Abstract:This work studies ensemble learning for graph neural networks (GNNs) under the popular semi-supervised setting. Ensemble learning has shown superiority in improving the accuracy and robustness of traditional machine learning by combining the outputs of multiple weak learners. However, adopting a similar idea to integrate different GNN models is challenging because of two reasons. First, GNN is notorious for its poor inference ability, so naively assembling multiple GNN models would deteriorate the inference efficiency. Second, when GNN models are trained with few labeled nodes, their performance are limited. In this case, the vanilla ensemble approach, e.g., majority vote, may be sub-optimal since most base models, i.e., GNNs, may make the wrong predictions. To this end, in this paper, we propose an efficient ensemble learner--E2GNN to assemble multiple GNNs in a learnable way by leveraging both labeled and unlabeled nodes. Specifically, we first pre-train different GNN models on a given data scenario according to the labeled nodes. Next, instead of directly combing their outputs for label inference, we train a simple multi-layer perceptron--MLP model to mimic their predictions on both labeled and unlabeled nodes. Then the unified MLP model is deployed to infer labels for unlabeled or new nodes. Since the predictions of unlabeled nodes from different GNN models may be incorrect, we develop a reinforced discriminator to effectively filter out those wrongly predicted nodes to boost the performance of MLP. By doing this, we suggest a principled approach to tackle the inference issues of GNN ensembles and maintain the merit of ensemble learning: improved performance. Comprehensive experiments over both transductive and inductive settings, across different GNN backbones and 8 benchmark datasets, demonstrate the superiority of E2GNN.

G-MIMO: Empowering GNNs with Diverse Sub-Networks for Graph Classification

E2GNN: Efficient Graph Neural Network Ensembles for Semi-Supervised Classification

Mixed Graph Contrastive Network for Semi-Supervised Node Classification

Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modeling

Ensemble Learning for Graph Neural Networks.

From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness

Imbalanced Graph Classification with Multi-scale Oversampling Graph Neural Networks

Exploiting Neighbor Effect: Conv-Agnostic GNN Framework for Graphs with Heterophily

Mixture of Weak & Strong Experts on Graphs

An End-to-End Multiplex Graph Neural Network for Graph Representation Learning

AM-GCN: Adaptive Multi-channel Graph Convolutional Networks

Graph ensemble neural network

UniGM: Unifying Multiple Pre-trained Graph Models Via Adaptive Knowledge Aggregation

GCNH: A Simple Method For Representation Learning On Heterophilous Graphs

Universal Inceptive GNNs by Eliminating the Smoothness-generalization Dilemma

Mixture of Experts Meets Decoupled Message Passing: Towards General and Adaptive Node Classification

Imbalanced Graph Classification via Graph-of-Graph Neural Networks

GNN-Ensemble: Towards Random Decision Graph Neural Networks

Learning the Network of Graphs for Graph Neural Networks

Multichannel Adaptive Data Mixture Augmentation for Graph Neural Networks