Abstract:Semi-supervised network representation learning is becoming a hotspot in graph mining community, which aims to learn low-dimensional vector representations of vertices using partial label information. In particular, graph neural networks integrate structural information and other side information like vertex attributes to learn node representations. Although the existing semi-supervised graph learning performs well on limited labeled data, it is still often hampered when labeled dataset is quite small. To mitigate this issue, we propose PMNRL, a pseudo-multitask learning framework for semi-supervised network representation learning to boost the expression power of graph networks such as vanilla GCN (Graph Convolutional Networks) and GAT (Graph Attention Networks). In PMNRL, by leveraging the community structures in networks, we create a pseudo task that classifies nodes’ community affiliation, and conduct a joint learning of two tasks (i.e., the original task and the pseudo task). Our proposed scheme can take advantage of the inherent connection between structural proximity and label similarity to improve the performance without the need to resort to more labels. The proposed framework is implemented in two ways: two-stage method and end-to-end method. For two-stage method, communities are first detected and then the community affiliations are used as “labels” along with original labels to train the joint model. In end-to-end method, the unsupervised community learning is combined into the representation learning process by shared layers and task-specific layers, so as to encourage the common features and specific features for different tasks at the same time. The experimental results on three real-world benchmark networks demonstrate the performance improvement of the vanilla models using our framework without any additional labels, especially when there are quite few labels.

InfoMLP: Unlocking the Potential of MLPs for Semi-Supervised Learning with Structured Data

Feature Importance Measure of a Multilayer Perceptron Based on the Presingle-Connection Layer

SimMLP: Training MLPs on Graphs without Supervision

Hypergraph-MLP: Learning on Hypergraphs without Message Passing

SA-MLP: Distilling Graph Knowledge from GNNs into Structure-Aware MLP

Learning to Model Graph Structural Information on MLPs via Graph Structure Self-Contrasting

Unveiling the Unseen Potential of Graph Learning through MLPs: Effective Graph Learners Using Propagation-Embracing MLPs

Graph-MLP: Node Classification without Message Passing in Graph

Cluster-aware Multiplex InfoMax for Unsupervised Graph Representation Learning

Beyond Redundancy: Information-aware Unsupervised Multiplex Graph Structure Learning

PathMLP: Smooth path towards high-order homophily

Edge-Splitting MLP: Node Classification on Homophilic and Heterophilic Graphs without Message Passing

Heterogeneous Deep Graph Infomax

Teaching MLPs to Master Heterogeneous Graph-Structured Knowledge for Efficient and Accurate Inference

HGAMLP: Heterogeneous Graph Attention MLP with De-Redundancy Mechanism

Brain-inspired Multilayer Perceptron with Spiking Neurons

Unsupervised Multiplex Graph Learning with Complementary and Consistent Information

AMOSL: Adaptive Modality-wise Structure Learning in Multi-view Graph Neural Networks For Enhanced Unified Representation

Graph Representation Learning Via Graphical Mutual Information Maximization.

Boosting semi-supervised network representation learning with pseudo-multitasking