Abstract:We introduce a novel method for transductive learning on graphs using hyperdimensional representations. The proposed approach encodes data samples using random projections into a very high-dimensional space (hyperdimensional or HD space for short). It obviates the need for expensive iterative training of the sort required by deep learning methods. Specifically, we propose a Hyperdimensional Graph Learning (HDGL) algorithm. HDGL leverages the \emph{injectivity} property of node representations of a family of Graph Neural Networks (GNNs) to map node features to the HD space and then uses HD operators such as bundling and binding to aggregate information from the local neighborhood of each node. The resulting latent node representations support both node classification and link prediction tasks, unlike typical deep learning methods, which often require separate models for these tasks. We report results of experiments using widely used benchmark datasets which demonstrate that, on the node classification task, HDGL is competitive with the SOTA GNN methods with respect to accuracy, at substantially reduced computational cost. Furthermore, HDGL is well-suited for class incremental learning where the model has to learn to effectively discriminate between a growing number of classes. Our experiments also show that the HD representation constructed by HDGL supports link prediction at accuracies comparable to that of DeepWalk and related methods, although it falls short of SOTA Graph Neural Network (GNN) methods that rely on computationally expensive iterative training. We conclude that HDGL offers a computationally efficient alternative to graph neural networks for node classification, especially in settings that call for class-incremental learning or in applications that demand high accuracy models at significantly lower computational cost and learning time than possible with the SOTA GNNs.

HDGN: Heat diffusion graph network for few-shot learning

Edge-labeling based modified gated graph network for few-shot learning

Multi-Head Attention Graph Network for Few Shot Learning

Contrastive Graph Convolution Network With Skip Connections for Few-Shot Hyperspectral Image Classification

Hybrid Graph Neural Networks for Few-Shot Learning

HD-GCN:A Hybrid Diffusion Graph Convolutional Network

Mixture Distribution Graph Network for Few Shot Learning

InfoMax Classification-Enhanced Learnable Network for Few-Shot Node Classification

Heterogeneous Deep Graph Infomax

Learning from Heterogeneity: A Dynamic Learning Framework for Hypergraphs

Hyperdimensional Computing for Node Classification and Link Prediction

Fuzzy Graph Neural Network for Few-Shot Learning

DSR-GCN: Differentiated-Scale Restricted Graph Convolutional Network for Few-Shot Hyperspectral Image Classification

Advancing Graph Neural Networks with HL-HGAT: A Hodge-Laplacian and Attention Mechanism Approach for Heterogeneous Graph-Structured Data

Learning Dual-Pooling Graph Neural Networks for Few-Shot Video Classification

Global Prototypical Network for Few-Shot Hyperspectral Image Classification

Local feature graph neural network for few-shot learning

Generalizing Graph Convolutional Networks Via Heat Kernel

Dynamic Hypergraph Convolution and Recursive Gated Convolution Fusion Network for Hyperspectral Image Classification

Node Embedding from Hamiltonian Information Propagation in Graph Neural Networks

Graph-based few-shot learning with transformed feature propagation and optimal class allocation