Abstract:Hyperdimensional computing (HDC) is a computational paradigm that leverages the mathematical properties of high-dimensional vector spaces to manipulate data as symbolic entities using a set of neurally plausible operations. Although HDC has demonstrated remarkable success in cognitive tasks, its potential in complex applications such as multi-label classificati has yet to be explored. In this research paper, we introduce three approaches to multi-label classification that strike a balance between computational efficiency and accuracy, based on the complexity of the problem. The first approach we propose is Power Set HD, a transformation method that is ideal for small-scale multi-label classification with label cardinality less than four and label set size less than ten. The second approach, One-vs-All HD, is another transformation method that is suitable for slightly more complex tasks with higher label cardinality, providing a better efficiency-accuracy trade-off over Power Set HD. However, due to the expensive linear complexity scaling of One-vs-All HD, we propose a novel neural approach called TinyXML HD for extreme scale tasks. This method learns hyperdimensional representations by decomposing the learning problem into multiple sub-problems, which are solved neurally through gradient-based optimization. Importantly, TinyXML HD fixes the output size of the model to the dimensionality of the hypervector, regardless of the label size, thereby scaling only by a small constant when evaluated on datasets with extremely large label spaces. Our approaches offer a valuable trade-off between computational efficiency and accuracy. We show that our methods provide a speedup of 16-60x on state of the art datasets, while maintaining comparable accuracy. Furthermore, our methods yield models that are 56x smaller on medium-scale tasks and up to 836x smaller on extreme-scale datasets, which is a significant reduction in model size while still achieving high accuracy.

Efficient Multi-Label Classification with Hypergraph Regularization

Hypergraph Label Propagation Network.

Multi-label remote sensing image classification with deformable convolutions and graph neural networks

Joint Multilabel Classification with Community-Aware Label Graph Learning

Multi-Label Classification With Hyperdimensional Representations

Hierarchical Multilabel Ship Classification in Remote Sensing Images Using Label Relation Graphs

Multi-Label Classification with Label Graph Superimposing

Adaptive hypergraph learning and its application in image classification.

Elastic Net Hypergraph Learning for Image Clustering and Semi-supervised Classification

Learning Graph Convolutional Networks for Multi-Label Recognition and Applications

Multilabel Recognition Algorithm With Multigraph Structure

Hypergraph-enhanced Dual Semi-supervised Graph Classification

Learning Graph Structure For Multi-Label Image Classification Via Clique Generation

Dual projection learning with adaptive graph smoothing for multi-label classification

Vertex-Weighted Hypergraph Learning for Multi-View Object Classification

Efficient multi-class unlabeled constrained semi-supervised SVM.

Multi-label Classification using Labels as Hidden Nodes

HyperMLL: Toward Robust Hyperspectral Image Classification With Multisource Label Learning

Multilabel Classification Based on Graph Neural Networks

Multi-Label Classification With High-Rank and High-Order Label Correlations

Hyperspectral Image Classification with Hypergraph Modelling