Abstract:Many high-dimensional practical data sets have hierarchical structures induced by graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional embeddings in other space forms to perform the required learning tasks. For hierarchical data, the space of choice is a hyperbolic space because it guarantees low-distortion embeddings for tree-like structures. The geometry of hyperbolic spaces has properties not encountered in Euclidean spaces that pose challenges when trying to rigorously analyze algorithmic solutions. We propose a unified framework for learning scalable and simple hyperbolic linear classifiers with provable performance guarantees. The gist of our approach is to focus on Poincaré ball models and formulate the classification problems using tangent space formalisms. Our results include a new hyperbolic perceptron algorithm as well as an efficient and highly accurate convex optimization setup for hyperbolic support vector machine classifiers. Furthermore, we adapt our approach to accommodate second-order perceptrons, where data is preprocessed based on second-order information (correlation) to accelerate convergence, and strategic perceptrons, where potentially manipulated data arrives in an online manner and decisions are made sequentially. The excellent performance of the Poincaré second-order and strategic perceptrons shows that the proposed framework can be extended to general machine learning problems in hyperbolic spaces. Our experimental results, pertaining to synthetic, single-cell RNA-seq expression measurements, CIFAR10, Fashion-MNIST and mini-ImageNet, establish that all algorithms provably converge and have complexity comparable to those of their Euclidean counterparts. Accompanying codes can be found at: <a class="link-external link-https" href="https://github.com/thupchnsky/PoincareLinearClassification" rel="external noopener nofollow">this https URL</a>.

Binary classification for imbalanced datasets using twin hyperspheres based on conformal method

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Hyperbolic Binary Neural Network

Support Vector Classification Using Hypersphere

An Effective Multiclass Twin Hypersphere Support Vector Machine and Its Practical Engineering Applications

Kernel-Free Universum Quadratic Surface Twin Support Vector Machines for Imbalanced Data

Homocentric quadratic surfaces and maximum margin approach for imbalanced data classification

Hybrid SVM algorithm oriented to classifying imbalanced datasets

One-Sided Fuzzy SVM Based on Sphere for Imbalanced Data Sets Learning

A Spectral-Texture Kernel-Based Classification Method for Hyperspectral Images.

Hyperspherical Consistency Regularization.

Deep Orthogonal Hypersphere Compression for Anomaly Detection

PFSC: Parameter-free sphere classifier for imbalanced data classification

Horospherical Decision Boundaries for Large Margin Classification in Hyperbolic Space

Progressive Hybrid Classifier Ensemble for Imbalanced Data

Provably Accurate and Scalable Linear Classifiers in Hyperbolic Spaces

Adaptive Fusion Based Method for Imbalanced Data Classification

Spatial-Aware Conformal Prediction for Trustworthy Hyperspectral Image Classification

Optimizing Kernel Transformations to Handle Binary Class Imbalanced Dataset Classification

Self-paced Ensemble for Highly Imbalanced Massive Data Classification

Binary Classification: Counterbalancing Class Imbalance by Applying Regression Models in Combination with One-Sided Label Shifts