Abstract:On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture ModelsTwin support vector machine (TSVM) is an emerging machine learning model with versatile applicability in classification and regression endeavors. Nevertheless, TSVM confronts noteworthy challenges: $(i)$ the imperative demand for matrix inversions presents formidable obstacles to its efficiency and applicability on large-scale datasets; $(ii)$ the omission of the structural risk minimization (SRM) principle in its primal formulation heightens the vulnerability to overfitting risks; and $(iii)$ the TSVM exhibits a high susceptibility to noise and outliers, and also demonstrates instability when subjected to resampling. In view of the aforementioned challenges, we propose the granular ball twin support vector machine (GBTSVM). GBTSVM takes granular balls, rather than individual data points, as inputs to construct a classifier. These granular balls, characterized by their coarser granularity, exhibit robustness to resampling and reduced susceptibility to the impact of noise and outliers. We further propose a novel large-scale granular ball twin support vector machine (LS-GBTSVM). LS-GBTSVM's optimization formulation ensures two critical facets: $(i)$ it eliminates the need for matrix inversions, streamlining the LS-GBTSVM's computational efficiency, and $(ii)$ it incorporates the SRM principle through the incorporation of regularization terms, effectively addressing the issue of overfitting. The proposed LS-GBTSVM exemplifies efficiency, scalability for large datasets, and robustness against noise and outliers. We conduct a comprehensive evaluation of the GBTSVM and LS-GBTSVM models on benchmark datasets from UCI, KEEL, and NDC datasets. Our experimental findings and statistical analyses affirm the superior generalization prowess of the proposed GBTSVM and LS-GBTSVM models.

GBSVM: An Efficient and Robust Support Vector Machine Framework via Granular-Ball Computing

GBSVM: Granular-ball Support Vector Machine

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

A new improved support vector machine: QGA-SVM

Enhancing Robustness and Efficiency of Least Square Twin SVM via Granular Computing

Granular-Balls based Fuzzy Twin Support Vector Machine for Classification

Granular Ball Twin Support Vector Machine

Granular Ball Twin Support Vector Machine with Universum Data

Improved support vector machine for multi-class classification problems

A support vector domain classification algorithm with gray information

Enhanced Feature Based Granular Ball Twin Support Vector Machine

GBG++: A Fast and Stable Granular Ball Generation Method for Classification

MMSVC: an Efficient Unsupervised Learning Approach for Large-Scale Datasets.

Granular Ball K-Class Twin Support Vector Classifier

MIC-SVM: Designing a Highly Efficient Support Vector Machine for Advanced Modern Multi-core and Many-Core Architectures

Scaling Support Vector Machines on Modern HPC Platforms

MIC-SVM: A Highly Efficient Support Vector Machine For Modern HPC Architectures

Distributed Online Semi-Supervised Support Vector Machine

Rgtsvm: Support Vector Machines on a GPU in R