Abstract:On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture ModelsTwin support vector machine (TSVM) is an emerging machine learning model with versatile applicability in classification and regression endeavors. Nevertheless, TSVM confronts noteworthy challenges: $(i)$ the imperative demand for matrix inversions presents formidable obstacles to its efficiency and applicability on large-scale datasets; $(ii)$ the omission of the structural risk minimization (SRM) principle in its primal formulation heightens the vulnerability to overfitting risks; and $(iii)$ the TSVM exhibits a high susceptibility to noise and outliers, and also demonstrates instability when subjected to resampling. In view of the aforementioned challenges, we propose the granular ball twin support vector machine (GBTSVM). GBTSVM takes granular balls, rather than individual data points, as inputs to construct a classifier. These granular balls, characterized by their coarser granularity, exhibit robustness to resampling and reduced susceptibility to the impact of noise and outliers. We further propose a novel large-scale granular ball twin support vector machine (LS-GBTSVM). LS-GBTSVM's optimization formulation ensures two critical facets: $(i)$ it eliminates the need for matrix inversions, streamlining the LS-GBTSVM's computational efficiency, and $(ii)$ it incorporates the SRM principle through the incorporation of regularization terms, effectively addressing the issue of overfitting. The proposed LS-GBTSVM exemplifies efficiency, scalability for large datasets, and robustness against noise and outliers. We conduct a comprehensive evaluation of the GBTSVM and LS-GBTSVM models on benchmark datasets from UCI, KEEL, and NDC datasets. Our experimental findings and statistical analyses affirm the superior generalization prowess of the proposed GBTSVM and LS-GBTSVM models.

Insensitive Stochastic Gradient Twin Support Vector Machine for Large Scale Problems

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Weighted Support Vector Machine for Classification with Uneven Training Class Sizes

A new improved support vector machine: QGA-SVM

An Incremental Updating Method for Support Vector Machines

Granular Ball Twin Support Vector Machine

An Online Incremental Learning Support Vector Machine for Large-Scale Data

Twin Support Vector Machines via Fast Generalized Newton Refinement

Large scale semi-supervised linear SVM with stochastic gradient descent

Local and Global Regularized Twin SVM.

Multi-class LSTMSVM Based on Optimal Directed Acyclic Graph and Shuffled Frog Leaping Algorithm

Pegasos: primal estimated sub-gradient solver for SVM

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

Fixed-point Twin Support Vector Machine.

An Effective Multiclass Twin Hypersphere Support Vector Machine and Its Practical Engineering Applications

An Overview on Twin Support Vector Machines

Stochastic gradient support vector machine with local structural information for pattern recognition

Uncertainty-aware twin support vector machines

Weighted Twin Support Vector Machines with Local Information and Its Application.

Twin Support Vector Machines Based on Chaotic Mapping Dung Beetle Optimization Algorithm

Enhanced Feature Based Granular Ball Twin Support Vector Machine