Abstract:On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture ModelsTwin support vector machine (TSVM) is an emerging machine learning model with versatile applicability in classification and regression endeavors. Nevertheless, TSVM confronts noteworthy challenges: $(i)$ the imperative demand for matrix inversions presents formidable obstacles to its efficiency and applicability on large-scale datasets; $(ii)$ the omission of the structural risk minimization (SRM) principle in its primal formulation heightens the vulnerability to overfitting risks; and $(iii)$ the TSVM exhibits a high susceptibility to noise and outliers, and also demonstrates instability when subjected to resampling. In view of the aforementioned challenges, we propose the granular ball twin support vector machine (GBTSVM). GBTSVM takes granular balls, rather than individual data points, as inputs to construct a classifier. These granular balls, characterized by their coarser granularity, exhibit robustness to resampling and reduced susceptibility to the impact of noise and outliers. We further propose a novel large-scale granular ball twin support vector machine (LS-GBTSVM). LS-GBTSVM's optimization formulation ensures two critical facets: $(i)$ it eliminates the need for matrix inversions, streamlining the LS-GBTSVM's computational efficiency, and $(ii)$ it incorporates the SRM principle through the incorporation of regularization terms, effectively addressing the issue of overfitting. The proposed LS-GBTSVM exemplifies efficiency, scalability for large datasets, and robustness against noise and outliers. We conduct a comprehensive evaluation of the GBTSVM and LS-GBTSVM models on benchmark datasets from UCI, KEEL, and NDC datasets. Our experimental findings and statistical analyses affirm the superior generalization prowess of the proposed GBTSVM and LS-GBTSVM models.

-norm Twin Support Vector Machine-based Regression

Weighted Support Vector Machines for Regression and Its Application

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

Improved 2-norm Based Fuzzy Least Squares Twin Support Vector Machine

Comprehensive Review On Twin Support Vector Machines

Noise model based ν-support vector regression with its application to short-term wind speed forecasting

On Regularization Based Twin Support Vector Regression with Huber Loss

Granular Ball Twin Support Vector Machine

Weighted Twin Support Vector Machines with Local Information and Its Application.

Twin support vector quantile regression

Universal Consistency of Twin Support Vector Machines.

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems

Functional iterative approaches for solving support vector classification problems based on generalized Huber loss

Robust Twin Parametric Margin Support Vector Machine for Multiclass Classification

Kreĭn twin support vector machines for imbalanced data classification

Intuitionistic Fuzzy Weighted Least Squares Twin SVMs

Least squares KNN-based weighted multiclass twin SVM

Elastic Net Nonparallel Hyperplane Support Vector Machine and Its Geometrical Rationality

A Feature Selection Method for Nonparallel Plane Support Vector Machine Classification

A novel fuzzy twin support vector machine based on centered kernel alignment

An Effective Multiclass Twin Hypersphere Support Vector Machine and Its Practical Engineering Applications