Abstract:On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture ModelsTwin support vector machine (TSVM) is an emerging machine learning model with versatile applicability in classification and regression endeavors. Nevertheless, TSVM confronts noteworthy challenges: $(i)$ the imperative demand for matrix inversions presents formidable obstacles to its efficiency and applicability on large-scale datasets; $(ii)$ the omission of the structural risk minimization (SRM) principle in its primal formulation heightens the vulnerability to overfitting risks; and $(iii)$ the TSVM exhibits a high susceptibility to noise and outliers, and also demonstrates instability when subjected to resampling. In view of the aforementioned challenges, we propose the granular ball twin support vector machine (GBTSVM). GBTSVM takes granular balls, rather than individual data points, as inputs to construct a classifier. These granular balls, characterized by their coarser granularity, exhibit robustness to resampling and reduced susceptibility to the impact of noise and outliers. We further propose a novel large-scale granular ball twin support vector machine (LS-GBTSVM). LS-GBTSVM's optimization formulation ensures two critical facets: $(i)$ it eliminates the need for matrix inversions, streamlining the LS-GBTSVM's computational efficiency, and $(ii)$ it incorporates the SRM principle through the incorporation of regularization terms, effectively addressing the issue of overfitting. The proposed LS-GBTSVM exemplifies efficiency, scalability for large datasets, and robustness against noise and outliers. We conduct a comprehensive evaluation of the GBTSVM and LS-GBTSVM models on benchmark datasets from UCI, KEEL, and NDC datasets. Our experimental findings and statistical analyses affirm the superior generalization prowess of the proposed GBTSVM and LS-GBTSVM models.

Exotic and physics-informed support vector machines for high energy physics

Support Vector Machines in High Energy Physics

Searching for Exotic Particles in High-Energy Physics with Deep Learning

Optimize the event selection strategy to study the anomalous quartic gauge couplings at muon colliders using the support vector machine and quantum support vector machine

High energy nuclear physics meets Machine Learning

Machine learning in the search for new fundamental physics

Exploring QCD matter in extreme conditions with Machine Learning

Advancing Physics Data Analysis through Machine Learning and Physics-Informed Neural Networks

Machine learning and the physical sciences

Application of quantum machine learning using the quantum kernel algorithm on high energy physics analysis at the LHC

Unravelling physics beyond the standard model with classical and quantum anomaly detection

Novel machine learning applications at the LHC

A novel quantum machine learning classifier to search for new physics

Kinematic variables and feature engineering for particle phenomenology

Applications of machine learning in relativistic heavy ion physics

Granular Ball Twin Support Vector Machine

Application of Quantum Machine Learning in a Higgs Physics Study at the CEPC

Machine learning-based jet and event classification at the Electron-Ion Collider with applications to hadron structure and spin physics

A high-bias, low-variance introduction to Machine Learning for physicists

Searches for the BSM scenarios at the LHC using decision tree-based machine learning algorithms: a comparative study and review of random forest, AdaBoost, XGBoost and LightGBM frameworks