Abstract:Numerous classification and regression problems have extensively used Support Vector Machines (SVMs). However, the SVM approach is less practical for large datasets because of its processing cost. This is primarily due to the requirement of optimizing a quadratic programming problem to determine the decision boundary during training. As a result, methods for selecting data instances that have a better likelihood of being chosen as support vectors by the SVM algorithm have been developed to help minimize the bulk of training data. This paper presents a density-based method, called Density-based Border Identification (DBI), in addition to four different variations of the method, for the lessening of the SVM training data through the extraction of a layer of border instances. For higher-dimensional datasets, the extraction is performed on lower-dimensional embeddings obtained by Uniform Manifold Approximation and Projection (UMAP), and the resulting subset can be repetitively used for SVM training in higher dimensions. Experimental findings on different datasets, such as Banana, USPS, and Adult9a, have shown that the best-performing variations of the proposed method effectively reduced the size of the training data and achieved acceptable training and prediction speedups while maintaining an adequate classification accuracy compared to training on the original dataset. These results, as well as comparisons to a selection of related state-of-the-art methods from the literature, such as Border Point extraction based on Locality-Sensitive Hashing (BPLSH), Clustering-Based Convex Hull (CBCH), and Shell Extraction (SE), suggest that our proposed methods are effective and potentially useful.

Density Estimation Based on Support Vector Machines

Density Estimation Based on Multi-Kernel Support Vector Machines

Support Vector Machine Model of Settlement Prediction of Road Soft Foundation

Weighted Support Vector Machines for Regression and Its Application

State estimation model of water distribution network based on SVM

M-estimator Based Support Vector Machine and Its Application

SVM for Density Estimation and Application to Medical Image Segmentation.

A Weighted Support Vector Machine Method and Its Application

An Approach for Crowd Density and Crowd Size Estimation

Higher-order SVD analysis for crowd density estimation

Conditional Density Estimation with HMM Based Support Vector Machines

Using Support Vector Machines for Mining Regression Classes in Large Data Sets

Density Estimation Based on Mass

Fuzzy Support Vector Machine For Regression Estimation

Approximate Approach to Train SVM on Very Large Data Sets

Data Classification Based on Density Function Estimated by Radial Basis Function

Non-Parametric Estimation Of Svm Probabilistic Outputs And Its Application On Handwritten Digital Recognition

A Method for Mass Estimation of Loose Parts in Nuclear Power Plant Based on Support Vector Machine

Research on the Assessment for Air Environment Quality Based on Support Vector Machine

Data reduction for SVM training using density-based border identification

DBSVEC: Density-Based Clustering Using Support Vector Expansion