Abstract:Numerous classification and regression problems have extensively used Support Vector Machines (SVMs). However, the SVM approach is less practical for large datasets because of its processing cost. This is primarily due to the requirement of optimizing a quadratic programming problem to determine the decision boundary during training. As a result, methods for selecting data instances that have a better likelihood of being chosen as support vectors by the SVM algorithm have been developed to help minimize the bulk of training data. This paper presents a density-based method, called Density-based Border Identification (DBI), in addition to four different variations of the method, for the lessening of the SVM training data through the extraction of a layer of border instances. For higher-dimensional datasets, the extraction is performed on lower-dimensional embeddings obtained by Uniform Manifold Approximation and Projection (UMAP), and the resulting subset can be repetitively used for SVM training in higher dimensions. Experimental findings on different datasets, such as Banana, USPS, and Adult9a, have shown that the best-performing variations of the proposed method effectively reduced the size of the training data and achieved acceptable training and prediction speedups while maintaining an adequate classification accuracy compared to training on the original dataset. These results, as well as comparisons to a selection of related state-of-the-art methods from the literature, such as Border Point extraction based on Locality-Sensitive Hashing (BPLSH), Clustering-Based Convex Hull (CBCH), and Shell Extraction (SE), suggest that our proposed methods are effective and potentially useful.

Increasing the Efficiency of Support Vector Machine by Simplifying the Shape of Separation Hypersurface

An Incremental Updating Method for Support Vector Machines

A hybrid method for speeding SVM training

Simplified support vector machines via kernel-based clustering

Simplified Support Vector Machine Based on Reduced Vector Set Method

A New Method of Sample Reduction for Support Vector Classification

A Geometric Approach To Train Svm On Very Large Data Sets

A Support Vector Machine with a Hybrid Kernel and Minimal Vapnik-Chervonenkis Dimension

A New Method for SVM Hyper-parameters Optimization

Approximate Approach to Train SVM on Very Large Data Sets

A geometrical method to improve performance of the support vector machine.

Improving the Performance of the Support Vector Machine: Two Geometrical Scaling Methods

Fuzzy Support Vector Machine For Regression Estimation

Fast SVM training using edge detection on very large datasets

Scaling the kernel function to improve performance of the support vector machine

Construction methods for H-SVMs

Improvements to Train Support Vector Machines Based on Convex Set Conception

Data reduction for SVM training using density-based border identification

Separating Hypersurfaces of SVMs in Input Spaces.

Scaling Up Sparse Support Vector Machines by Simultaneous Feature and Sample Reduction

Editing Support Vector Machines