Abstract:Numerous classification and regression problems have extensively used Support Vector Machines (SVMs). However, the SVM approach is less practical for large datasets because of its processing cost. This is primarily due to the requirement of optimizing a quadratic programming problem to determine the decision boundary during training. As a result, methods for selecting data instances that have a better likelihood of being chosen as support vectors by the SVM algorithm have been developed to help minimize the bulk of training data. This paper presents a density-based method, called Density-based Border Identification (DBI), in addition to four different variations of the method, for the lessening of the SVM training data through the extraction of a layer of border instances. For higher-dimensional datasets, the extraction is performed on lower-dimensional embeddings obtained by Uniform Manifold Approximation and Projection (UMAP), and the resulting subset can be repetitively used for SVM training in higher dimensions. Experimental findings on different datasets, such as Banana, USPS, and Adult9a, have shown that the best-performing variations of the proposed method effectively reduced the size of the training data and achieved acceptable training and prediction speedups while maintaining an adequate classification accuracy compared to training on the original dataset. These results, as well as comparisons to a selection of related state-of-the-art methods from the literature, such as Border Point extraction based on Locality-Sensitive Hashing (BPLSH), Clustering-Based Convex Hull (CBCH), and Shell Extraction (SE), suggest that our proposed methods are effective and potentially useful.

Large-scale support vector machine classification with redundant data reduction

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Weighted Support Vector Machine for Classification with Uneven Training Class Sizes

A Multi-Class Large Margin Classifier

One Kind of Reduced Learning Algorithm for Support Vector Domain Description

MMSVC: an Efficient Unsupervised Learning Approach for Large-Scale Datasets.

Weighted Support Vector Machine Based Classification Algorithm for Uneven Class Size Problems

An Incremental Updating Method for Support Vector Machines

A New Method of Sample Reduction for Support Vector Classification

Approximate Approach to Train SVM on Very Large Data Sets

Fast SVM training using edge detection on very large datasets

An Online Incremental Learning Support Vector Machine for Large-Scale Data

One-class support vector machines for large-scale data sets

A simple and reliable instance selection for fast training support vector machine: Valid Border Recognition

Learning concepts from large scale imbalanced data sets using support cluster machines.

Distributed Online Semi-Supervised Support Vector Machine

Prescriptive Cluster-Dependent Support Vector Machines with an Application to Reducing Hospital Readmissions

Data reduction for SVM training using density-based border identification

A hybrid method for speeding SVM training

Scaling Up Sparse Support Vector Machines by Simultaneous Feature and Sample Reduction

A Geometric Approach To Train Svm On Very Large Data Sets