Abstract:Numerous classification and regression problems have extensively used Support Vector Machines (SVMs). However, the SVM approach is less practical for large datasets because of its processing cost. This is primarily due to the requirement of optimizing a quadratic programming problem to determine the decision boundary during training. As a result, methods for selecting data instances that have a better likelihood of being chosen as support vectors by the SVM algorithm have been developed to help minimize the bulk of training data. This paper presents a density-based method, called Density-based Border Identification (DBI), in addition to four different variations of the method, for the lessening of the SVM training data through the extraction of a layer of border instances. For higher-dimensional datasets, the extraction is performed on lower-dimensional embeddings obtained by Uniform Manifold Approximation and Projection (UMAP), and the resulting subset can be repetitively used for SVM training in higher dimensions. Experimental findings on different datasets, such as Banana, USPS, and Adult9a, have shown that the best-performing variations of the proposed method effectively reduced the size of the training data and achieved acceptable training and prediction speedups while maintaining an adequate classification accuracy compared to training on the original dataset. These results, as well as comparisons to a selection of related state-of-the-art methods from the literature, such as Border Point extraction based on Locality-Sensitive Hashing (BPLSH), Clustering-Based Convex Hull (CBCH), and Shell Extraction (SE), suggest that our proposed methods are effective and potentially useful.

A Fast and Efficient Algorithm for Border Extraction

Fast extraction strategy of support vector machines

Automatic foreground extraction of head shoulder images

A simple and reliable instance selection for fast training support vector machine: Valid Border Recognition

Fast SIFT algorithm based on Sobel edge detector

Accelerating kernel classifiers through borders mapping

Machining Region Boundary Extraction Algorithm Based on Z-map Model

Boundary Extraction Using Supervised Edgelet Classification

A Boundary Method To Speed Up Training Support Vector Machines

New Fast Training Algorithm of Support Vector Machine

A fast region-based image segmentation based on least square method

Efficient Linear Feature Extraction Based on Large Margin Nearest Neighbor.

Data reduction for SVM training using density-based border identification

An algorithm for boundary extraction based on turning row permutation into sequence permutation

Boundary Extraction of Moving Object Based on Spatio-Temporal Information

Fast Text Extraction and Its Application Based on Morphology and Window Features

A Fast Image Segmentation Algorithm Fully Based on Edge Information

Non-iterative Border-Peeling Clustering Algorithm based on Swap Strategy

Border Image Generation Based on Residual Map Vote

An efficient face segmentation algorithm based on binary partition tree

Fast Feature Extraction Method for Faults Detection System