Abstract:In traditional boosting algorithms, the focus on misclassified training samples emphasizes their importance based on difficulty during the learning process. While using a standard Support Vector Machine (SVM) as a weak learner in an AdaBoost framework can enhance model performance by concentrating on error samples, this approach introduces significant challenges. Specifically, SVMs, characterized by their stability and robustness, may require destabilization to fit the boosting paradigm, which in turn can constrain performance due to reliance on the weighted results from preceding iterations. To address these challenges, we propose the Support Vector Boosting Machine (SVBM), which integrates a novel subsampling process with SVM algorithms and residual connection techniques. This method updates sample weights by considering both the current model's predictions and the outputs from prior rounds, allowing for effective sparsity control. The SVBM framework enhances the ability to form complex decision boundaries, thereby improving classification performance. The MATLAB source code for SVBM can be accessed at <a class="link-external link-https" href="https://github.com/junbolian/SVBM" rel="external noopener nofollow">this https URL</a>.

A Method to Boost Support Vector Machines

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Boosting Support Vector Machines Successfully.

Support Vector Boosting Machine (SVBM): Enhancing Classification Performance with AdaBoost and Residual Connections

A Method to Boost Naïve Bayesian Classifiers

Combined Classification Algorithm Based on Improved AdaBoost and SVM

SVM-Boosting based on Markov resampling: Theory and algorithm

A Hybrid Acceleration Strategy for Nonparallel Support Vector Machine.

An efficient approach to boost support vector data description

Feature combination using boosting

Two Effective Sample Selection Methods for Support Vector Machine

Research and Application of AdaBoost Algorithm Based on SVM

Improved boosting algorithm using combined weak classifiers

Robust Boosting Via Self-Sampling

A New Method to Construct Reduced Vector Sets for Simplifying Support Vector Machines

A Boosting SVM Chain Learning for Visual Information Retrieval

LOCAL MODELS—THE KEY TO BOOSTING STABLE LEARNERS SUCCESSFULLY

Surrogate-Based Support Vector Machine Method

A Confident Majority Voting Strategy for Parallel and Modular Support Vector Machines

Feature Learning Viewpoint of AdaBoost and a New Algorithm

A hybrid method for speeding SVM training