Abstract:In traditional boosting algorithms, the focus on misclassified training samples emphasizes their importance based on difficulty during the learning process. While using a standard Support Vector Machine (SVM) as a weak learner in an AdaBoost framework can enhance model performance by concentrating on error samples, this approach introduces significant challenges. Specifically, SVMs, characterized by their stability and robustness, may require destabilization to fit the boosting paradigm, which in turn can constrain performance due to reliance on the weighted results from preceding iterations. To address these challenges, we propose the Support Vector Boosting Machine (SVBM), which integrates a novel subsampling process with SVM algorithms and residual connection techniques. This method updates sample weights by considering both the current model's predictions and the outputs from prior rounds, allowing for effective sparsity control. The SVBM framework enhances the ability to form complex decision boundaries, thereby improving classification performance. The MATLAB source code for SVBM can be accessed at <a class="link-external link-https" href="https://github.com/junbolian/SVBM" rel="external noopener nofollow">this https URL</a>.

Research and Application of AdaBoost Algorithm Based on SVM

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

AdaBoost-based Multi-attribute Classification Technology and Its Application

Multi-class AdaBoost ELM

Feature Learning Viewpoint of AdaBoost and a New Algorithm

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

A Regression Algorithm Based on AdaBoost

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

Optimization of the aggregation in AdaBoost algorithm by particle swarm optimization and its application in classification problems

Improved support vector machine for multi-class classification problems

Support Vector Boosting Machine (SVBM): Enhancing Classification Performance with AdaBoost and Residual Connections

Z-Adaboost: Boosting 2-thresholded weak classifiers for object detection

Two-Stage Multi-Class Adaboost for Facial Expression Recognition

Hybrid SVM algorithm oriented to classifying imbalanced datasets

SVM-Boosting based on Markov resampling: Theory and algorithm

A Revised AdaBoost Algorithm——AD AdaBoost

The improved AdaBoost algorithms for imbalanced data classification

Improved SVM algorithm for imbalanced dataset classification

AdaBoost typical Algorithm and its application research

AdaBoost Regression Algorithm Based on Classification-Type Loss

Face Detection Using Adaboosted SVM-Based Component Classifier