Abstract:To address the imbalanced data problem in classification, the studies of the combination of AdaBoost, short for “Adaptive Boosting,” and cost-sensitive learning have shown convincing results in the literature. The cost-sensitive AdaBoost algorithms are practical since the “boosting” property in AdaBoost can iteratively enhance the small class of the cost-sensitive learning to solve the imbalanced data issue. However, the most available cost-sensitive AdaBoost algorithms are heuristic approaches, which are improved from the standard AdaBoost algorithm by cost-sensitively adjusting the voting weight parameters of weak classifiers or the sample updating weight parameters without strict theoretic proof. The algorithms are appended the cost-sensitive factors to focus on the high-cost and small-class samples, but they have no procedures to show the best place to add the cost factors and the cost factor value set. To complete the cost-sensitive AdaBoost algorithms’ framework, the present article has two main contributions. First, we summarize the popular cost-sensitive boosting algorithms in the literature and propose a generally comprehensive form. We name our specific one, the “AdaImC algorithm,” which is typically appliable to solve the imbalanced data classification problem with theoretic proof. Second, a statistical approach to prove the AdaImC algorithm is proposed to verify the inner relationship between the cost parameters. We show that our proposed algorithm in the machine learning field is identical to the Product of Experts (PoE) model in the statistics field. Besides, a way to determine the cost parameter value by the statistical analysis is introduced. Several numeric studies are listed finally to support our proposed algorithm.

A Comprehensive Study for Asymmetric AdaBoost and Its Application in Object Detection

Fast and Robust Object Detection Using Asymmetric Totally Corrective Boosting

Asymmetric Totally-Corrective Boosting for Real-Time Object Detection

Real-time face detection with self-adaptive cost-sensitive AdaBoost

Z-Adaboost: Boosting 2-thresholded weak classifiers for object detection

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

Face Detection Method Based on Multi-Skin Color Space and AdaBoost Algorithm

A Revised AdaBoost Algorithm——AD AdaBoost

Two-Stage Multi-Class Adaboost for Facial Expression Recognition

Robust Real-Time Face Detection Based on Cost-Sensitive AdaBoost Method

A Statistical Approach to Cost-Sensitive AdaBoost for Imbalanced Data Classification

Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection

Face detection based on controlled-cost sensitive AdaBoost

Shedding Light on the Asymmetric Learning Capability of AdaBoost

Boosting 2-Thresholded Weak Classifiers over Scattered Rectangle Features for Object Detection.

Asymmetric Learning for Pedestrian Detection Based on Joint Local Orientation Histograms

Double-Base Asymmetric AdaBoost

Efficiently Training a Better Visual Detector with Sparse Eigenvectors

A Theoretical Approach To Construct Highly Discriminative Features With Application In Adaboost

Asymmetric Real Adaboost

An AdaBoost-Based Face Detection System Using Parallel Configurable Architecture with Optimized Computation