Abstract:In many practical engineering applications, data are usually collected in online pattern. However, if the classes of these data are severely imbalanced, the classification performance will be restricted. In this paper, a novel classification approach is proposed to solve the online data imbalance problem by integrating a fast and efficient learning algorithm, that is, Extreme Learning Machine (ELM), and a typical sampling strategy, that is, the synthetic minority oversampling technique (SMOTE). To reduce the severe imbalance, the granulation division for major-class samples is made according to the samples’ distribution characteristic, and the original samples are replaced by the obtained granule core to prepare a balanced sample set. In online stage, we firstly make granulation division for minor-class and then conduct oversampling using SMOTE in the region around granule core and granule border. Therefore, the training sample set is gradually balanced and the online ELM model is dynamically updated. We also theoretically introduce fuzzy information entropy to prove that the proposed approach has the lower bound of model reliability after undersampling. Numerical experiments are conducted on two different kinds of datasets, and the results demonstrate that the proposed approach outperforms some state-of-the-art methods in terms of the generalization performance and numerical stability.

A Novel Online Learning Algorithm Of Support Vector Machines

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

A Novel Approach to Incremental SVM Learning Algorithm

An On-Line Learning Approach with Support Vector Dormain Classifier

An Incremental Updating Method for Support Vector Machines

A novel online incremental and decremental learning algorithm based on variable support vector machine

Incremental batch learning with support vector machines

On-line Support Vector Machine Training Algorithm and Its Application

A Novel Online Least Squares Svm Based on Smo Algorithm

An Online Incremental Learning Support Vector Machine for Large-Scale Data

Online support vector machines with vectors sieving method

Accurate on-line ν-support vector learning.

The Research and Application of a Learning Algorithm of Batch Increment and Online Which Bases on Support Vector Regression

A New SVM Iterative Algorithm in Large Training Set

Online Kernel Learning with a Near Optimal Sparsity Bound

A Novel SMOTE-Based Classification Approach to Online Data Imbalance Problem

A Novel Parallel Reduced Support Vector Machine

A Parallel SVM Training Algorithm on Large-Scale Classification Problems

Using Novel Support Vector Machines for Efficient Classification

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

A Novel Fast Support Vector Machine Based on Support Vector Geometry Analysis