Abstract:In many practical engineering applications, data are usually collected in online pattern. However, if the classes of these data are severely imbalanced, the classification performance will be restricted. In this paper, a novel classification approach is proposed to solve the online data imbalance problem by integrating a fast and efficient learning algorithm, that is, Extreme Learning Machine (ELM), and a typical sampling strategy, that is, the synthetic minority oversampling technique (SMOTE). To reduce the severe imbalance, the granulation division for major-class samples is made according to the samples’ distribution characteristic, and the original samples are replaced by the obtained granule core to prepare a balanced sample set. In online stage, we firstly make granulation division for minor-class and then conduct oversampling using SMOTE in the region around granule core and granule border. Therefore, the training sample set is gradually balanced and the online ELM model is dynamically updated. We also theoretically introduce fuzzy information entropy to prove that the proposed approach has the lower bound of model reliability after undersampling. Numerical experiments are conducted on two different kinds of datasets, and the results demonstrate that the proposed approach outperforms some state-of-the-art methods in terms of the generalization performance and numerical stability.

The Generalization Ability of SVM Classification Based on Markov Sampling

Generalization Performance of Gaussian Kernels SVMC Based on Markov Sampling.

The Learning Performance of Support Vector Machine Classification Based on Markov Sampling

The Generalization Performance of Regularized Regression Algorithms Based on Markov Sampling

Generalization Capacity of Multi-class SVM Based on Markovian Resampling

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

K-Times Markov Sampling for SVMC

OAA-SVM-MS: A fast and efficient multi-class classification algorithm

M-estimator Based Support Vector Machine and Its Application

An Incremental Updating Method for Support Vector Machines

Incremental batch learning with support vector machines

Learning from uniformly ergodic Markov chains

SVM-Boosting based on Markov resampling: Theory and algorithm

Learning Performance of Weighted Distributed Learning With Support Vector Machines

Generalization Bounds of ERM Algorithm with Markov Chain Samples

Generalization Performance of Least-Square Regularized Regression Algorithm with Markov Chain Samples

On-line Support Vector Machine Training Algorithm and Its Application

A Novel SMOTE-Based Classification Approach to Online Data Imbalance Problem

Generalization Performance Analysis of M-SVMs

Accurate on-line ν-support vector learning.

Generalization Performance of Fisher Linear Discriminant Based on Markov Sampling