Abstract:The large proportion of irrelevant or noisy features in real-life high-dimensional data presents a significant challenge to subspace/feature selection-based high-dimensional outlier detection (a.k.a. outlier scoring) methods. These methods often perform the two dependent tasks: relevant feature subset search and outlier scoring independently, consequently retaining features/subspaces irrelevant to the scoring method and downgrading the detection performance. This paper introduces a novel sequential ensemble-based framework SEMSE and its instance CINFO to address this issue. SEMSE learns the sequential ensembles to mutually refine feature selection and outlier scoring by iterative sparse modeling with outlier scores as the pseudo target feature. CINFO instantiates SEMSE by using three successive recurrent components to build such sequential ensembles. Given outlier scores output by an existing outlier scoring method on a feature subset, CINFO first defines a Cantelli's inequality-based outlier thresholding function to select outlier candidates with a false positive upper bound. It then performs lasso-based sparse regression by treating the outlier scores as the target feature and the original features as predictors on the outlier candidate set to obtain a feature subset that is tailored for the outlier scoring method. Our experiments show that two different outlier scoring methods enabled by CINFO (i) perform significantly better on 11 real-life high-dimensional data sets, and (ii) have much better resilience to noisy features, compared to their bare versions and three state-of-the-art competitors. The source code of CINFO is available at https://sites.google.com/site/gspangsite/sourcecode.

Nearest Neighbor Ensembles: an Effective Method for Difficult Problems in Streaming Classification with Emerging New Classes.

Classification under Streaming Emerging New Classes: A Solution Using Completely-Random Trees

Semi-Supervised Streaming Learning with Emerging New Labels

Difficult Novel Class Detection in Semisupervised Streaming Data

An Automatic Construction and Organization Strategy for Ensemble Learning on Data Streams

A neural network for uncertain data classification.

Subspace Ensembles for Classification

Streaming Classification with Emerging New Class by Class Matrix Sketching.

SACCOS: A Semi-Supervised Framework for Emerging Class Detection and Concept Drift Adaption Over Data Streams

A Feature Weighted Ensemble Classifier on Stream Data

Social Stream Classification with Emerging New Labels.

Feature Selection For Classifying Data Stream Based On Maximum Entropy

Classification of High-Dimensional Evolving Data Streams Via a Resource-Efficient Online Ensemble

Online ensemble learning algorithm for imbalanced data stream

An ensemble-based online learning algorithm for streaming data

A novel learning method for feature evolvable streams

Streaming Active Deep Forest for Evolving Data Stream Classification

Differentially Private Ensemble Classifiers for Data Streams

Adaptive regularized ensemble for evolving data stream classification

Online Streaming Feature Selection Via Conditional Independence

Sparse Modeling-Based Sequential Ensemble Learning for Effective Outlier Detection in High-Dimensional Numeric Data.