Abstract:Feature selection is an important technique for data mining. Despite its importance, most studies of feature selection are restricted to batch learning. Unlike traditional batch learning methods, online learning represents a promising family of efficient and scalable machine learning algorithms for large-scale applications. Most existing studies of online learning require accessing all the attributes/features of training instances. Such a classical setting is not always appropriate for real-world applications when data instances are of high dimensionality or it is expensive to acquire the full set of attributes/features. To address this limitation, we investigate the problem of online feature selection (OFS) in which an online learner is only allowed to maintain a classifier involved only a small and fixed number of features. The key challenge of online feature selection is how to make accurate prediction for an instance using a small number of active features. This is in contrast to the classical setup of online learning where all the features can be used for prediction. We attempt to tackle this challenge by studying sparsity regularization and truncation techniques. Specifically, this article addresses two different tasks of online feature selection: 1) learning with full input, where an learner is allowed to access all the features to decide the subset of active features, and 2) learning with partial input, where only a limited number of features is allowed to be accessed for each instance by the learner. We present novel algorithms to solve each of the two problems and give their performance analysis. We evaluate the performance of the proposed algorithms for online feature selection on several public data sets, and demonstrate their applications to real-world problems including image classification in computer vision and microarray gene expression analysis in bioinformatics. The encouraging results of our experiments validate the efficacy and efficiency of the proposed techniques.

A Two-Stage Feature Selection Method with Its Application

Detecting method of foreign fibers in seed cotton using double illumination imaging

A comprehensive unsupervised feature selection method of two-stage strategy

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A Fast Feature Extraction Algorithm for Detection of Foreign Fiber in Lint Cotton Within a Complex Background

TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

Online Group Feature Selection

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization

Online Feature Selection with Group Structure Analysis

Two-step Based Feature Selection Method for Filtering Redundant Information

A Novel Feature-Selection Approach Based on Particle Swarm Optimization Algorithm for Intrusion Detection Systems (Workshop Paper)

Two-Stage Method for Clothing Feature Detection

Feature selection using bare-bones particle swarm optimization with mutual information

Cotton image segmentation method for online foreign fiber inspection

Detection clustering analysis algorithm and system parameters study of the near-point multi-class foreign fiber

Foreign Fiber Detecting System Based on Multispectral Technique

Analysis of progress in research on technology for the detection and removal of foreign fibers

A Multi-Objective Particle Swarm Optimisation for Filter-Based Feature Selection in Classification Problems

Detecting Foreign Fibers in Cotton Using a Multi-Spectral Technique

Online Feature Selection and Its Applications

Progress on Detecting Technique and Sorter of Raw Cotton Foreign Matters