Abstract:Feature selection is an important topic in data mining and machine learning, which aims to select an optimal feature subset for building effective and explainable prediction models. This article introduces Rough Hypercuboid based Distributed Online Feature Selection (RHDOFS) method to tackle two critical challenges of Volume and Velocity associated with Big Data. By exploring the class separability in the boundary region of rough hypercuboid approach, a novel integrated feature evaluation criterion is proposed by examining not only the explicit patterns contained in the positive region but also the useful implicit patterns derived from the boundary region. An efficient online feature selection method for streaming feature scenario is developed to identify relevant and nonredundant features in an incremental iterative fashion. Furthermore, a parallel optimization mechanism by combining both data and computational independence is further employed to accelerate the original sequential implementation. An efficient distributed online feature selection algorithm is presented and implemented on the Apache Spark platform to scale for massive amount of data by exploiting the computational capabilities of multicore clusters. Encouraging results of extensive experiments indicate the superiority and notable advantages of the proposed algorithm over the relevant and representative online feature selection algorithms. Empirical tests on scalability and extensibility also demonstrate our distributed implementation significantly reduces the computational times requirements while maintaining the prediction accuracy, and is capable of scaling well in volume of data and number of computing nodes.

A NEW DATA STREAM FEATURE SELECTION ALGORITHM BASED ON ATTRIBUTE RELEVANCE

Data Fusion Using Feature Selection Based Causal Network Algorithm

Feature Selection For Classifying Data Stream Based On Maximum Entropy

A Feature Selection Method Using Conditional Correlation Dispersion and Redundancy Analysis

Fair Streaming Feature Selection

Adaptive Sparse Confidence-Weighted Learning for Online Feature Selection.

Hierarchical Online Streaming Feature Selection Based on Adaptive ReliefF

Fairness-Aware Streaming Feature Selection with Causal Graphs

Feature selection method based on conditional relevance

Feature Selection Considering Weighted Relevancy

Causality‐based Online Streaming Feature Selection

Streaming Feature Selection Via Graph Diffusion

Feature Selection Considering the Composition of Feature Relevancy

Feature Selection Based on Streaming Labels Considering the Division of the Selected Feature Set

Clustering-based feature subset selection with analysis on the redundancy–complementarity dimension

Online Scalable Streaming Feature Selection Via Dynamic Decision

RHDOFS: A Distributed Online Algorithm Towards Scalable Streaming Feature Selection

General Assembly Framework for Online Streaming Feature Selection Via Rough Set Models

A New Feature Selection Algorithm Based on Relevance, Redundancy and Complementarity.

Feature Selection with Integrated Relevance and Redundancy Optimization