Abstract:Attribute reduction is an important application of rough sets. Efficiently reducing massive dynamic data sets quickly has always been a major goal of researchers. Traditional incremental methods focus on reduction by updated approximations. However, these methods must evaluate all attributes and repeatedly calculate their importance. When these algorithms are applied to large datasets with high time complexity, reducing large decision systems becomes inefficient. We propose an incremental acceleration strategy based on attribute trees to solve this problem. The key step is to cluster all attributes into multiple trees for incremental attribute evaluation. Specifically, we first select the appropriate attribute tree for attribute evaluation according to the attribute tree correlation measure to reduce the time complexity. Next, the branch coefficient is added to the stop criterion, increasing with the branch depth and guiding a jump out of the loop after reaching the maximum threshold. This avoids redundant calculation and improves efficiency. Furthermore, we propose an algorithm for incremental attribute reduction based on attribute trees using these improvements. Finally, a Spark parallel mechanism is added to parallelize data processing to implement the parallel incremental efficient attribute reduction based on the attribute tree. Experimental results on the Shuttle dataset show that the time consumption of our algorithm is more than 40% lower than that of the classical IARC algorithm while maintaining its good classification performance. In addition, the time is shortened by more than 87% from the benchmark after adding the Spark parallelizing mechanism.

Grouping Attributes: an Accelerator for Attribute Reduction Based on Similarity

Novel algorithm for attribute reduction based on mutual-information gain ratio

Positive approximation: An accelerator for attribute reduction in rough set theory

Unsupervised Attribute Reduction: Improving Effectiveness and Efficiency

An Efficient Accelerator for Attribute Reduction from Incomplete Data in Rough Set Framework

Attribute Reduction Method Based on Sequential Three-Branch Decision Model

A Neighborhood Rough Set Attribute Reduction Method Based on Attribute Importance

Similarity-based Attribute Reduction in Rough Set Theory: a Clustering Perspective

Parallel incremental efficient attribute reduction algorithm based on attribute tree

PARA: A Positive-Region Based Attribute Reduction Accelerator

Improved Attribute Reduction Algorithm Based On Rough Set And Correlation-Based Analysis

Attribute Reduction Algorithm Based on Improved Information Gain Rate and Ant Colony Optimization

An Efficient Attribute Reduction Algorithm Using MapReduce

Consistency Based Attribute Reduction

An Efficient Ant Colony Optimization Approach To Attribute Reduction In Rough Set Theory

Fuzzy Rough Set-Based Attribute Reduction Using Distance Measures

A novel attribute reduction method based on intuitionistic fuzzy three-way cognitive clustering

A Parallel Attribute Reduction Algorithm Based on Affinity Propagation Clustering.

New Heuristic Attribute Reduction Algorithm Based on Rough Set

A Novel Method for Attribute Reduction of Covering Decision Systems

A Rough Set-Based Heuristic Algorithm for Attribute Reduction