Abstract:Attribute reduction is an important application of rough sets. Efficiently reducing massive dynamic data sets quickly has always been a major goal of researchers. Traditional incremental methods focus on reduction by updated approximations. However, these methods must evaluate all attributes and repeatedly calculate their importance. When these algorithms are applied to large datasets with high time complexity, reducing large decision systems becomes inefficient. We propose an incremental acceleration strategy based on attribute trees to solve this problem. The key step is to cluster all attributes into multiple trees for incremental attribute evaluation. Specifically, we first select the appropriate attribute tree for attribute evaluation according to the attribute tree correlation measure to reduce the time complexity. Next, the branch coefficient is added to the stop criterion, increasing with the branch depth and guiding a jump out of the loop after reaching the maximum threshold. This avoids redundant calculation and improves efficiency. Furthermore, we propose an algorithm for incremental attribute reduction based on attribute trees using these improvements. Finally, a Spark parallel mechanism is added to parallelize data processing to implement the parallel incremental efficient attribute reduction based on the attribute tree. Experimental results on the Shuttle dataset show that the time consumption of our algorithm is more than 40% lower than that of the classical IARC algorithm while maintaining its good classification performance. In addition, the time is shortened by more than 87% from the benchmark after adding the Spark parallelizing mechanism.

Research about Decision Tree Algorithm Based on Attribute Reduction Technology

Rough set based decision tree

The Rule-Matching Algorithm of Decision Tree Attribute Reduction

Novel algorithm for attribute reduction based on mutual-information gain ratio

Analysis of decision tree classification algorithm based on attribute reduction and application in criminal behavior

The Method of Attribute Reduction Based on Decision Tree

Summary of Decision Tree Algorithm and Its Application in Attribute Reduction

Heuristic Mode Research and Application of Decision Tree Algorithm

Parallel incremental efficient attribute reduction algorithm based on attribute tree

A Rule Extraction Algorithm Based On Attribute Importance

Heuristic Mode Research Of Decision Tree Algorithm Based On Synthesizing Effect

Unsupervised Attribute Reduction: Improving Effectiveness and Efficiency

Heuristic Model Research on Decision Tree Algorithm

A Heuristic Algorithm of Attribute Reduction for Decision Table Based on Discernibility Matrix

New Algorithm for Attribute Reduction Based on Intrusion Detection

A cost sensitive decision tree algorithm with two adaptive mechanisms

An improved decision tree algorithm based on boundary mixed attribute dependency

Heuristic Model and Application of Decision Tree Based on Quasi-Linear Criterion

MINIMUM ATTRIBUTE CO-REDUCTION ALGORITHM BASED ON MULTILEVEL EVOLUTIONARY TREE WITH SELF-ADAPTIVE SUBPOPULATIONS

A new approach for attribute reduction from decision table based on intuitionistic fuzzy topology

Rough Set Based Related Affect Attribute Reduction Algorithm