Abstract:The classification ability in unseen objects, namely generalization ability, remains a long-standing challenge in rough set-based classifier. Current research mainly focuses on introducing thresholds to tolerate some errors in seen objects. The reason for introducing thresholds and the selection of threshold still lack sufficient theoretical support. The structural risk minimization (SRM) inductive principle is one of the most effective theories to control the generalization ability, which suggests a trade-off between errors in seen objects and complexity. Therefore, this paper introduces the SRM principle into rough set-based classifier and proposes SRM algorithm of rough set-based classifier called SRM-R algorithm. SRM-R algorithm uses the number of rules to characterize the actual complexity of rough set-based classifier and obtains the optimal trade-off between errors in seen objects and complexity through genetic multi-objective optimization. The tenfold cross-validation experiment in 12 UCI datasets shows SRM-R algorithm can significantly improve the generalization ability compared with conventional threshold algorithm. Besides, this paper uses other two possible complexity metrics including the number of attributes and attribute space to construct corresponding SRM algorithms, respectively, and compared their classification accuracy with that of SRM-R algorithm. Comparison result shows SRM-R algorithm obtains optimal classification accuracy. This indicates that the number of rules characterizes the complexity more effectively than the number of attributes and attribute space. Further experiments show that SRM-R algorithm obtains fewer rules and larger support coefficient, which means it extracts stronger rules. This explains why it obtains better generalization ability to some extent.

Rough-set Based Algorithm on Learning Classification Rules of Spatial Objects

Attribute reduction algorithm of rough sets based on spatial optimization

A method for extracting rules from spatial data based on rough fuzzy sets

An Algorithm for Classification Rules Extraction Based on Rough Set Theory

The Rough Set Based Approach for Image Classification

Rough Set Theory Based Object-Oriented Classification of High Resolution Remotely Sensed Imagery

Rule Learning for Classification Based on Neighborhood Covering Reduction

Study of Land Cover Classification Based on Knowledge Rules Using High-Resolution Remote Sensing Images

Text Classification Algorithm Study Based on Rough Set Theory

Geo-rough Space

Research on a Remote Sensing Image Classification Algorithm Based on Decision Table

Rough Set Based Approach to Text Classification

The Dynamic Extraction of Classification Rules for Land Consolidation through Object-oriented Features Space Optimization

An Effective Rough Set-Based Method For Text Classification

Attribute Reduction And Decision Rule Generation Based On Rough Sets

A Multi-level Spatial Association Rules Mining Algorithm Based on Qualitative Spatial Reasoning

Studies on the Application of Rough Set Analysis in Mining of Association Rules and the Realization in Provincial Road Transportation Management Information System

Structural Risk Minimization of Rough Set-Based Classifier

A Kind of Hybrid Classification Algorithm Based on Rough Set and Support Vector Machine

Rough Spatial Interpretation