New uncertainty measurement for a decision table with application to feature selection
Gangqiang Zhang,Yan Song,Guangji Yu,Zhaowen Li
DOI: https://doi.org/10.1007/s10489-024-05310-7
IF: 5.3
2024-02-23
Applied Intelligence
Abstract:A decision table consists of samples, categorical features, and a decision feature. Uncertainty measurement (UM) can supply new points of view for analyzing data. Thus, it is vital to study the uncertainty of the decision table. Some UMs, such as classification precision, rough membership degree, dependence degree, and attribute importance, cannot accurately measure the uncertainty of a decision table. For example, the dependence degree only considers the information provided by the lower approximation of the decision and ignores the upper approximation, which may lead to some information loss. This paper proposes new UMs in a decision table and gives an application for feature selection. First, new UMs such as conditional information entropy, conditional information quantity, and conditional discriminant index in a decision table are proposed. Then, statistical analysis is used to identify the strengths and weaknesses of the proposed UMs. Next, the UM with the best performance is applied to create a heuristic select feature algorithm in a decision table. Finally, the created algorithm is compared to five other feature selection algorithms, and numerical experiments demonstrate its superior performance.
computer science, artificial intelligence