Abstract:Mutual information is fundamental for feature selection, and relevant conditional and joint mutual fuzzy granularities (MFGs) characterize feature correlation and redundancy in fuzzy decision systems, respectively. Recently, conditional MFGs have been utilized to generate three-stage heuristic measures, and thus, two feature selection algorithms (called GFMRI-FS and NGFMRI-FS) have emerged. However, these methods emphasize correlation connections but neglect redundancy deletion, thus the approach can be improved. In this paper, a joint MFG with redundant feature information is supplemented to reasonably modify existing heuristic measures, and new three-stage heuristic measures are constructed to obtain two improved selection algorithms (called C-GFMRI-FS and C-NGFMRI-FS). First, the measurement mechanisms of the MFGs are analyzed, and three-stage correctional heuristic measures are established to acquire the dependency semantics, bound combinations, size relationships, theoretical extensions, applied optimization, parametric monotonicity, and systematic algorithms. Then, the three-stage current and correctional heuristic measures obtain granulation monotonicity/certainty and nonmonotonicity/uncertainty, respectively, as well as uncertainty fluctuations on feature-dynamic subset chains. Furthermore, feature selection is investigated by correctional heuristic measures, and two selection algorithms (i.e., C-GFMRI-FS and C-NGFMRI-FS) are designed. Finally, table examples and data experiments validate the uncertainty heuristic measures and feature selection algorithms; accordingly, C-GFMRI-FS and C-NGFMRI-FS outperform GFMRI-FS and NGFMRI-FS and achieve better classification results. This study fuses conditional and joint MFGs to make systematic improvements in heuristic measurements and feature selection, thus facilitating data learning.

PG-HMI: Mutual Information Based Feature Selection Method

PGFB: A hybrid feature selection method based on mutual information

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Feature Selection Method on Imbalanced Text

Feature Selection Algorithm Based On Conditional Dynamic Mutual Information

Higher Order Mutual Information Approximation for Feature Selection

Latest CHORUS and NOMAD results

Mutual Information-Based Unsupervised Feature Transformation for Heterogeneous Feature Subset Selection

Hybrid Mutual Information Based Feature Selection Method As Appied to Static Voltage Stability Assessment in Power Systems

A New Approach for Feature Selection from Microarray Data Based on Mutual Information.

Multi-population differential evolution approach for feature selection with mutual information ranking

Estimating Conditional Mutual Information for Dynamic Feature Selection

Combining similarity measures in content-based image retrieval guided by mutual information

Feature Selection Based on Data Clustering

Hyperspectral Feature Selection Based on Mutual Information and Nonlinear Correlation Coefficient

Feature selection for multi-label classification by maximizing full-dimensional conditional mutual information

Feature selection and threshold method based on fuzzy joint mutual information

Mutual Information Based Feature Selection for Medical Image Retrieval

Feature selection based on self-information and entropy measures for incomplete neighborhood decision systems

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature selection using three-stage heuristic measures based on mutual fuzzy granularities