Abstract:Feature selection is very important for pattern recognition to reduce the dimensions of data and to improve the efficiency of learning algorithms. Recent research on new approaches has focused mostly on improving accuracy and reducing computing time. This paper presents a flexible feature-selection method based on an optimized kernel mutual information (OKMI) approach. Mutual information (MI) has been applied successfully in decision trees to rank variables; its aim is to connect class labels with the distribution of experimental data. The use of MI removes irrelevant features and decreases redundant features. However, MI is usually less robust when the data distribution is not centralized. To overcome this problem, we propose to use the OKMI approach, which combines MI and a kernel function. This approach may be used for feature selection with nonlinear models by defining kernels for feature vectors and class-label vectors. By optimizing the objection equations, we develop a new feature-selection algorithm that combines both Ml and kernel learning, we discuss the relationship among various kernel-selection methods. Experiments were conducted to compare the new technique applied to various data sets with other methods, and in each case the OKMI approach performs better than the other methods in terms of feature-classification accuracy and computing time. OKMI method solves the problem of computation complexity in the probability of distribution, and avoids this problem by finding the optimal features at very low computational cost. As a result, the OKMI method with the proposed algorithm is effective and robust over a wide range of real applications on expert systems. Crown Copyright (C) 2018 Published by Elsevier Ltd. All rights reserved.

Feature selection based on Mutual Information in supervised learning

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Feature Selection Based on Data Clustering

Feature Selection Using Mutual Information: An Experimental Study

Higher Order Mutual Information Approximation for Feature Selection

Feature Selection With Dynamic Mutual Information

Feature Selection by Maximizing Part Mutual Information

Mutual Information Criteria for Feature Selection

Class-specific Mutual Information Variation for Feature Selection.

Mutual Information Based Feature Selection for Medical Image Retrieval

High-dimensional Supervised Feature Selection Via Optimized Kernel Mutual Information

Input Feature Selection For Sensor Data Mining Based On Mutual Information

Latest CHORUS and NOMAD results

Mutual Information Multinomial Estimation

Feature selection for multi-label classification by maximizing full-dimensional conditional mutual information

A Filter Approach to Feature Selection Based on Mutual Information

A Fast Feature Selection Method Based on Mutual Information in Multi-label Learning.

Dimension Reduction by Mutual Information Feature Extraction

A New Approach for Feature Selection from Microarray Data Based on Mutual Information.

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization

Mic_fs : A Novel Model For Feature Selection By Mutual Information Guided By Clustering