Abstract:Feature selection is very important for pattern recognition to reduce the dimensions of data and to improve the efficiency of learning algorithms. Recent research on new approaches has focused mostly on improving accuracy and reducing computing time. This paper presents a flexible feature-selection method based on an optimized kernel mutual information (OKMI) approach. Mutual information (MI) has been applied successfully in decision trees to rank variables; its aim is to connect class labels with the distribution of experimental data. The use of MI removes irrelevant features and decreases redundant features. However, MI is usually less robust when the data distribution is not centralized. To overcome this problem, we propose to use the OKMI approach, which combines MI and a kernel function. This approach may be used for feature selection with nonlinear models by defining kernels for feature vectors and class-label vectors. By optimizing the objection equations, we develop a new feature-selection algorithm that combines both Ml and kernel learning, we discuss the relationship among various kernel-selection methods. Experiments were conducted to compare the new technique applied to various data sets with other methods, and in each case the OKMI approach performs better than the other methods in terms of feature-classification accuracy and computing time. OKMI method solves the problem of computation complexity in the probability of distribution, and avoids this problem by finding the optimal features at very low computational cost. As a result, the OKMI method with the proposed algorithm is effective and robust over a wide range of real applications on expert systems. Crown Copyright (C) 2018 Published by Elsevier Ltd. All rights reserved.

High-dimensional Supervised Feature Selection Via Optimized Kernel Mutual Information

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Higher Order Mutual Information Approximation for Feature Selection

A Kernel Function Optimization And Selection Algorithm Based On Cost Function Maximization

Feature subset selection for kernel SVM classification via mixed-integer optimization

A New Approach for Feature Selection from Microarray Data Based on Mutual Information.

Mixed-integer linear optimization formulations for feature subset selection in kernel SVM classification

Hyperspectral Feature Selection Based on Mutual Information and Nonlinear Correlation Coefficient

Feature selection for multi-label classification by maximizing full-dimensional conditional mutual information

A new filter feature selection algorithm for classification task by ensembling pearson correlation coefficient and mutual information

Estimating Conditional Mutual Information for Dynamic Feature Selection

Unsupervised Feature Selection via Nonnegative Orthogonal Constrained Regularized Minimization

Dimension Reduction by Mutual Information Feature Extraction

A Recognition Method for Diabetic Retinopathy Based on Feature Selection

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Learning to Maximize Mutual Information for Dynamic Feature Selection

Feature selection and threshold method based on fuzzy joint mutual information

MVMR-FS : Non-parametric feature selection algorithm based on Maximum inter-class Variation and Minimum Redundancy

Mutual Information-Based Unsupervised Feature Transformation for Heterogeneous Feature Subset Selection

Feature selection based on mutual information with correlation coefficient

Feature Selection in a Kernel Space