Abstract:We first present a feature selection method based on a multilayer perceptron (MLP) neural network, called feature selection MLP (FSMLP). We explain how FSMLP can select essential features and discard derogatory and indifferent features. Such a method may pick up some useful but dependent (say correlated) features, all of which may not be needed. We then propose a general scheme for dealing with feature selection with "controlled redundancy" (CoR). The proposed scheme, named as FSMLP-CoR, can select features with a controlled redundancy both for classification and function approximation/prediction type problems. We have also proposed a new more effective training scheme named mFSMLP-CoR. The idea is general in nature and can be used with other learning schemes also. We demonstrate the effectiveness of the algorithms using several data sets including a synthetic data set. We also show that the selected features are adequate to solve the problem at hand. Here, we have considered a measure of linear dependency to control the redundancy. The use of nonlinear measures of dependency, such as mutual information, is straightforward. Here, there are some advantages of the proposed schemes. They do not require explicit evaluation of the feature subsets. Here, feature selection is integrated into designing of the decision-making system. Hence, it can look at all features together and pick up whatever is necessary. Our methods can account for possible nonlinear subtle interactions between features, as well as that between features, tools, and the problem being solved. They can also control the level of redundancy in the selected features. Of the two learning schemes, mFSMLP-CoR, not only improves the performance of the system, but also significantly reduces the dependency of the network's behavior on the initialization of connection weights.

Group-Feature (Sensor) Selection With Controlled Redundancy Using Neural Networks

Feature Selection Using a Neural Network with Group Lasso Regularization and Controlled Redundancy.

Feature Selection Using a Neural Framework With Controlled Redundancy

Sparse-Input Neural Network using Group Concave Regularization

MISFEAT: Feature Selection for Subgroups with Systematic Missing Data

Supervised Feature Selection via Collaborative Neurodynamic Optimization

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Redundancy-Controlled Feature Selection for Fuzzy Neural Networks

Group Feature Selection Via Structural Sparse Logistic Regression for IDS

Feature selection simultaneously preserving both class and cluster structures

BP Neural Network Feature Selection Based on Group Lasso Regularization

Efficient feature selection using one-pass generalized classifier neural network and binary bat algorithm with a novel fitness function

Feature Selection for Fuzzy Neural Networks Using Group Lasso Regularization

A Novel Approach for Stable Selection of Informative Redundant Features from High Dimensional fMRI Data

Neurodynamics-driven supervised feature selection.

Joint nonlinear feature selection and continuous values regression network

Unsupervised Feature Selection Via Adaptive Autoencoder with Redundancy Control

Consistent Feature Selection for Analytic Deep Neural Networks

A neurodynamic optimization approach to supervised feature selection via fractional programming

Feature Selection Using Double Parallel Feedforward Neural Networks And Particle Swarm Optimization

Neuro-Symbolic Embedding for Short and Effective Feature Selection via Autoregressive Generation