Abstract:Variable selection is a procedure to attain the truly important predictors from inputs. Complex nonlinear dependencies and strong coupling pose great challenges for variable selection in high-dimensional data. In addition, real-world applications have increased demands for interpretability of the selection process. A pragmatic approach should not only attain the most predictive covariates, but also provide ample and easy-to-understand grounds for removing certain covariates. In view of these requirements, this paper puts forward an approach for transparent and nonlinear variable selection. In order to transparently decouple information within the input predictors, a three-step heuristic search is designed, via which the input predictors are grouped into four subsets: the relevant to be selected, and the uninformative, redundant, and conditionally independent to be removed. A nonlinear partial correlation coefficient is introduced to better identify the predictors which have nonlinear functional dependence with the response. The proposed method is model-free and the selected subset can be competent input for commonly used predictive models. Experiments demonstrate the superior performance of the proposed method against the state-of-the-art baselines in terms of prediction accuracy and model interpretability.

Hybrid Mean Impact Value with Nonnegative Garrote for Input Variable Selection of Multi-Layer Perceptron

A Hybrid Variable Selection Algorithm for Multi-Layer Perceptron with Nonnegative Garrote and Extremal Optimization

Design of an Adaptive Nonnegative Garrote Algorithm for Multi-Layer Perceptron- Based Soft Sensor

A new variable selection algorithm for LSTM neural network

A Novel Input Variable Selection and Structure Optimization Algorithm for Multilayer Perceptron-Based Soft Sensors

Soft Sensor Development With Nonlinear Variable Selection Using Nonnegative Garrote And Artificial Neural Network

An Adaptive Variable Selection Algorithm for Gated Recurrent Unit Based on Sensitivity Analysis and Nonnegative Garrote

Non-Convex Projected Nlms Algorithm for Adaptive Nonlinear Prediction

Design and Application of a Variable Selection Method for Multilayer Perceptron Neural Network With LASSO.

Development of a variable selection method for soft sensor using artificial neural network and nonnegative garrote

Development of input variable selection and structural optimization algorithm for recurrent neural network

A novel variable selection algorithm for multi-layer perceptron with elastic net.

Performance of Soft Sensors Based on Stochastic Configuration Networks with Nonnegative Garrote

Extending MLP ANN hyper-parameters Optimization by using Genetic Algorithm

A New Feature Selection Algorithm Based on the Mean Impact Variance

Nonlinear MPC Design for Identified Nonlinear Parameter Varying (NPV) Model

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

Support Vector Regression Based Nonlinear Model Reference Adaptive Control

A Fast Hybrid Algorithm Of Global Optimization For Feedforward Neural Networks

A Transparent and Nonlinear Method for Variable Selection

Variable Selection via Adaptive False Negative Control in Linear Regression