Abstract:The subset selection of individual prediction methods is gradually becoming a hot topic. Among numerous forecasts, identifying the optimal subset approach has become a major focal point of research. To address this issue, the paper introduces a novel method based on information theory, which is called common mutual information (CMI) selection algorithm. This optimal subset selection method not only simultaneously considers the relationships of three factors, which include the candidate feature set, the selected feature set, and the actual time series, but also provides a more precise treatment of these relationships. Therefore, CMI algorithm employs the mutual information (MI) shared among the three factors as the criterion for selection and improves the accuracy of the redundancy or correlation measure for existing algorithms. Furthermore, it overcomes the deficiency of calculating MI between the candidate subset and the actual time series. Existing algorithms use the average MI values between individual elements within the subset and the actual sequence; this paper takes the selected subset as a multidimensional input for MI computation, thus reducing computational errors. Finally, the proposed algorithm is compared with two other approaches of the MI algorithm, the Max‐Relevance and Min‐Redundancy (mRMR) algorithm in both theoretical and empirical aspects. The experiments are illustrated to show the effectiveness and superiority of CMI algorithm.

An input variables selection method based on k-nearest neighbors mutual information

Joint mutual information-based input variable selection for multivariate time series modeling

Cluster-Based Input Selection for Transparant Fuzzy Modeling

Mutual Information with Parameter Determination Approach for Feature Selection in Multivariate Time Series Prediction.

A Model Population Analysis Method For Variable Selection Based On Mutual Information

Mutual Information Based Feature Selection for Multivariate Time Series Forecasting

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization

Mutual Information-Based Input Variable Selection Method for Runoff-Forecasting Neural Network Model

Improved K nearest neighbor nonparametric regression and its application in short-term traffic flow forecasting

A Transparent and Nonlinear Method for Variable Selection

An Improved Normalized Mutual Information Variable Selection Algorithm for Neural Network-Based Soft Sensors

A Hybrid Approach Variable Selection Algorithm Based on Mutual Information for Data-Driven Industrial Soft-Sensor Applications

An Effective Feature Selection Scheme via Genetic Algorithm Using Mutual Information

Input Feature Selection For Sensor Data Mining Based On Mutual Information

Feature Selection Using Mutual Information: An Experimental Study

Global mutual information-based feature selection approach using single-objective and multi-objective optimization

A Novel Variable Selection Method Based on Binning-Normalized Mutual Information for Multivariate Calibration

Size Adaptive Selection of Most Informative Features

Nearest-Neighbours Estimators for Conditional Mutual Information

Common Mutual Information Selection Algorithm and Its Application on Combination Forecasting

Short-term Traffic Flow Forecasting Based on Feature Selection with Mutual Information