Abstract:Long short-term memory faces challenges in information mining and parameter selection due to inherent uncertainty and randomness. In this study, we propose a novel hybrid model called ‘STL-ALN_BSA-LSTM’ that aims to tackle this issue. In the proposed model, data is first prepossessed using seasonal-trend decomposition to extract informative features. Next, we propose an adaptive learning and niching-based backtracking search algorithm to enhance the robustness and learning ability of the original backtracking search algorithm, which affords a balance between exploration and exploitation. Subsequently, the weights and thresholds within each LSTM are optimized by our optimization algorithm automatically, leading to improved interpretability and accuracy of the model. Finally, the proposed optimization algorithm was evaluated using five benchmark functions, and the hybrid model was compared with sixteen baselines on two real-world datasets. For rainfall forecasting, the hybrid model achieved the root mean square error of 7.3772, mean absolute error of 2.6187, and R2 of 0.8388. For power generation forecasting, our model outperformed the second-best model by 29.6%, 34.4%, and 16 ‰, respectively, as in the above metrics. These results demonstrate that the proposed hybrid model can attain higher accuracy in real-life applications than previous models, which contributes in-depth insights into parameter optimization for time series forecasting, and provides valuable suggestions in resource planning, risk reduction, and decision-making. The core code of this work can be found from https://github.com/zjuml/STL-ALNBSA-LSTM.

A new variable selection algorithm for LSTM neural network

Development of input variable selection and structural optimization algorithm for recurrent neural network

Development of a Novel Variable Selection Algorithm for LSTM with LASSO

Input Variable Selection and Structure Optimization for LSTM-Based Soft Sensor With a Dual Nonnegative Garrote Approach

A Hybrid Variable Selection Algorithm for Multi-Layer Perceptron with Nonnegative Garrote and Extremal Optimization

An Adaptive Variable Selection Algorithm for Gated Recurrent Unit Based on Sensitivity Analysis and Nonnegative Garrote

Hybrid Mean Impact Value with Nonnegative Garrote for Input Variable Selection of Multi-Layer Perceptron

Regularization and variable selection for infinite variance autoregressive models

Soft Sensor Development With Nonlinear Variable Selection Using Nonnegative Garrote And Artificial Neural Network

A Novel Input Variable Selection and Structure Optimization Algorithm for Multilayer Perceptron-Based Soft Sensors

Design of an Adaptive Nonnegative Garrote Algorithm for Multi-Layer Perceptron- Based Soft Sensor

Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

Deep neural networks for variable selection of higher-order nonparametric spatial autoregressive model

Long Short-Term Memory Networks with Multiple Variables for Stock Market Prediction

Design and Application of a Variable Selection Method for Multilayer Perceptron Neural Network With LASSO.

Penalized Generative Variable Selection

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

A Hybrid Spiking Neurons Embedded LSTM Network for Multivariate Time Series Learning under Concept-Drift Environment

Multi-variable LSTM neural network for autoregressive exogenous model

Development of a variable selection method for soft sensor using artificial neural network and nonnegative garrote

A novel variable selection algorithm for multi-layer perceptron with elastic net.