Abstract:Long short-term memory faces challenges in information mining and parameter selection due to inherent uncertainty and randomness. In this study, we propose a novel hybrid model called ‘STL-ALN_BSA-LSTM’ that aims to tackle this issue. In the proposed model, data is first prepossessed using seasonal-trend decomposition to extract informative features. Next, we propose an adaptive learning and niching-based backtracking search algorithm to enhance the robustness and learning ability of the original backtracking search algorithm, which affords a balance between exploration and exploitation. Subsequently, the weights and thresholds within each LSTM are optimized by our optimization algorithm automatically, leading to improved interpretability and accuracy of the model. Finally, the proposed optimization algorithm was evaluated using five benchmark functions, and the hybrid model was compared with sixteen baselines on two real-world datasets. For rainfall forecasting, the hybrid model achieved the root mean square error of 7.3772, mean absolute error of 2.6187, and R2 of 0.8388. For power generation forecasting, our model outperformed the second-best model by 29.6%, 34.4%, and 16 ‰, respectively, as in the above metrics. These results demonstrate that the proposed hybrid model can attain higher accuracy in real-life applications than previous models, which contributes in-depth insights into parameter optimization for time series forecasting, and provides valuable suggestions in resource planning, risk reduction, and decision-making. The core code of this work can be found from https://github.com/zjuml/STL-ALNBSA-LSTM.

Simplifying Long Short-Term Memory for Fast Training and Time Series Prediction

Simplified Long Short-Term Memory Model for Robust and Fast Prediction

RNN algorithm optimization based on extended unsaturated region

Deep Learning with Long Short-Term Memory for Time Series Prediction

A PLS-based Pruning Algorithm for Simplified Long–short Term Memory Neural Network in Time Series Prediction

Extreme-Long-short Term Memory for Time-series Prediction

Simplified Gating in Long Short-term Memory (LSTM) Recurrent Neural Networks

Fuzzy inference-based LSTM for long-term time series prediction

Time Series Prediction Method Based on Variant LSTM Recurrent Neural Network

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

An Attention Free Long Short-Term Memory for Time Series Forecasting

PT-LSTM: Extending LSTM for Efficient Processing Time Attributes in Time Series Prediction

xLSTMTime : Long-term Time Series Forecasting With xLSTM

ELSTM: An improved long short‐term memory network language model for sequence learning

Learning Sparse Hidden States In Long Short-Term Memory

Generalizable Memory-driven Transformer for Multivariate Long Sequence Time-series Forecasting

Long Short-term Memory Network Prediction Model Based on Fuzzy Time Series

Unlocking the Power of LSTM for Long Term Time Series Forecasting

Multivariate Time Series Forecasting Based on Sliding Attention Correction LSTM Network

Time Series Prediction Based on Temporal Convolutional Network

SALSTM: Segmented Self-Attention Long Short-Term Memory for Long-Term Forecasting