Abstract:Long short-term memory faces challenges in information mining and parameter selection due to inherent uncertainty and randomness. In this study, we propose a novel hybrid model called ‘STL-ALN_BSA-LSTM’ that aims to tackle this issue. In the proposed model, data is first prepossessed using seasonal-trend decomposition to extract informative features. Next, we propose an adaptive learning and niching-based backtracking search algorithm to enhance the robustness and learning ability of the original backtracking search algorithm, which affords a balance between exploration and exploitation. Subsequently, the weights and thresholds within each LSTM are optimized by our optimization algorithm automatically, leading to improved interpretability and accuracy of the model. Finally, the proposed optimization algorithm was evaluated using five benchmark functions, and the hybrid model was compared with sixteen baselines on two real-world datasets. For rainfall forecasting, the hybrid model achieved the root mean square error of 7.3772, mean absolute error of 2.6187, and R2 of 0.8388. For power generation forecasting, our model outperformed the second-best model by 29.6%, 34.4%, and 16 ‰, respectively, as in the above metrics. These results demonstrate that the proposed hybrid model can attain higher accuracy in real-life applications than previous models, which contributes in-depth insights into parameter optimization for time series forecasting, and provides valuable suggestions in resource planning, risk reduction, and decision-making. The core code of this work can be found from https://github.com/zjuml/STL-ALNBSA-LSTM.

Segmental online support vector regression algorithm

On-line support vector regression with multiple samples

A novel piecewise linear segmentation for time series

A Study of Modelling Non-Stationary Time Series Using Support Vector Machines with Fuzzy Segmentation Information

Parameter choosing method of support vector regression for time series prediction

An On-Line Learning Approach with Support Vector Dormain Classifier

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

An updating method for support vector learning

A Multi-SVR Based Fuzzy Modeling Method for Non-Stationary Time Series

Segmental semi-markov model based online series pattern detection under arbitrary time scaling

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Modeling and Prediction Based on Recursive Least Square Support Vector Regression

An Advanced Segmental Semi-Markov Model Based Online Series Pattern Detection

Local least squares support vector regression with application to online modeling for batch processes

Research on Long Short-Term Decision-Making System for Excavator Market Demand Forecasting Based on Improved Support Vector Machine

Application of Support Vector Regression and Time Series Method in Short-term Power Load Forecasting with Regional Difference

Research on Multi-Step Prediction of Wind Speed Time Series Based on Parallel Support Vector Regression

Short-Term Load Forecasting Based On Support Vector Machine

Online Series Pattern Detection Based on Advanced Segmental Semi-Markov Model

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

Application of online multitask learning based on least squares support vector regression in the financial market