Multilayer time delay reservoir with double feedback loops for time series forecasting task

Meiming You,Fei Li,Jiaqi Xi,Guoqiang Wang,Baoxiang Du
DOI: https://doi.org/10.1016/j.asoc.2023.110179
IF: 8.7
2023-05-01
Applied Soft Computing
Abstract:Time Delay Reservoir (TDR) is a special single-node reservoir to process time dependent signals simply and efficiently. It has good performance on time series forecasting tasks. Meanwhile, the single-node structure can be implemented easily in hardware. In fact, its prediction performance is also limited by its own special structure. In this paper, we experimentally verified the low memory capacity of the single feedback loop and the low utilization of virtual nodes in the single layer structure. Therefore, we propose a multilayer time delay reservoir of the double feedback loops to improve the overall efficiency and performance of the reservoir computing. Firstly, we use the double feedback loops structure which has another feedback loop with longer cycle on the basis of the single feedback loop. In this way, the responses generated earlier will be re-injected into the reservoir to improve the memory capacity. Secondly, the single layer is extended to multiple layers. The utilization of virtual nodes in the reservoir was improved during the training process of the output weights. Finally, the nonlinear function of the original TDR is replaced with a nonlinear function of exponential decay to reduce parameters. The experimental results show that the model proposed has better prediction accuracy and anti-noise performance than that of standard TDR on the time series forecasting task and also has better performance compared with other five models.
computer science, artificial intelligence, interdisciplinary applications
What problem does this paper attempt to address?