A time-delayed physical reservoir with various time constants

Yutaro Yamazaki,Kentaro Kinoshita
DOI: https://doi.org/10.35848/1882-0786/ad2782
IF: 2.819
2024-02-10
Applied Physics Express
Abstract:Physical reservoir computing has been attracting attention in recent years. However, it remains unclear how much nonlinearity is required in the physical dynamics to achieve high computational performance. Therefore, we focused a resistor–capacitor circuit, which exhibit simple transient characteristics, and investigated the performance required for physical reservoir. As a result, the proposed reservoir shows high performance for time series prediction tasks and can be used as a computational resource even without high nonlinearity in the physical dynamics. These results are expected to help establish design guidelines that support the hardware implementation of physical reservoir.
physics, applied
What problem does this paper attempt to address?
The core problem that this paper attempts to solve is: **How to design a physical reservoir computing system that can achieve high - performance time - series prediction tasks without relying on highly nonlinear dynamics?** Specifically, the author focuses on the requirements for nonlinearity and memory capacity in reservoir computing and proposes a parallel resistor - capacitor (RC) circuit reservoir (VTC - PR) with multiple time constants to improve computing performance and the scope of application. ### The main research questions of the paper are decomposed as follows: 1. **Nonlinear requirements in reservoir computing**: - In current reservoir computing research, it is still unclear how much nonlinearity is required in physical dynamics to achieve high - performance computing. - This paper verifies whether high - performance time - series prediction tasks can be achieved through simple RC circuits (exhibiting linear or weakly nonlinear dynamics). 2. **The importance of time - scale diversity**: - The performance of reservoir computing largely depends on its ability to process signals at different time scales. - Traditional single - time - constant reservoirs may not be able to effectively handle multi - scale dynamic tasks (such as the combination of slow and fast dynamics). - This paper proposes a parallel reservoir structure (VTC - PR) with multiple time constants to solve this problem. 3. **The feasibility of hardware implementation**: - Existing physical reservoir computing systems usually rely on complex physical systems (such as photonics, ionic liquids, etc.), which limits the simplicity and cost of hardware implementation. - The VTC - PR proposed in this paper is based on simple RC circuits and aims to provide a simpler and more practical design scheme for the hardware implementation of reservoir computing. ### Specific tasks and goals: The paper verifies the performance of VTC - PR through the following three tasks: 1. **NARMA task**: - Test whether the reservoir can mimic nonlinear dynamic transformation. - The goal is to predict the time - series output of the nonlinear autoregressive moving - average model (NARMA). The NARMA model formula is as follows: $$ y(t)=\sum_{i = 1}^{m}\left[a\cdot y(t - i)+b\cdot u(t - i)\cdot\sum_{j = 1}^{i}y(t - j)\right]+c\cdot u(t - m) $$ 2. **Short - term memory (STM) task**: - Evaluate the memory capacity of the reservoir. - The goal is to delay and reproduce the input time - series \(u(t)\), that is, to predict \(d(t)=u(t - k)\). The memory capacity (MC) formula is as follows: $$ MC_{k}=\frac{\text{Cov}(u(t - k),\hat{y}(t))}{\sqrt{\text{Var}(u(t - k))\cdot\text{Var}(\hat{y}(t))}} $$ 3. **Hindmarsh - Rose (HR) task**: - Test the performance of the reservoir in multi - scale dynamic prediction. - The HR model describes the spike - burst behavior of neuronal membrane potential, including fast and slow dynamics. The HR model formula is as follows: $$ \begin{aligned} \frac{dx}{dt}&=y + a(x^{2}-x^{3})-z + I,\\ \frac{dy}{dt}&=c - dx^{2}-y,\\ \frac{dz}{dt}&=r(s(x - x_{0})-z). \end{aligned} $$ Through these tasks, the paper verifies the performance improvement of VTC - PR in nonlinear time - series prediction, short - term memory, and multi - scale dynamic prediction. ### Summary: The core goal of the paper is to explore a physical reservoir computing system (VTC - PR) based on simple RC circuits to solve the current problems of relying on complex physical systems and highly nonlinear dynamics in reservoir computing. By introducing a parallel structure with multiple time constants, VTC - PR not only achieves high - performance time - series prediction but also expands the time - scale range of processable signals for the reservoir.