Photonic deep residual time-delay reservoir computing

Changdi Zhou,Yu Huang,Yigong Yang,Deyu Cai,Pei Zhou,Nianqiang Li
DOI: https://doi.org/10.1016/j.neunet.2024.106575
2024-07-27
Abstract:Time-delay reservoir computing (TDRC) represents a simplified variant of recurrent neural networks, employing a nonlinear node with a feedback mechanism to construct virtual nodes. The capabilities of TDRC can be enhanced by transitioning to a deep architecture. In this work, we propose a novel photonic deep residual TDRC (DR-TDRC) with augmented capabilities. The additional time delay added to the residual structure enables DR-TDRC superior to traditional deep structures across various benchmark tasks, especially in memory capability and almost an order of magnitude improvement in nonlinear channel equalization. Additionally, a specifically designed clipping algorithm is utilized to counteract the damage of redundant layers in deep structures, enabling the extension of the deep TDRC to dozens rather than just a few layers, with higher performance. We experimentally demonstrate the proof-of-concept with a 4-layer DR-TDRC containing 960 interrelated neurons (240 neurons per layer), based on four injection-locked distributed feedback lasers. We confirm the potential for scalable deep RC with elevated performance. Our results provide a feasible approach for expanding deep photonic computing to satisfy the boosting demand for artificial intelligence.
What problem does this paper attempt to address?