Bioinspired In‐Sensor Reservoir Computing for Self‐Adaptive Visual Recognition with Two‐Dimensional Dual‐Mode Phototransistors

Najia Jiang,Jian Tang,Woyu Zhang,Yi Li,Na Li,Xiuzhen Li,Xi Chen,Renrui Fang,Zeyu Guo,Fei Wang,Jun Wang,Zhi Li,Congli He,Guangyu Zhang,Zhongrui Wang,Dashan Shang
DOI: https://doi.org/10.1002/adom.202300271
IF: 9
2023-06-09
Advanced Optical Materials
Abstract:A MoS2‐based phototransistor with feature intensity‐dependent, gate‐tunable, and time‐varying photoresponse is introduced to implement a self‐adaptive optoelectronic reservoir computing (RC) system for real‐time dynamic image recognition. Through gate‐controlled visual adaptation, the system maintains a high recognition accuracy on the sequential task under complex illumination conditions. These results provide insight into phototransistor‐based efficient and low‐cost neuromorphic edge computing systems. Artificial visual systems that dynamically process spatiotemporal optoelectronic signals under complex real‐life environments bear a wide spectrum of edge applications. Despite significant progress in optoelectronic sensors and neuromorphic computing algorithms, developing visual systems that can adapt to a broad illumination range while retaining high performance, high efficiency, and low training costs remains a challenge. Here, this work reports a bioinspired in‐sensor reservoir computing (RC) for self‐adaptive visual recognition. By leveraging voltage‐tunable photoresponses of the MoS2‐based phototransistor array, the RC system demonstrates both scotopic and photopic adaptation functions and maintains a recognition accuracy of 91%. The horizontal modulation (HM) block enables the reservoir to adapt automatically in real‐time under changing illumination conditions, yielding a 90.64% recognition accuracy (14.21% improvement over conventional RC systems). These results pave the way for the emergence of a reconfigurable in‐sensor RC system with broad applications and enhanced performance for an efficient artificial vision system at the edge.
materials science, multidisciplinary,optics
What problem does this paper attempt to address?