Optoelectronic graded neurons for bioinspired in-sensor motion perception

Jiewei Chen,Zheng Zhou,Beom Jin Kim,Yue Zhou,Zhaoqing Wang,Tianqing Wan,Jianmin Yan,Jinfeng Kang,Jong-Hyun Ahn,Yang Chai
DOI: https://doi.org/10.1038/s41565-023-01379-2
IF: 38.3
2023-04-21
Nature Nanotechnology
Abstract:Motion processing has proven to be a computational challenge and demands considerable computational resources. Contrast this with the fact that flying insects can agilely perceive real-world motion with their tiny vision system. Here we show that phototransistor arrays can directly perceive different types of motion at sensory terminals, emulating the non-spiking graded neurons of insect vision systems. The charge dynamics of the shallow trapping centres in MoS 2 phototransistors mimic the characteristics of graded neurons, showing an information transmission rate of 1,200 bit s −1 and effectively encoding temporal light information. We used a 20 × 20 photosensor array to detect trajectories in the visual field, allowing the efficient perception of the direction and vision saliency of moving objects and achieving 99.2% recognition accuracy with a four-layer neural network. By modulating the charge dynamics of the shallow trapping centres of MoS 2 , the sensor array can recognize motion with a temporal resolution ranging from 10 1 to 10 6 ms.
materials science, multidisciplinary,nanoscience & nanotechnology
What problem does this paper attempt to address?