Broadband sensory networks with locally stored responsivities for neuromorphic machine vision

Guo-Xin Zhang,Zhi-Cheng Zhang,Xu-Dong Chen,Lixing Kang,Yuan Li,Fu-Dong Wang,Lei Shi,Ke Shi,Zhi-Bo Liu,Jian-Guo Tian,Tong-Bu Lu,Jin Zhang
DOI: https://doi.org/10.1126/sciadv.adi5104
IF: 13.6
2023-09-17
Science Advances
Abstract:As the most promising candidates for the implementation of in-sensor computing, retinomorphic vision sensors can constitute built-in neural networks and directly implement multiply-and-accumulation operations using responsivities as the weights. However, existing retinomorphic vision sensors mainly use a sustained gate bias to maintain the responsivity due to its volatile nature. Here, we propose an ion-induced localized-field strategy to develop retinomorphic vision sensors with nonvolatile tunable responsivity in both positive and negative regimes and construct a broadband and reconfigurable sensory network with locally stored weights to implement in-sensor convolutional processing in spectral range of 400 to 1800 nanometers. In addition to in-sensor computing, this retinomorphic device can implement in-memory computing benefiting from the nonvolatile tunable conductance, and a complete neuromorphic visual system involving front-end in-sensor computing and back-end in-memory computing architectures has been constructed, executing supervised and unsupervised learning tasks as demonstrations. This work paves the way for the development of high-speed and low-power neuromorphic machine vision for time-critical and data-intensive applications.
multidisciplinary sciences
What problem does this paper attempt to address?