Abstract:A brain-like neuromorphic computing system, as compared with traditional Von Neumann architecture, has broad application prospects in the fields of emerging artificial intelligence (AI) due to its high fault tolerance, excellent plasticity, and parallel computing capability. A neuromorphic visuosensory and memory system, an important branch of neuromorphic computing, is the basis for AI to perceive, process, and memorize optical information, now still suffering from nonlinearity of synaptic weight, crosstalk issues, and integration incompatibility, hindering the high-level training and inference accuracy. In this work, we propose a new optoelectronic neuromorphic architecture by integrating an electrochromic device and a perovskite photodetector. Ascribing to the superior memory characteristics of the electrochromic device and sensitive light response of the perovskite photodetector, the neuromorphic device shows typical visual synaptic functionalities such as light triggering, neural facilitation, long-term potentiation, and depression (LTP and LTD). Furthermore, by adjusting the intensity and wavelength of external light signals, the visual synaptic function of the device can be modulated, enabling the device to exhibit high weight linearity in all current output ranges and improve information processing capability and image recognition accuracy. Moreover, both the electrochromic and perovskite layers possess the advantage of large area fabrication and integration, which enables the fabrication of large device arrays with high integration compatibility and scalability. In this study, 10 × 10 device arrays are demonstrated and each device shows uniform light responses, memory behaviors, and synaptic performances. MNIST and CIFAR-10 algorithms are used to simulate the image recognition properties of the synaptic architecture, and the calculated recognition accuracy is 97.94 and 91.04%, respectively, with an error less than 2.5%. The proposed artificial visual neuromorphic architecture will provide a potential device prototype for efficient visual neuromorphic systems.

Retinomorphic Machine Vision in a Network Laser

Digit Recognition Based on Programmable Nanophotonic Processor

A complete, parallel and autonomous photonic neural network in a semiconductor multimode laser

Broadband Visual Adaption and Image Recognition in a Monolithic Neuromorphic Machine Vision System

Retinomorphic optoelectronic devices for intelligent machine vision.

Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception

Nanoprinted high-neuron-density optical linear perceptrons performing near-infrared inference on a CMOS chip

High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network

Single-shot optical neural network

Neuromorphic Silicon Photonics and Hardware-Aware Deep Learning for High-Speed Inference

Deep learning with coherent VCSEL neural networks

Ultrafast machine vision with 2D material neural network image sensors

A Two-Dimensional Mid-Infrared Optoelectronic Retina Enabling Simultaneous Perception and Encoding.

Broadband Optoelectronic Synapse Enables Compact Monolithic Neuromorphic Machine Vision for Information Processing

Artificial Visual Synaptic Architecture with High-Linearity Light-Modulated Weight for Optoelectronic Neuromorphic Computing

All-in-one two-dimensional retinomorphic hardware device for motion detection and recognition

Low-power scalable multilayer optoelectronic neural networks enabled with incoherent light

Ultra-low Power In-Sensor Neuronal Computing with Oscillatory Retinal Neurons for Frequency-Multiplexed, Parallel Machine Vision

Bioinspired and Low-Power 2D Machine Vision with Adaptive Machine Learning and Forgetting

Ultralow Power In-Sensor Neuronal Computing with Oscillatory Retinal Neurons for Frequency-Multiplexed, Parallel Machine Vision