Abstract:A hardware‐reconfigurable visual information in‐sensor computing architecture integrating both synaptic and digital logic functions is proposed based on the photoelectric‐coupling engineered vdW heterostructures. Leveraging on the diversified optoelectronic behaviors in vdW heterostructure‐based floating gate transistors, rich nonvolatile photoelectrical logic functionalities and synaptic operations are demonstrated. These findings highlight the prospects of 2D semiconductor‐based optoelectronics for both digital and analog visual in‐sensor computing. In‐sensor computing with visual information, which can integrate photo‐sensing, data storage, and computation functions within the same physical element, has promised a fundamentally different architecture for future machine vision technology with extreme energy and time efficiency. The elementary devices required to fulfil the goal of such a new sensory computation scheme would demand a bold functional variation to the existing sensor and data processing hardware. Here, a van der Waals (vdW) heterostructure‐based optoelectronic transistor that can act as an integrated photoreceptor, memory, and computation unit by exploiting its own physical attributes is demonstrated. It is found that diverse photoelectric control of device conductance can lead to versatile photoresponse characteristics, including memristive behaviors, retention‐, polarity‐ and strength‐tunable photoconductance, photoelectric‐coupling effect, etc. Exploiting the photoelectric‐coupling effect, reconfigurable and nonvolatile optoelectronic logic functions are realized in this device, featuring a logic‐in‐sensor unit. With the same device, both short‐ and long‐term synaptic plasticity can be faithfully emulated, rendering it an optoelectronic synaptic transistor. Moreover, a psychologic human memory model is implemented with the device, showing the emulation of memorization and learning processes. This prototypical demonstration provides a promising hardware system for visual information in‐sensor computing capable of addressing complex computation tasks.

The Photoelectric Synaptic Device with Sensing‐Memory‐Computing Function Regulated by All‐Optical Pulse

A Photoeletric Memristive Device for Artificial Visual Perception

Photogated Synaptic Transistors Based on the Heterostructure of 4H-Sic and Organic Semiconductors for Neuromorphic Ultraviolet Vision

Perovskite/Organic Semiconductor-Based Photonic Synaptic Transistor for Artificial Visual System.

Optically Stimulated Synaptic Devices Based on the Hybrid Structure of Silicon Nanomembrane and Perovskite.

SnS‐Facilitated ZnAlSnO‐Based Fully Optically Modulated Artificial Synaptic Device for Image Processing

Fully UV Modulated Artificial Synapses with Integrated Sensing, Storage and Computation

All-photonic artificial synapses based on photochromic perovskites for noncontact neuromorphic visual perception

Bidirectional Photoresponse in Perovskite‐ZnO Heterostructure for Fully Optical‐Controlled Artificial Synapse

Photonic Synapses for Image Recognition and High Density Integration of Simplified Artificial Neural Networks

All‐Optically Controlled Artificial Synapse Based on Full Oxides for Low‐Power Visible Neural Network Computing

N:ZnO/MoS2-heterostructured flexible synaptic devices enabling optoelectronic co-modulation for robust artificial visual systems

Artificial optoelectronic synapse based on CdSe nanobelt photosensitized MoS 2 transistor with long retention time for neuromorphic application

InGaZnO-based Photoelectric Synaptic Devices for Neuromorphic Computing

An Ultrasensitive Programmable 2D Photoelectric Synaptic Transistor

Controlled Optoelectronic Response in van der Waals Heterostructures for In‐Sensor Computing

Silicon-Based Hybrid Optoelectronic Devices with Synaptic Plasticity and Stateful Photoresponse

Optically Readable Electrochromic-Based Microfiber Synaptic Device for Photonic Neuromorphic Systems

A Reconfigurable Optoelectronic Synaptic Transistor with Stable Zr-CsPbI3 Nanocrystals for Visuomorphic Computing

Complementary Photo-Synapses Based on Light-Stimulated Porphyrin-Coated Silicon Nanowires Field-Effect Transistors (LPSNFET)

Ultra-low power IGZO optoelectronic synaptic transistors for neuromorphic computing