Abstract:A hardware‐reconfigurable visual information in‐sensor computing architecture integrating both synaptic and digital logic functions is proposed based on the photoelectric‐coupling engineered vdW heterostructures. Leveraging on the diversified optoelectronic behaviors in vdW heterostructure‐based floating gate transistors, rich nonvolatile photoelectrical logic functionalities and synaptic operations are demonstrated. These findings highlight the prospects of 2D semiconductor‐based optoelectronics for both digital and analog visual in‐sensor computing. In‐sensor computing with visual information, which can integrate photo‐sensing, data storage, and computation functions within the same physical element, has promised a fundamentally different architecture for future machine vision technology with extreme energy and time efficiency. The elementary devices required to fulfil the goal of such a new sensory computation scheme would demand a bold functional variation to the existing sensor and data processing hardware. Here, a van der Waals (vdW) heterostructure‐based optoelectronic transistor that can act as an integrated photoreceptor, memory, and computation unit by exploiting its own physical attributes is demonstrated. It is found that diverse photoelectric control of device conductance can lead to versatile photoresponse characteristics, including memristive behaviors, retention‐, polarity‐ and strength‐tunable photoconductance, photoelectric‐coupling effect, etc. Exploiting the photoelectric‐coupling effect, reconfigurable and nonvolatile optoelectronic logic functions are realized in this device, featuring a logic‐in‐sensor unit. With the same device, both short‐ and long‐term synaptic plasticity can be faithfully emulated, rendering it an optoelectronic synaptic transistor. Moreover, a psychologic human memory model is implemented with the device, showing the emulation of memorization and learning processes. This prototypical demonstration provides a promising hardware system for visual information in‐sensor computing capable of addressing complex computation tasks.

Hybrid MoS2/PbS Quantum Dots Toward In-Sensor Reservoir Computing

Optical Microlithography of Perovskite Quantum Dots/Organic Semiconductor Heterojunctions for Neuromorphic Photosensors

Bioinspired In‐Sensor Reservoir Computing for Self‐Adaptive Visual Recognition with Two‐Dimensional Dual‐Mode Phototransistors

An Optoelectronic Reservoir Computing for Temporal Information Processing

In-sensor reservoir computing based on optoelectronic synaptic devices

Multimodal In-Sensor Computing Implemented by Easily-Fabricated Oxide-Heterojunction Optoelectronic Synapses

Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning

IGZO/InHfO$_{\textit{x}}$ Nanowires/IGZO Phototransistor with Persistent Photoconductivity Effect for Intelligent Visual Perception Application

Integrated In-Memory Sensor and Computing of Artificial Vision System Based on Reversible Bonding Transition-Induced Nitrogen-Doped Carbon Quantum Dots (N-Cqds)

Controlled Optoelectronic Response in van der Waals Heterostructures for In‐Sensor Computing

All‐Inorganic Perovskite Quantum‐Dot Optical Neuromorphic Synapses for Near‐Sensor Colored Image Recognition

Hardware Implementation of Photoelectrically Modulated Dendritic Arithmetic and Spike-Timing-dependent Plasticity Enabled by an Ion-Coupling Gate-Tunable Vertical 0D-Perovskite/2d-mos2hybrid-dimensional Van Der Waals Heterostructure

A Low‐Toxic Colloidal Quantum Dots Sensitized IGZO Phototransistor Array for Neuromorphic Vision Sensors

Reconfigurable, non-volatile neuromorphic photovoltaics

2D Electric-Double-layer Phototransistor for Photoelectronic and Spatiotemporal Hybrid Neuromorphic Integration

CsPbBr 3 quantum dots/PDVT-10 conjugated polymer hybrid film-based photonic synaptic transistors toward high-efficiency neuromorphic computing

Coupled Ferroelectric‐Photonic Memory in a Retinomorphic Hardware for In‐Sensor Computing

IGZO/InHfO<inline-formula> <tex-math notation="LaTeX">$_{\textit{x}}$</tex-math> </inline-formula> Nanowires/IGZO Phototransistor With Persistent Photoconductivity Effect for Intelligent Visual Perception Application

A Memristive-Optoelectronic Sensor for Neuromorphic Visual Systems

Neuromorphic Computing Using a Floating Gate Modulated Photoelectric Synaptic Transistor

PbS/CsPbBr3 Heterojunction for Broadband Neuromorphic Vision Sensing