Abstract:A hardware‐reconfigurable visual information in‐sensor computing architecture integrating both synaptic and digital logic functions is proposed based on the photoelectric‐coupling engineered vdW heterostructures. Leveraging on the diversified optoelectronic behaviors in vdW heterostructure‐based floating gate transistors, rich nonvolatile photoelectrical logic functionalities and synaptic operations are demonstrated. These findings highlight the prospects of 2D semiconductor‐based optoelectronics for both digital and analog visual in‐sensor computing. In‐sensor computing with visual information, which can integrate photo‐sensing, data storage, and computation functions within the same physical element, has promised a fundamentally different architecture for future machine vision technology with extreme energy and time efficiency. The elementary devices required to fulfil the goal of such a new sensory computation scheme would demand a bold functional variation to the existing sensor and data processing hardware. Here, a van der Waals (vdW) heterostructure‐based optoelectronic transistor that can act as an integrated photoreceptor, memory, and computation unit by exploiting its own physical attributes is demonstrated. It is found that diverse photoelectric control of device conductance can lead to versatile photoresponse characteristics, including memristive behaviors, retention‐, polarity‐ and strength‐tunable photoconductance, photoelectric‐coupling effect, etc. Exploiting the photoelectric‐coupling effect, reconfigurable and nonvolatile optoelectronic logic functions are realized in this device, featuring a logic‐in‐sensor unit. With the same device, both short‐ and long‐term synaptic plasticity can be faithfully emulated, rendering it an optoelectronic synaptic transistor. Moreover, a psychologic human memory model is implemented with the device, showing the emulation of memorization and learning processes. This prototypical demonstration provides a promising hardware system for visual information in‐sensor computing capable of addressing complex computation tasks.

Optoelectronic Devices for In-Sensor Computing

Multimodal In-Sensor Computing Implemented by Easily-Fabricated Oxide-Heterojunction Optoelectronic Synapses

Breaking the Energy-Efficiency Barriers for Smart Sensing Applications with “sensing with Computing” Architectures

Advances in Spatial Analog Optical Computing Devices

Recent advances in in-sensor computational vision sensors: from mechanisms to applications

In-sensor Neuromorphic Computing Using Perovskites and Transition Metal Dichalcogenides

Advances in silicon-based in-sensor computing for neuromorphic vision sensors

Controlled Optoelectronic Response in van der Waals Heterostructures for In‐Sensor Computing

In-sensor reservoir computing based on optoelectronic synaptic devices

Integrated In-Sensor Computing Optoelectronic Device for Environment-Adaptable Artificial Retina Perception Application.

Bio‐Inspired In‐Sensor Compression and Computing Based on Phototransistors

Neuromorphic sensory computing

Multimode Modulated Memristors for In-Sensor Computing System

Low-Dimensional Optoelectronic Synaptic Devices for Neuromorphic Vision Sensors

Multidimensional vision sensors for information processing

Mechanisms and Applications of Neuromorphic Sensors for Intelligent Visual Perception

Recent Progress in Optoelectronic Synapses for Artificial Visual‐Perception System

Optoelectronic Integrated Circuits for Analog Optical Computing: Development and Challenge

2D Materials Based Optoelectronic Memory: Convergence of Electronic Memory and Optical Sensor

Design of Optoelectronic In-Sensor Computing Circuit Based on Memristive Crossbar Array for in Situ Edge Extraction

In-Sensor Polarimetric Optoelectronic Computing Based on Gate-Tunable 2D Photodetector