Abstract:A hardware‐reconfigurable visual information in‐sensor computing architecture integrating both synaptic and digital logic functions is proposed based on the photoelectric‐coupling engineered vdW heterostructures. Leveraging on the diversified optoelectronic behaviors in vdW heterostructure‐based floating gate transistors, rich nonvolatile photoelectrical logic functionalities and synaptic operations are demonstrated. These findings highlight the prospects of 2D semiconductor‐based optoelectronics for both digital and analog visual in‐sensor computing. In‐sensor computing with visual information, which can integrate photo‐sensing, data storage, and computation functions within the same physical element, has promised a fundamentally different architecture for future machine vision technology with extreme energy and time efficiency. The elementary devices required to fulfil the goal of such a new sensory computation scheme would demand a bold functional variation to the existing sensor and data processing hardware. Here, a van der Waals (vdW) heterostructure‐based optoelectronic transistor that can act as an integrated photoreceptor, memory, and computation unit by exploiting its own physical attributes is demonstrated. It is found that diverse photoelectric control of device conductance can lead to versatile photoresponse characteristics, including memristive behaviors, retention‐, polarity‐ and strength‐tunable photoconductance, photoelectric‐coupling effect, etc. Exploiting the photoelectric‐coupling effect, reconfigurable and nonvolatile optoelectronic logic functions are realized in this device, featuring a logic‐in‐sensor unit. With the same device, both short‐ and long‐term synaptic plasticity can be faithfully emulated, rendering it an optoelectronic synaptic transistor. Moreover, a psychologic human memory model is implemented with the device, showing the emulation of memorization and learning processes. This prototypical demonstration provides a promising hardware system for visual information in‐sensor computing capable of addressing complex computation tasks.

Reconfigurable Sensing‐Memory‐Processing and Logical Integration Within 2D Ferroelectric Optoelectronic Transistor for CMOS‐Compatible Bionic Vision

A robust neuromorphic vision sensor with optical control of ferroelectric switching

Nonvolatile Ferroelectric Field-Effect Transistors.

Photogated Synaptic Transistors Based on the Heterostructure of 4H-Sic and Organic Semiconductors for Neuromorphic Ultraviolet Vision

Multi‐Functional Platform for In‐Memory Computing And Sensing Based on 2D Ferroelectric Semiconductor α‐In2Se3

Integrated In‐Memory Sensor and Computing of Artificial Vision Based on Full‐vdW Optoelectronic Ferroelectric Field‐Effect Transistor

Artificial Optoelectronic Synapses Based on Ferroelectric Field-Effect Enabled 2D Transition Metal Dichalcogenide Memristive Transistors.

Ferroelectric Polarization Enhanced Optoelectronic Synaptic Response of a CuInP2S6 Transistor Structure

Reconfigurable optoelectronic transistors for multimodal recognition

In-plane Ferroelectric-Reconfigured Interface Towards Dual-Modal Intelligent Vision

2D Bi-doped SnSe Ferroelectric Memristor Integrating All-in-One Sensing-Memory-Computing

Coupled Ferroelectric‐Photonic Memory in a Retinomorphic Hardware for In‐Sensor Computing

Multisensory Ferroelectric Semiconductor Synapse for Neuromorphic Computing

Multimodal 2D Ferroelectric Transistor with Integrated Perception-and-Computing-in-Memory Functions for Reservoir Computing

Logic and in-memory computing achieved in a single ferroelectric semiconductor transistor

Integration of Image Preprocessing and Recognition Functions in an Optoelectronic Coupling Organic Ferroelectric Retinomorphic Neuristor

Artificial Visual Systems Fabricated with Ferroelectric van der Waals Heterostructure for In-Memory Computing Applications

A Ferroelectric/Electrochemical Modulated Organic Synapse for Ultraflexible, Artificial Visual-Perception System

The Optical-Electronic Integrated Spiking Neurons Based on Antiferroelectric Thin-Film Transistors

Controlled Optoelectronic Response in van der Waals Heterostructures for In‐Sensor Computing

Multifunctional MoTe 2 Fe‐FET Enabled by Ferroelectric Polarization‐Assisted Charge Trapping