Abstract:A hardware‐reconfigurable visual information in‐sensor computing architecture integrating both synaptic and digital logic functions is proposed based on the photoelectric‐coupling engineered vdW heterostructures. Leveraging on the diversified optoelectronic behaviors in vdW heterostructure‐based floating gate transistors, rich nonvolatile photoelectrical logic functionalities and synaptic operations are demonstrated. These findings highlight the prospects of 2D semiconductor‐based optoelectronics for both digital and analog visual in‐sensor computing. In‐sensor computing with visual information, which can integrate photo‐sensing, data storage, and computation functions within the same physical element, has promised a fundamentally different architecture for future machine vision technology with extreme energy and time efficiency. The elementary devices required to fulfil the goal of such a new sensory computation scheme would demand a bold functional variation to the existing sensor and data processing hardware. Here, a van der Waals (vdW) heterostructure‐based optoelectronic transistor that can act as an integrated photoreceptor, memory, and computation unit by exploiting its own physical attributes is demonstrated. It is found that diverse photoelectric control of device conductance can lead to versatile photoresponse characteristics, including memristive behaviors, retention‐, polarity‐ and strength‐tunable photoconductance, photoelectric‐coupling effect, etc. Exploiting the photoelectric‐coupling effect, reconfigurable and nonvolatile optoelectronic logic functions are realized in this device, featuring a logic‐in‐sensor unit. With the same device, both short‐ and long‐term synaptic plasticity can be faithfully emulated, rendering it an optoelectronic synaptic transistor. Moreover, a psychologic human memory model is implemented with the device, showing the emulation of memorization and learning processes. This prototypical demonstration provides a promising hardware system for visual information in‐sensor computing capable of addressing complex computation tasks.

Integration of Multimode Sensory and Data Processing in Single-Transistor Sensors

A Multimodal Sensing CMOS Imager Based on Dual‐Focus Imaging(Adv. Sci. 14/2023)

Intelligent Multimodal Sensors Based on Novel Electronic-Ionic Bi<inf>2</inf>O<inf>2</inf>Se Semiconductors

Multimodal In-Sensor Computing Implemented by Easily-Fabricated Oxide-Heterojunction Optoelectronic Synapses

An Image Detection–Memory–Recognition Artificial Visual Unit Based on Dual‐Gate Phototransistors

Reconfigurable Sensing‐Memory‐Processing and Logical Integration Within 2D Ferroelectric Optoelectronic Transistor for CMOS‐Compatible Bionic Vision

Reconfigurable optoelectronic transistors for multimodal recognition

Reconfigurable memlogic long wave infrared sensing with superconductors

A Logic-Memory Transistor with the Integration of Visible Information Sensing-Memory-Processing

Ultrasensitive Photo-Thermal Multimodal Sensory Based on Self-Doping Modulation of Bi2O2Se Semiconductor

Bidirectional Synaptic Phototransistor Based on Two-Dimensional Ferroelectric Semiconductor for Mixed Color Pattern Recognition

Controlled Optoelectronic Response in van der Waals Heterostructures for In‐Sensor Computing

Molecular-scale Integration of Multi-modal Sensing and Neuromorphic Computing with Organic Electrochemical Transistors

A Dual-Functional Integration of Photodetectors and Artificial Optoelectronic Synapses on a VO2/WO3 Heterojunction Device

Fully integrated multi-mode optoelectronic memristor array for diversified in-sensor computing

Triboelectric potential tuned dual-gate IGZO transistor for versatile sensory device

Monolithic Tandem Multicolor Image Sensor Based on Electrochromic Color‐Radix Demultiplexing

MoS2/ZnO-heterostructured Optoelectronic Synapse for Multiwavelength Optical Information-based Sensing, Memory, and Processing

Ultrasensitive dim-light neuromorphic vision sensing via momentum-conserved reconfigurable van der Waals heterostructure

A robust neuromorphic vision sensor with optical control of ferroelectric switching

Bi2O2Se-Perovskite Heterostructure Based Bipolar Photosensors As Reconfigurable Logic-In-Sensor Devices