Abstract:A hardware‐reconfigurable visual information in‐sensor computing architecture integrating both synaptic and digital logic functions is proposed based on the photoelectric‐coupling engineered vdW heterostructures. Leveraging on the diversified optoelectronic behaviors in vdW heterostructure‐based floating gate transistors, rich nonvolatile photoelectrical logic functionalities and synaptic operations are demonstrated. These findings highlight the prospects of 2D semiconductor‐based optoelectronics for both digital and analog visual in‐sensor computing. In‐sensor computing with visual information, which can integrate photo‐sensing, data storage, and computation functions within the same physical element, has promised a fundamentally different architecture for future machine vision technology with extreme energy and time efficiency. The elementary devices required to fulfil the goal of such a new sensory computation scheme would demand a bold functional variation to the existing sensor and data processing hardware. Here, a van der Waals (vdW) heterostructure‐based optoelectronic transistor that can act as an integrated photoreceptor, memory, and computation unit by exploiting its own physical attributes is demonstrated. It is found that diverse photoelectric control of device conductance can lead to versatile photoresponse characteristics, including memristive behaviors, retention‐, polarity‐ and strength‐tunable photoconductance, photoelectric‐coupling effect, etc. Exploiting the photoelectric‐coupling effect, reconfigurable and nonvolatile optoelectronic logic functions are realized in this device, featuring a logic‐in‐sensor unit. With the same device, both short‐ and long‐term synaptic plasticity can be faithfully emulated, rendering it an optoelectronic synaptic transistor. Moreover, a psychologic human memory model is implemented with the device, showing the emulation of memorization and learning processes. This prototypical demonstration provides a promising hardware system for visual information in‐sensor computing capable of addressing complex computation tasks.

Van der Waals Integrated Silicon Broadband Imagers

A van der Waals pn heterojunction with organic/inorganic semiconductors

A High-resolution Colloidal Quantum Dot Imager by Monolithic Integration

Broadband Graphene-Silicon Integrated Imagers

Silicon-based Heterostructures for Optoelectronic Synaptic Devices

Two-dimensional optoelectronic devices for silicon photonic integration

Van der Waals integration of two-dimensional materials and bulk semiconductors for infrared photodetection technology

Silicon Photonic Network-on-chip and Enabling Components

All van der Waals Integrated Nanophotonics

Controlled Optoelectronic Response in van der Waals Heterostructures for In‐Sensor Computing

Development of Silicon Photonic Devices for Optical Interconnects

Unlocking High Performance, Ultra-Low Power Van der Waals Transistors: Towards Back-End-of-Line In-Sensor Machine Vision Applications

Two-dimensional devices and integration towards the silicon lines

Unlocking High-Performance, Ultra-Low Power van der Waals Photo-Transistors: Toward Back-End-of-Line in-Sensor Machine Vision Applications

An Atomically Thin Optoelectronic Machine Vision Processor

A Universal Optoelectronic Imaging Platform with Wafer-scale Integration of Two-dimensional Semiconductors

Hybrid silicon photonic devices with two-dimensional materials

Ultra-wideband integrated photonic devices on silicon platform: from visible to mid-IR

Hybrid/Integrated Silicon Photonics Based on 2D Materials in Optical Communication Nanosystems

Van der Waals heterostructures for high-performance device applications: challenges and opportunities

Allying nanophotonic structures with two-dimensional van der Waals materials