Abstract:This work demonstrates a retinomorphic prototype that integrates ferroelectricity and photosensitivity within a two‐dimensional (2D) α‐In2Se3 material, emulating simultaneous functions in the human retina, that is, perceptive light‐sensing, memory, and computation. The optoelectronic memory efficiently classifies 12 000 images with a satisfactory precision of 94% and replicates five convolutional kernels using a network of 3 × 3 phototransistors for the image processing task. The development of all‐in‐one devices for artificial visual systems offers an attractive solution in terms of energy efficiency and real‐time processing speed. In recent years, the proliferation of smart sensors in the growth of Internet‐of‐Things (IoT) has led to the increasing importance of in‐sensor computing technology, which places computational power at the edge of the data‐flow architecture. In this study, a prototype visual sensor inspired by the human retina is proposed, which integrates ferroelectricity and photosensitivity in two‐dimensional (2D) α‐In2Se3 material. This device mimics the functions of photoreceptors and amacrine cells in the retina, performing optical reception and memory computation functions through the use of electrical switching polarization in the channel. The gate‐tunable linearity of excitatory and inhibitory functions in photon‐induced short‐term plasticity enables to encode and classify 12 000 images in the Mixed National Institute of Standards and Technology (MNIST) dataset with remarkable accuracy, achieving ≈94%. Additionally, in‐sensor convolution image processing through a network of phototransistors, with five convolutional kernels electrically pre‐programmed into the transistors is demonstrated. The convoluted photocurrent matrices undergo straightforward arithmetic calculations to produce edge and feature‐enhanced scenarios. The findings demonstrate the potential of ferroelectric α‐In2Se3 for highly compact and efficient retinomorphic hardware implementation, regardless of ambipolar transport in the channel.

Bio‐Inspired In‐Sensor Compression and Computing Based on Phototransistors (Small 23/2022)

Bio‐Inspired In‐Sensor Compression and Computing Based on Phototransistors

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

A Near-array Convolution Computing Scheme Based on WSe<inf>2</inf> Photodiode

A Near-array Convolution Computing Scheme Based on WSe<sub>2</sub> Photodiode

A Multimodal Sensing CMOS Imager Based on Dual‐Focus Imaging(Adv. Sci. 14/2023)

Progress in Bioinspired Photodetectors Design for Visual Information Processing

InP Quantum Dots Tailored Oxide Thin Film Phototransistor for Bioinspired Visual Adaptation

Optoelectronic Devices for In-Sensor Computing

Multimodal In-Sensor Computing Implemented by Easily-Fabricated Oxide-Heterojunction Optoelectronic Synapses

Recent advances in in-sensor computational vision sensors: from mechanisms to applications

Bioinspired in-sensor visual adaptation for accurate perception

All‐In‐One Optoelectronic Transistors for Bio‐Inspired Visual System

Near-Infrared Heterojunction Field Modulated Phototransistors with Distinct Photodetection/Photostorage Switching Feature for Artificial Visuals

Bioinspired In‐Sensor Reservoir Computing for Self‐Adaptive Visual Recognition with Two‐Dimensional Dual‐Mode Phototransistors

Coupled Ferroelectric‐Photonic Memory in a Retinomorphic Hardware for In‐Sensor Computing

In-Sensor Polarimetric Optoelectronic Computing Based on Gate-Tunable 2D Photodetector

Ultra-low power IGZO optoelectronic synaptic transistors for neuromorphic computing

Bioinspired sensing-memory-computing integrated vision systems: biomimetic mechanisms, design principles, and applications

Bionic visual-audio photodetectors with in-sensor perception and preprocessing

An Image Detection–Memory–Recognition Artificial Visual Unit Based on Dual‐Gate Phototransistors