Abstract:Sensory neurons integrate multiple sensory inputs into a synthetical perception to monitor complex environments, which significantly impact on how we perceive the world. However, a true implementation of such an electronic device to mimic multiple sensory modalities, especially the coordinating behaviors of multisensory integration, has rarely been reported thus far. Herein, an artificial multisensory integration nervous system with haptic and iconic perception behaviors is developed by integrating flexible triboelectric nanogenerator (TENG) with organic photosynaptic transistor, where lead-free perovskite (Cs2AgBiBr6) quantum dots (QDs) are firstly presented. Meanwhile, Inverse effectiveness effect and Temporal congruency, which are the primary principles of multisensory integration in biological perceptual system, are firstly precisely mimicked in our system. Moreover, the pattern recognition results show that multisensory integration exhibited obviously higher accuracy than single sense, which is consistent with biological system. Furthermore, 3 × 3 pixel array of artificial photosynaptic circuits actuated with TENG is designed and demonstrated for the recognition of various objects in extreme environments, which further verifies the superiority of the multisensory integration with improved image contrast, accuracy of subsequent pattern recognition, and environment-adaptable perception behaviors. This work provides new insight into developing artificial multisensory integration nerve in neuromorphic perceptions and neuromorphic computing, which is of great significance in future human-machine interaction, sophisticated robotic prostheses and neurorobotic system.

System Integration For Visual Pattern Processing Based On Cmos Technology

A Cmos Vertically Integrated Device for Monochromatic Spectrum Detection

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

Design and Application of an Image Processing System Based on TMS320VC5416

A Multimodal Sensing CMOS Imager Based on Dual‐Focus Imaging(Adv. Sci. 14/2023)

A New Interpolating Method Based on the Variation of Spectra Energy Using CMOS Array

Design Realization and Characterization of A Position Sensitive Detector for Fast Optical Measurement

Microimage Processing System Based On Cmos Sensor

Design Of A High Flexible Block-Based Computational Cmos Image Sensor

Systematic Experimental Study on Stitching Techniques of CMOS Image Sensors

Design and fabrication of vertically-integrated CMOS image sensors

A 619-pixel machine vision enhancement chip based on two-dimensional semiconductors

MOS-based model of four-transistor CMOS image sensor pixels for photoelectric simulation

An Atomically Thin Optoelectronic Machine Vision Processor

Design and Simulation of an Application Specific CMOS Image Sensor

Monolithic Tandem Multicolor Image Sensor Based on Electrochromic Color‐Radix Demultiplexing

Artificial multisensory integration nervous system with haptic and iconic perception behaviors

A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition

Circuit Design of High-Dynamic-Range Image Sensor Pixel for Visual Prostheses

A Logic-Memory Transistor with the Integration of Visible Information Sensing-Memory-Processing

A Monolithically Integrated 640 × 512 CMOS-Perovskite Image Sensor