Abstract:The advent of big data and the Internet of Things has created urgent demands for in-sensor computing hardware with multimodal perception that can effectively resolve the inefficiency, high latency, and excessive energy consumption challenges faced by conventional sensory systems. Here, a simple-structured optoelectronic synaptic device of In2O3SnO2/Nb:SrTiO3 (ITO/NSTO) heterostructure is proposed, which vividly demonstrates in-sensor computing and multimodal perception capabilities. First, with the ingenious synaptic responses of the device under both optical and electrical stimuli, a multimodal in-sensor neuromorphic computing system capable of concurrently perceiving and processing visual and auditory information is constructed. Using this multimodal system to perform a human emotion recognition task, the misjudgment arising from single-modal cognition can thereby be effectively avoided. Second, utilizing the integrated sensing and processing functions, along with the dynamic memories of the device array, a neuromorphic vision system is implemented for real-time monitoring of moving vehicles, which displays high recognition efficiency and accuracy. This research not only provides an optoelectronic synaptic device that is low-cost and easy to mass-produce, but also paves the way for next-generation in-sensor computing that can efficiently process multimodal signals. The separated sensing, storing, and computing modules along with single-mode perception in the conventional sensory system cause time-delay, massive energy consumption, as well as incomprehensive cognition issues. Here a neuromorphic device capable of performing multimodal perception and in-sensor computation within a single device is proposed, enabling a novel multimodal sensory system that is efficient, low-energy, and has minimal time latency. image

Ultra-low-power-consuming Liquid-Water-based Optoelectronic Computing Chip

Liquid water based optoelectronic computing chip

Ultra-low power IGZO optoelectronic synaptic transistors for neuromorphic computing

Ultralow-power optoelectronic synaptic transistors based on polyzwitterion dielectrics for in-sensor reservoir computing

Realize low-power artificial photonic synapse based on (Al,Ga)N nanowire/graphene heterojunction for neuromorphic computing

Multimodal In-Sensor Computing Implemented by Easily-Fabricated Oxide-Heterojunction Optoelectronic Synapses

Ultralow Power Wearable Organic Ferroelectric Device for Optoelectronic Neuromorphic Computing.

Photogated Synaptic Transistors Based on the Heterostructure of 4H-Sic and Organic Semiconductors for Neuromorphic Ultraviolet Vision

Optical synaptic devices with ultra-low power consumption for neuromorphic computing

An optoelectronic synapse based on α-In 2 Se 3 with controllable temporal dynamics for multimode and multiscale reservoir computing

Artificial optoelectronic synaptic devices based on vertical organic field-effect transistors with low energy consumption

Ultra‐Low Power Consumption Artificial Photoelectric Synapses Based on Lewis Acid Doped WSe2 for Neuromorphic Computing

Zero-power Optoelectronic Synaptic Devices

Single wavelength operating neuromorphic device based on a graphene-ferroelectric transistor

A 0.96pJ/SOP, 30.23K-neuron/mm^2 Heterogeneous Neuromorphic Chip With Fullerene-like Interconnection Topology for Edge-AI Computing

Ultralow Power Consumption and Large Dynamic Range Synaptic Transistor Based on Α-In2se3 Nanosheets

Ultra-Low Power Silicon Neuron Circuit for Extreme-Edge Neuromorphic Intelligence

Reconfigurable Optoelectronic Memristor for In-Sensor Computing Applications

Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning

Ultra-low power carbon nanotube/porphyrin synaptic arrays for persistent photoconductivity and neuromorphic computing

Amorphous Ga2O3/GaN heterostructure for ultralow-energy-consumption optically stimulated synaptic devices