Abstract:Brain-inspired approaches can efficiently analyze the activities of biological neural networks and solve computationally hard problems with energy efficiencies unattainable with von Neumann architectures, indicating a significant improvement in the understanding of neuronal communications and functionalities. Here, we present a brain-inspired multimodal signal processing system with organic memristor arrays that can potentially integrate the signal sensory, storage, and computation. To facilitate the multimodal signal processing system design, we used four components. First, we present a multimodal signal sensory module mainly responsible for multimodal (iconic, echoic, olfactory, muscular, and gustatory) signal collection, fusion, and storage. Second, a high-density cross-point memristive synapse array is constructed after fabrication of the albumin protein memristor to realize the dense connectivity between layers of computing, data storage, and communication. Third, considering the structure and function of the brain region, we demonstrate a general learning module for hierarchy learning, which can recognize and imagine multimodal information. Finally, the necessary peripheral circuit module (consisting of winnerless competition function circuit, analog-to-digital converter, digital-to-analog converter, pulse modulator, etc.) is designed. Notably, our system can capture massive amounts of data every second and perform in situ processing of multimodal signals. This study is expected to help achieve the deep integration of nano materials into neuromorphic computing systems and energy-efficient integrated circuits.

Self healable neuromorphic memtransistor elements for decentralized sensory signal processing in robotics

Self-reconfigurable Multifunctional Memristive Nociceptor for Intelligent Robotics

A Bioinspired Artificial Injury Response System Based on a Robust Polymer Memristor to Mimic a Sense of Pain, Sign of Injury, and Healing

Artificial Synapses Based on Organic Electrochemical Transistors with Self-Healing Dielectric Layers

Towards on-receptor computing: Electronic nociceptor embedded neuromorphic functionalities at nanoscale

An Artificial Spiking Afferent Nerve Based on Mott Memristors for Neurorobotics

An Artificial Nociceptor Based on a Diffusive Memristor.

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Neuro-inspired Thermoresponsive Nociceptor for Intelligent Sensory Systems

An Artificial Universal Tactile Nociceptor Based on 2D Polymer Film Memristor Arrays with Tunable Resistance Switching Behaviors

A biomimetic nociceptor system with tactile perception based on Ni-Al layered double hydroxides/gelatin heterojunction memristor

A Biomimetic Nociceptor Based on a Vertical Multigate, Multichannel Neuromorphic Transistor

A Multimodal Perception-Enabled Flexible Memristor with Combined Sensing-Storage-Memory Functions for Enhanced Artificial Injury Recognition

Cobalt-doped zinc oxide based memristors with nociceptor characteristics for bio-inspired technology

Halide Perovskites‐based Diffusive Memristors for Artificial Mechano‐Nociceptive System

Neuro-inspired electronic skin for robots

Neuromorphic sensorimotor loop embodied by monolithically integrated, low-voltage, soft e-skin

Memristive Circuit Implementation of a Self-Repairing Network Based on Biological Astrocytes in Robot Application

An Artificial Sensory Neuron with Tactile Perceptual Learning

Freestanding Dual-Gate Oxide-Based Neuromorphic Transistors for Flexible Artificial Nociceptors

Memristor-based adaptive neuromorphic perception in unstructured environments