Abstract:Brain-inspired approaches can efficiently analyze the activities of biological neural networks and solve computationally hard problems with energy efficiencies unattainable with von Neumann architectures, indicating a significant improvement in the understanding of neuronal communications and functionalities. Here, we present a brain-inspired multimodal signal processing system with organic memristor arrays that can potentially integrate the signal sensory, storage, and computation. To facilitate the multimodal signal processing system design, we used four components. First, we present a multimodal signal sensory module mainly responsible for multimodal (iconic, echoic, olfactory, muscular, and gustatory) signal collection, fusion, and storage. Second, a high-density cross-point memristive synapse array is constructed after fabrication of the albumin protein memristor to realize the dense connectivity between layers of computing, data storage, and communication. Third, considering the structure and function of the brain region, we demonstrate a general learning module for hierarchy learning, which can recognize and imagine multimodal information. Finally, the necessary peripheral circuit module (consisting of winnerless competition function circuit, analog-to-digital converter, digital-to-analog converter, pulse modulator, etc.) is designed. Notably, our system can capture massive amounts of data every second and perform in situ processing of multimodal signals. This study is expected to help achieve the deep integration of nano materials into neuromorphic computing systems and energy-efficient integrated circuits.

Design Proposal of Imaging Activities of Cultured Neural Network on a Silicon Substrate with Neural-Electronic-Optical Integrated Microsystem

Design Proposal For A Chip Jointing Vlsi And Rat Spinal Cord Neurons On A Single Silicon Wafer

A Multi-Electrode Array Coupled with Fiberoptic for Deep-Brain Optical Neuromodulation and Electrical Recording.

Full custom design of the interface for an in vitro neural biosensor

Heterogeneously Integrated Optoelectronic Devices for Implantable Neural Interfaces

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Simulation and fabrication of in vitro microfluidic microelectrode array chip for patterned culture and electrophysiological detection of neurons

Development of wafer-scale multifunctional nanophotonic neural probes for brain activity mapping

Single-chip microelectronic system to interface with living cells

A Neurophotonic Device for Stimulation and Recording of Neural Microcircuits.

Design of Silicon Photonic Structures for Multi-Site, Multi-Spectral Optogenetics in the Deep Brain

Flexible Optoelectric Neural Interface Integrated Wire-Bonding $\mu$ LEDs and Microelectrocorticography for Optogenetics

Implantable Photonic Neural Probes with 3D-Printed Microfluidics and Applications to Uncaging

A Microelectrode Array Incorporating an Optical Waveguide Device for Stimulation and Spatiotemporal Electrical Recording of Neural Activity

Low-voltage solution-processed artificial optoelectronic hybrid-integrated neuron based on 2D MXene for multi-task spiking neural network

Integrated Device for Optical Stimulation and Spatiotemporal Electrical Recording of Neural Activity in Light-Sensitized Brain Tissue.

Integrated optoelectronics for neural stimulation and recording in freely moving animals

Active microelectronic neurosensor arrays for implantable brain communication interfaces

Photonic Integrated Neuro-Synaptic Core for Convolutional Spiking Neural Network

Massively Parallel Microwire Arrays Integrated with CMOS chips for Neural Recording

Visualized in-sensor computing