Abstract:While there is an abundance of research on neural networks that are "inspired" by the brain, few mimic the critical temporal compute features that allow the brain to efficiently perform complex computations. Even fewer methods emulate the heterogeneity of learning produced by biological neurons. Memory devices, such as memristors, are also investigated for their potential to implement neuronal functions in electronic hardware. However, memristors in computing architectures typically operate as non-volatile memories, either as storage or as the weights in a multiply-and-accumulate function that requires direct access to manipulate memristance via a costly learning algorithm. Hence, the integration of memristors into architectures as time-dependent computational units is studied, starting with the development of a compact and versatile mathematical model that is capable of emulating flux-linkage controlled analog (FLCA) memristors and their unique temporal characteristics. The proposed model, which is validated against experimental FLCA LixNbO2 intercalation devices, is used to create memristive circuits that mimic neuronal behavior such as desensitization, paired-pulse facilitation, and spike-timing-dependent plasticity. The model is used to demonstrate building blocks of biomimetic learning via dynamical memristive circuits that implement biomimetic learning rules in a self-training neural network, with dynamical memristive weights that are capable of associative lifelong learning. Successful training of the dynamical memristive neural network to perform image classification of handwritten digits is shown, including lifelong learning by having the dynamical memristive network relearn different characters in succession. An analog computing architecture that learns to associate input-to-input correlations is also introduced, with examples demonstrating image classification and pattern recognition without convolution. The biomimetic functions shown in this paper result from fully ion-driven memristive circuits devoid of integrating capacitors and thus are instructive for exploiting the immense potential of memristive technology for neuromorphic computation in hardware and allowing a common architecture to be applied to a wide range of learning rules, including STDP, magnitude, frequency, and pulse shape among others, to enable an inorganic implementation of the complex heterogeneity of biological neural systems.

Learning-to-learn enables rapid learning with phase-change memory-based in-memory computing

Emulating Brain-like Rapid Learning in Neuromorphic Edge Computing

Data and Power Efficient Intelligence with Neuromorphic Learning Machines

Brain-inspired Global-Local Learning Incorporated with Neuromorphic Computing

Memristors -- from In-memory computing, Deep Learning Acceleration, Spiking Neural Networks, to the Future of Neuromorphic and Bio-inspired Computing

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

Brain-Inspired Hardware for Artificial Intelligence: Accelerated Learning in a Physical-Model Spiking Neural Network

Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses

Memristors—From In‐Memory Computing, Deep Learning Acceleration, and Spiking Neural Networks to the Future of Neuromorphic and Bio‐Inspired Computing

Neuromorphic Incremental on-chip Learning with Hebbian Weight Consolidation

Learning Memory Access Patterns

Neuromorphic analog circuits for robust on-chip always-on learning in spiking neural networks

A Brain-Plausible Neuromorphic On-the-fly Learning System Implemented with Magnetic Domain Wall Analog Memristors

Neuromorphic one-shot learning utilizing a phase-transition material

Reconfigurable Multilevel Storage and Neuromorphic Computing Based on Multilayer Phase-Change Memory

Dynamical memristive neural networks and associative self-learning architectures using biomimetic devices

A 64-core mixed-signal in-memory compute chip based on phase-change memory for deep neural network inference

Mixed‐Precision Continual Learning Based on Computational Resistance Random Access Memory

Special Topic on Nonvolatile Memory for Efficient Implementation of Neural/Neuromorphic Computing

Tutorial: Brain-inspired computing using phase-change memory devices

In-memory Computing with Emerging Nonvolatile Memory Devices