Abstract:Machine learning, particularly in the form of deep learning, has driven most of the recent fundamental developments in artificial intelligence. Deep learning is based on computational models that are, to a certain extent, bio-inspired, as they rely on networks of connected simple computing units operating in parallel. Deep learning has been successfully applied in areas such as object/pattern recognition, speech and natural language processing, self-driving vehicles, intelligent self-diagnostics tools, autonomous robots, knowledgeable personal assistants, and monitoring. These successes have been mostly supported by three factors: availability of vast amounts of data, continuous growth in computing power, and algorithmic innovations. The approaching demise of Moore's law, and the consequent expected modest improvements in computing power that can be achieved by scaling, raise the question of whether the described progress will be slowed or halted due to hardware limitations. This paper reviews the case for a novel beyond CMOS hardware technology, memristors, as a potential solution for the implementation of power-efficient in-memory computing, deep learning accelerators, and spiking neural networks. Central themes are the reliance on non-von-Neumann computing architectures and the need for developing tailored learning and inference algorithms. To argue that lessons from biology can be useful in providing directions for further progress in artificial intelligence, we briefly discuss an example based reservoir computing. We conclude the review by speculating on the big picture view of future neuromorphic and brain-inspired computing systems.

On-Chip Universal Supervised Learning Methods for Neuro-Inspired Block of Memristive Nanodevices

On-chip Supervised Learning Rule for Ultra High Density Neural Crossbar Using Memristor for Synapse and Neuron

Bioinspired networks with nanoscale memristive devices that combine the unsupervised and supervised learning approaches

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

A 45nm CMOS Neuromorphic Chip with a Scalable Architecture for Learning in Networks of Spiking Neurons

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Robust Learning Approach for Neuro-Inspired Nanoscale Crossbar Architecture.

Memristor-based Synaptic Networks and Logical Operations Using In-Situ Computing

Memristor-based Neuromorphic Implementations for Artificial Neural Networks

Robust neural logic block (NLB) based on memristor crossbar array

Memristors -- from In-memory computing, Deep Learning Acceleration, Spiking Neural Networks, to the Future of Neuromorphic and Bio-inspired Computing

Post-silicon nano-electronic device and its application in brain-inspired chips

Memristors: Associative Learning with Temporal Contiguity in a Memristive Circuit for Large‐Scale Neuromorphic Networks (Adv. Electron. Mater. 8/2015)

Neuromorphic Function Learning with Carbon Nanotube Based Synapses.

Design and Modeling of a Neuro-Inspired Learning Circuit Using Nanotube-Based Memory Devices

Memristors—From In‐Memory Computing, Deep Learning Acceleration, and Spiking Neural Networks to the Future of Neuromorphic and Bio‐Inspired Computing

A Brain-Plausible Neuromorphic On-the-fly Learning System Implemented with Magnetic Domain Wall Analog Memristors

Exploiting Memristors for Neuromorphic Reinforcement Learning

A CMOS Spiking Neuron for Brain-Inspired Neural Networks with Resistive Synapses and In-Situ Learning

On-Chip Error-Triggered Learning of Multi-Layer Memristive Spiking Neural Networks

Exploiting the Short-term to Long-term Plasticity Transition in Memristive Nanodevice Learning Architectures