Abstract:For processing streaming events from a Dynamic Vision Sensor camera, two types of neural networks can be considered. One are spiking neural networks, where simple spike-based computation is suitable for low-power consumption, but the discontinuity in spikes can make the training complicated in terms of hardware. The other one are digital Complementary Metal Oxide Semiconductor (CMOS)-based neural networks that can be trained directly using the normal backpropagation algorithm. However, the hardware and energy overhead can be significantly large, because all streaming events must be accumulated and converted into histogram data, which requires a large amount of memory such as SRAM. In this paper, to combine the spike-based operation with the normal backpropagation algorithm, memristor–CMOS hybrid circuits are proposed for implementing event-driven neural networks in hardware. The proposed hybrid circuits are composed of input neurons, synaptic crossbars, hidden/output neurons, and a neural network's controller. Firstly, the input neurons perform preprocessing for the DVS camera's events. The events are converted to histogram data using very simple memristor-based latches in the input neurons. After preprocessing the events, the converted histogram data are delivered to an ANN implemented using synaptic memristor crossbars. The memristor crossbars can perform low-power Multiply–Accumulate (MAC) calculations according to the memristor's current–voltage relationship. The hidden and output neurons can convert the crossbar's column currents to the output voltages according to the Rectified Linear Unit (ReLU) activation function. The neural network's controller adjusts the MAC calculation frequency according to the workload of the event computation. Moreover, the controller can disable the MAC calculation clock automatically to minimize unnecessary power consumption. The proposed hybrid circuits have been verified by circuit simulation for several event-based datasets such as POKER-DVS and MNIST-DVS. The circuit simulation results indicate that the neural network's performance proposed in this paper is degraded by as low as 0.5% while saving as much as 79% in power consumption for POKER-DVS. The recognition rate of the proposed scheme is lower by 0.75% compared to the conventional one, for the MNIST-DVS dataset. In spite of this little loss, the power consumption can be reduced by as much as 75% for the proposed scheme.

Memristive neural network circuit design based on locally competitive algorithm for sparse coding application

Sparse coding with memristor networks

Single Image Super-Resolution Via the Implementation of the Hardware-Friendly Sparse Coding

Fast and Accurate Sparse Coding of Visual Stimuli With a Simple, Ultralow-Energy Spiking Architecture

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

A Neuromorphic Core Based on Threshold Switching Memristor with Asynchronous Address Event Representation Circuits

In-situ learning in multilayer locally-connected memristive spiking neural network

A Low-Cost Hardware-Friendly Spiking Neural Network Based on Binary MRAM Synapses, Accelerated Using In-Memory Computing

Efficient In Situ Learning of Hybrid LIF Neurons Using WTA Mechanism for High-Speed Low-Power Neuromorphic Systems

Memristor–CMOS Hybrid Circuits Implementing Event-Driven Neural Networks for Dynamic Vision Sensor Camera

Memristor-Based Cellular Nonlinear/Neural Network: Design, Analysis, and Applications

A linear compensation method for inference accuracy improvement of memristive in-memory computing

Efficient Spiking Neural Networks with Biologically Similar Lithium-Ion Memristor Neurons

A Memristive Spiking Neural Network Circuit with Selective Supervised Attention Algorithm

Memristor Neural Network Design

In-situ Learning in Hardware Compatible Multi-layer Memristive Spiking Neural Network

Memristor-based multi-synaptic spiking neuron circuit for spiking neural network

An Efficient and Accurate Memristive Memory for Array-based Spiking Neural Networks

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Memristor networks for real-time neural activity analysis