Abstract:An increasing number of studies are highlighting the importance of spatial dendritic branching in pyramidal neurons in the neocortex for supporting non-linear computation through localized synaptic integration. In particular, dendritic branches play a key role in temporal signal processing and feature detection. This is accomplished thanks to coincidence detection (CD) mechanisms enabled by the presence of synaptic delays that align temporally disparate inputs for effective integration. Computational studies on spiking neural networks further highlight the significance of delays for achieving spatio-temporal pattern recognition with pure feed-forward neural networks, without the need of resorting to recurrent architectures. In this work, we present "DenRAM", the first realization of a feed-forward spiking neural network with dendritic compartments, implemented using analog electronic circuits integrated into a 130 nm technology node and coupled with Resistive Random Access Memory (RRAM) technology. DenRAM's dendritic circuits use RRAM devices to implement both delays and synaptic weights in the network. By configuring the RRAM devices to reproduce bio-realistic timescales, and by exploiting their heterogeneity we experimentally demonstrate DenRAM's ability to replicate synaptic delay profiles, and to efficiently implement CD for spatio-temporal pattern recognition. To validate the architecture, we conduct comprehensive system-level simulations on two representative temporal benchmarks, demonstrating DenRAM's resilience to analog hardware noise, and its superior accuracy compared to recurrent architectures with an equivalent number of parameters. DenRAM not only brings rich temporal processing capabilities to neuromorphic architectures, but also reduces the memory footprint of edge devices, warrants high accuracy on temporal benchmarks, and represents a significant step-forward in low-power real-time signal processing technologies.

Computing of temporal information in spiking neural networks with ReRAM synapses

Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks

Spiking Neural Network with RRAM: Can We Use It for Real-World Application?

Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses

Multicore Spiking Neuromorphic Chip in 180-nm with ReRAM Synapses and Digital Neurons

Improving Robustness of ReRAM-based Spiking Neural Network Accelerator with Stochastic Spike-timing-dependent-plasticity

ASTERS: Adaptable Threshold Spike-timing Neuromorphic Design with Twin-Column ReRAM Synapses

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

DenRAM: neuromorphic dendritic architecture with RRAM for efficient temporal processing with delays

A Spike Neuron Network Prototype Based on RRAM Array

Spiking Neurons with Neural Dynamics Implemented Using Stochastic Memristors

Machine Learning-Assisted Analysis of Advanced STDP for Neuromorphic Computing using MRAM

Dendritic Computation through Exploiting Resistive Memory as both Delays and Weights

Memristive neural network for on-line learning and tracking with brain-inspired spike timing dependent plasticity

Analysis and Simulation of Capacitor-Less ReRAM-Based Stochastic Neurons for the in-Memory Spiking Neural Network

Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

Energy Efficient RRAM Spiking Neural Network for Real Time Classification

A Software-equivalent SNN Hardware using RRAM-array for Asynchronous Real-time Learning

An Efficient Neuromorphic Implementation of Temporal Coding-Based On-Chip STDP Learning

Magnetic Tunnel Junction Based Long-Term Short-Term Stochastic Synapse for a Spiking Neural Network with On-Chip STDP Learning