Abstract:Memristive crossbars have become a popular means for realizing unsupervised and supervised learning techniques. In previous neuromorphic architectures with leaky integrate-and-fire neurons, the crossbar itself has been separated from the neuron capacitors to preserve mathematical rigor. In this paper, we sought to design a simplified sparse coding circuit without this restriction, resulting in a fast circuit that approximated a sparse coding operation at a minimal loss in accuracy. We showed that connecting the neurons directly to the crossbar resulted in a more energy-efficient sparse coding architecture and alleviated the need to prenormalize receptive fields. This paper provides derivations for the design of such a network, named the simple spiking locally competitive algorithm, as well as CMOS designs and results on the CIFAR and MNIST data sets. Compared to a nonspiking, nonapproximate model which scored 33% on CIFAR-10 with a single-layer classifier, this hardware scored 32% accuracy. When used with a state-of-the-art deep learning classifier, the nonspiking model achieved 82% and our simplified, spiking model achieved 80% while compressing the input data by 92%. Compared to a previously proposed spiking model, our proposed hardware consumed 99% less energy to do the same work at 21 × the throughput. Accuracy held out with online learning to a write variance of 3%, suitable for the often reported 4-bit resolution required for neuromorphic algorithms, with offline learning to a write variance of 27%, and with read variance to 40%. The proposed architecture's excellent accuracy, throughput, and significantly lower energy usage demonstrate the utility of our innovations.

Gabor-like Image Filtering using a Neural Microcircuit

GaborNet: Gabor filters with learnable parameters in deep convolutional neural networks

A recurrent neural circuit in deblurs visual inputs

Image Edge Detector with Gabor Type Filters Using a Spiking Neural Network of Biologically Inspired Neurons

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

Analog electronic neural network circuits

Training a V1 Like Layer Using Gabor Filters in Convolutional Neural Networks

Compact Image Representation Model Based on Both Ncrf and Reverse Control Mechanisms

Construction and Application of a Neuromorphic Circuit With Excitatory and Inhibitory Post-Synaptic Conduction Channels Implemented Using Dual-Gate Thin-Film Transistors

A retina-inspired neurocomputing circuit for image representation

An evolutionary perspective on the design of neuromorphic shape filters

Analysis and Design of a Neural Chip Used for Binary Image Processing

Cortical circuitry implementing graphical models

Fast and Accurate Sparse Coding of Visual Stimuli With a Simple, Ultralow-Energy Spiking Architecture

A Biologically Inspired Neurocomputing Circuit for Image Representation

An error-propagation spiking neural network compatible with neuromorphic processors

Memristive system design for variable pixel G-neighbor denoising filter

Recurrent neural circuits for contour detection

A neural circuit model for nCRF's dynamic adjustment and its application on image representation

Computing Gabor Expansion Coefficients By Th Neural Network

The Positive and Random Impulse Noise Reduction Using Ann and Gaussian Recursive Filter