Abstract:On-chip learning in a crossbar array based analog hardware Neural Network (NN) has been shown to have major advantages in terms of speed and energy compared to training NN on a traditional computer. However analog hardware NN proposals and implementations thus far have mostly involved Non Volatile Memory (NVM) devices like Resistive Random Access Memory (RRAM), Phase Change Memory (PCM), spintronic devices or floating gate transistors as synapses. Fabricating systems based on RRAM, PCM or spintronic devices need in-house laboratory facilities and cannot be done through merchant foundries, unlike conventional silicon based CMOS chips. Floating gate transistors need large voltage pulses for weight update, making on-chip learning in such systems energy inefficient. This paper proposes and implements through SPICE simulations on-chip learning in analog hardware NN using only conventional silicon based MOSFETs (without any floating gate) as synapses since they are easy to fabricate. We first model the synaptic characteristic of our single transistor synapse using SPICE circuit simulator and benchmark it against experimentally obtained current-voltage characteristics of a transistor. Next we design a Fully Connected Neural Network (FCNN) crossbar array using such transistor synapses. We also design analog peripheral circuits for neuron and synaptic weight update calculation, needed for on-chip learning, again using conventional transistors. Simulating the entire system on SPICE simulator, we obtain high training and test accuracy on the standard Fisher's Iris dataset, widely used in machine learning. We also compare the speed and energy performance of our transistor based implementation of analog hardware NN with some previous implementations of NN with NVM devices and show comparable performance with respect to on-chip learning.

Hardware implementation of an on-chip BP learning neural network with programmable neuron characteristics and learning rate adaptation

An On-Chip BP Learning Neural Network with Ideal Neuron Characteristics and Learning Rate Adaptation

A programmable on-chip BP learning neural network with enhanced neuron characteristics

Analogue Circuit Realization of a Programmable Sigmoidal Function and Its Derivative for On-Chip BP Learning

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

On-chip learning in a conventional silicon MOSFET based Analog Hardware Neural Network

Hardware Realization of Building Blocks for Artificial Neural Networks

A 45nm CMOS Neuromorphic Chip with a Scalable Architecture for Learning in Networks of Spiking Neurons

Programmable synapse analog CMOS neural network

An Area- and Energy-Efficient Spiking Neural Network with Spike-Time-Dependent Plasticity Realized with SRAM Processing-in-Memory Macro and On-Chip Unsupervised Learning.

CMOS Circuit Implementation of Spiking Neural Network for Pattern Recognition Using On-chip Unsupervised STDP Learning

Analog Spiking Neuron in CMOS 28 nm Towards Large-Scale Neuromorphic Processors

A 28nm Configurable Asynchronous SNN Accelerator with Energy-Efficient Learning

A Spike-Event-Based Neuromorphic Processor with Enhanced On-Chip STDP Learning in 28nm CMOS

A Neuromorphic-Hardware Oriented Bio-Plausible Online-Learning Spiking Neural Network Model.

A 64K-Neuron 64M-1b-Synapse 2.64pJ/SOP Neuromorphic Chip With All Memory on Chip for Spike-Based Models in 65nm CMOS

Highly efficient neuromorphic learning system of spiking neural network with multi-compartment leaky integrate-and-fire neurons

Sign backpropagation: An on-chip learning algorithm for analog RRAM neuromorphic computing systems

A CMOS Spiking Neuron for Brain-Inspired Neural Networks with Resistive Synapses and In-Situ Learning

Scalable NoC-based Neuromorphic Hardware Learning and Inference

Hardware implementation of backpropagation using progressive gradient descent for in situ training of multilayer neural networks