Abstract:On-chip learning in a crossbar array based analog hardware Neural Network (NN) has been shown to have major advantages in terms of speed and energy compared to training NN on a traditional computer. However analog hardware NN proposals and implementations thus far have mostly involved Non Volatile Memory (NVM) devices like Resistive Random Access Memory (RRAM), Phase Change Memory (PCM), spintronic devices or floating gate transistors as synapses. Fabricating systems based on RRAM, PCM or spintronic devices need in-house laboratory facilities and cannot be done through merchant foundries, unlike conventional silicon based CMOS chips. Floating gate transistors need large voltage pulses for weight update, making on-chip learning in such systems energy inefficient. This paper proposes and implements through SPICE simulations on-chip learning in analog hardware NN using only conventional silicon based MOSFETs (without any floating gate) as synapses since they are easy to fabricate. We first model the synaptic characteristic of our single transistor synapse using SPICE circuit simulator and benchmark it against experimentally obtained current-voltage characteristics of a transistor. Next we design a Fully Connected Neural Network (FCNN) crossbar array using such transistor synapses. We also design analog peripheral circuits for neuron and synaptic weight update calculation, needed for on-chip learning, again using conventional transistors. Simulating the entire system on SPICE simulator, we obtain high training and test accuracy on the standard Fisher's Iris dataset, widely used in machine learning. We also compare the speed and energy performance of our transistor based implementation of analog hardware NN with some previous implementations of NN with NVM devices and show comparable performance with respect to on-chip learning.

Analog electronic neural network circuits

Prospects for Analog Circuits in Deep Networks

Artificial Neural Microcircuits as Building Blocks: Concept and Challenges

Automated design of deep neural networks with in-situ training architecture based on analog functional blocks

Machine learning without a processor: Emergent learning in a nonlinear analog network

A New Hybrid Neural System Interfacing Neurons and Silicon Hardware for Fast Signal Recognition

VLSI implementation of a neural network model

The prospects for analogue neural VLSI

Hardware Realization of Building Blocks for Artificial Neural Networks

Is my Neural Network Neuromorphic? Taxonomy, Recent Trends and Future Directions in Neuromorphic Engineering

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

Implementation Of MNIST Dataset Learning Using Analog Circuit

Neuromorphic electronic circuits for building autonomous cognitive systems

Computational Investigation of the Potential and Limitations of Machine Learning with Neural Network Circuits Based on Synaptic Transistors

KirchhoffNet: A Scalable Ultra Fast Analog Neural Network

Energy-based analog neural network framework

Construction and Application of a Neuromorphic Circuit With Excitatory and Inhibitory Post-Synaptic Conduction Channels Implemented Using Dual-Gate Thin-Film Transistors

Using Artificial Neural Networks for Analog Integrated Circuit Design Automation

Method for implementing feedforward neural network by using digital and analog circuits

On-chip learning in a conventional silicon MOSFET based Analog Hardware Neural Network

The Promise of Analog Deep Learning: Recent Advances, Challenges and Opportunities