Abstract:Deep neural networks are the most in demand and popular for solving a wide range of problems in various fields of science and technology due to their learning ability. Increasing the number of layers in software implementation of deep neural networks (DNN) requires increased power consumption when working with big asynchronous data and becomes ineffective. To solve this problem, this study proposes a new approach to DNN design with on-chip training, based on the analog implementation of all computational operations, including matrix–vector multiplication in synaptic crossbar arrays, with digital implementation of synaptic weight setup and storage operations. The efficiency of the proposed approach is determined by the developed integrated synaptic CMOS IP block, which performs direct (without DAC) linear conversion of the binary code of the synaptic weight into the level of synaptic conductivity, as well as unified analog CMOS IP blocks with the ability to change the number of inputs and outputs. The paper presents the circuit diagrams, topology and results of SPICE modeling of CMOS IP blocks, as well as a description of the functional capabilities of the compiler, which allows using these IP blocks to synthesize functional circuits and topology of deep neural networks with specified parameters based on a neural network graph with training using the backpropagation method.

Method for implementing feedforward neural network by using digital and analog circuits

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

Analogue Implementation of A Neural Network Controller for Ups Inverter Applications

Analog electronic neural network circuits

Analogue Circuit Realization of a Programmable Sigmoidal Function and Its Derivative for On-Chip BP Learning

Analog/digital circuit simplification for Hopfield neural network

Automated design of deep neural networks with in-situ training architecture based on analog functional blocks

3D Image Recognition Technology for Analog Circuit Based on DSP and BP Algorithm

A programmable on-chip BP learning neural network with enhanced neuron characteristics

A method for analog circuits fault diagnosis by neural network and virtual instruments

Modeling Dynamic Feedforward Neural Networks with VHDL*

Hardware implementation of an on-chip BP learning neural network with programmable neuron characteristics and learning rate adaptation

Efficient Hardware Realizations of Feedforward Artificial Neural Networks

Training an Artificial Neural Network with Op-amp Integrators Based Analog Circuits

FPGA Implementation of Feed-Forward MLP Neural Networks

Application of neural networks for integrated circuit modeling

Programmable synapse analog CMOS neural network

Combinatorial Optimization Based Analog Circuit Fault Diagnosis with Back Propagation Neural Network

A Multilayer Feed Forward Small-World Neural Network Controller and Its Application on Electrohydraulic Actuation System.

A Single Layer Architecture to FPGA Implementation of BP Artificial Neural Network

Solving a Kind of Nonlinear Programming Problems Via Analog Neural Networks