Abstract:A time-domain analog-weighted-sum calculation model based on a pulse-width modulation (PWM) approach is proposed. The proposed calculation model can be applied to any types of network structure including multi-layer feedforward networks. We also propose very large-scale integrated (VLSI) circuits to implement the proposed model. Unlike the conventional analog voltage or current mode circuits used in computing-in-memory circuits, our time-domain analog circuits use transient operation in charging/discharging processes to capacitors. Since the circuits can be designed without operational amplifiers, they can be operated with extremely low power consumption. However, they have to use very high-resistance devices, on the order of giga-ohms. We designed a CMOS VLSI chip to verify weighted-sum operation based on the proposed model with binary weights, which realizes the BinaryConnect model. In the chip, memory cells of static-random-access memory (SRAM) are used for synaptic connection weights. High-resistance operation was realized by using the subthreshold operation region of MOS transistors unlike the ordinary computing-in-memory circuits. The chip was designed and fabricated using a 250-nm fabrication technology. Measurement results showed that energy efficiency for the weighted-sum calculation was 300~TOPS/W (Tera-Operations Per Second per Watt), which is more than one order of magnitude higher than that in state-of-the-art digital AI processors, even though the minimum width of interconnection used in this chip was several times larger than that in such digital processors. If state-of-the-art VLSI technology is used to implement the proposed model, an energy efficiency of more than 1,000~TOPS/W will be possible. For practical applications, development of emerging analog memory devices such as ferroelectric-gate field effect transistors (FeFETs) is necessary.

Prospects for Analog Circuits in Deep Networks

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

Analog architectures for neural network acceleration based on non-volatile memory

The Promise of Analog Deep Learning: Recent Advances, Challenges and Opportunities

Cases for Analog Mixed Signal Computing Integrated Circuits for Deep Neural Networks

AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing

On the Accuracy of Analog Neural Network Inference Accelerators

Analog circuits for mixed-signal neuromorphic computing architectures in 28 nm FD-SOI technology

Analog electronic neural network circuits

Ultra-Low Power Silicon Neuron Circuit for Extreme-Edge Neuromorphic Intelligence

A Heterogeneous and Programmable Compute-In-Memory Accelerator Architecture for Analog-AI Using Dense 2-D Mesh

Leveraging Bit-Serial Architectures for Hardware-Oriented Deep Learning Accelerators with Column-Buffering Dataflow

Automated design of deep neural networks with in-situ training architecture based on analog functional blocks

A Review of Machine Learning Techniques in Analog Integrated Circuit Design Automation

An Energy-efficient Time-domain Analog VLSI Neural Network Processor Based on a Pulse-width Modulation Approach

Mem-elements based Neuromorphic Hardware for Neural Network Application

A Time-domain Analog Weighted-sum Calculation Model for Extremely Low Power VLSI Implementation of Multi-layer Neural Networks

Multiscale Co-Design Analysis of Energy, Latency, Area, and Accuracy of a ReRAM Analog Neural Training Accelerator

Accelerating Deep Neural Networks in Processing-in-Memory Platforms: Analog or Digital Approach?

Efficient Hardware Optimization Strategies For Deep Neural Networks Acceleration Chip

Towards training digitally-tied analog blocks via hybrid gradient computation