Abstract:The energy consumption of training and deploying state-of-the-art artificial intelligence (AI) models has experienced exponential growth, driven by increasing model parameters and the necessary training data. Recent models demand over 1 billion PetaFLOPs of total computation for training, potentially taking weeks to complete. With current GPU performance at approximately 1-3 TOPS/W, GPU training energy consumption alone can exceed 100,000 kWh, equivalent to the monthly energy expenditure of 100 US households. Over the next decade, these models are expected to scale up further, driving total computing energy to constitute a significant portion of global consumption. In this talk, we describe both synaptic and neuronal devices that can accelerate AI algorithms with potentially multiple orders of magnitude improvement in power efficiency. First, we describe an oscillatory retinal neuron (ORN) that directly converts incident DC light into voltage spikes. Coupled arrays of this device result in an imager that carries out in-sensor processing while capturing an image. Uniquely, the conversion from input light to output voltage spikes occurs without external power. When coupled in arrays, the neighboring neurons interact with each other to influence the spiking frequency spectrum. This allows the arrays to carry out frequency multiplexed computation on an input image. It is shown that this approach can achieve>20,000 TOPS/W, multiple orders of magnitude greater than the current approaches. Theory and simulation is used to elucidate how coupled ORNs carry out computation on an input image. When coupled, each output frequency band encodes a unique computation on the input image. By tuning the coupling impedances and the frequency bands, user defined computations can be carried out on the input. We experimentally show that this can be carried out with a 3x3 array that demonstrates simultaneous edge detection, intensity filtering, image segmentation and other functions. This hardware is then used to demonstrate improvement in MNIST handwritten digit classification accuracy over a traditional imager connected to a fully connected network. Next, we describe spiking synaptic devices that can be directly fabricated in the back-end of line of CMOS devices. These devices consist of an InP transistor channel with an engineered gate stack. Using a uniform gate insulator, we can demonstrate behaviors of biological synapses, such as potentiation, depression, spike number dependent plasticity, and spike timing dependent plasticity. By introducing a heterostructured gate insulator, it is shown that short-term to long-term memory transitions can be designed into the device. Finally, by using a transparent gate, an in-sensor synaptic phototransistor is demonstrated and the performance of these devices at a system level is demonstrated.

The Artificial Neuron: Built From Nanosheet Transistors to Achieve Ultra Low Power Consumption

Ultralow Power Consumption and Large Dynamic Range Synaptic Transistor Based on Α-In2se3 Nanosheets

A Compact Artificial Spiking Neuron Using a Sharp-Switching FET with Ultra-Low Energy Consumption Down to 0.45 Fj/spike

Subthreshold CMOS Implementation of the Izhikevich Neuron Model

Design of Artificial Neuron Network with Synapse Utilizing Hybrid CMOS Transistors with Memristor for Low Power Applications

Design and Performance Analysis of an Ultra-Low Power Integrate-and-Fire Neuron Circuit Using Nanoscale Side-contacted Field Effect Diode Technology

CMOS-based area-and-power-efficient neuron and synapse circuits for time-domain analog spiking neural networks

Spintronic Neuron Using a Magnetic Tunnel Junction for Low-Power Neuromorphic Computing

Ultra-Low Power Silicon Neuron Circuit for Extreme-Edge Neuromorphic Intelligence

Implementation of a Spiking Neuron in CMOS

(Invited) Nanoscale Devices for Accelerating AI Algorithms

A 5.3 pJ/Spike CMOS Neural Array Employing Time-Modulated Axon-Sharing and Background Mismatch Calibration Techniques

One Transistor One Electrolyte‐Gated Transistor Based Spiking Neural Network for Power‐Efficient Neuromorphic Computing System

Band-to-Band Tunneling based Ultra-Energy Efficient Silicon Neuron

Compact Digital-Controlled Neuromorphic Circuit with Low Power Consumption

1T Spiking Neuron Using Ferroelectric Junctionless FET with Ultra-Low Energy Consumption of 24 aJ/Spike

Ultra-Low-Power Compact Neuron Circuit with Tunable Spiking Frequency and High Robustness in 22 Nm FDSOI

Quantum Tunneling Based Ultra-Compact and Energy Efficient Spiking Neuron Enables Hardware SNN

Electrospun InSnMgO Nanofibers Channel to Construct 3D Interface in a Synaptic Transistor for Neuromorphic Electronics

AGN: A Power-Adaptive and Growth-Capable Neuron Model and Circuit Implementation

Analog Spiking Neuron in 28 nm CMOS