Abstract:Edholm's Law predicts exponential growth in data rate and spectrum bandwidth for communications and is forecasted to remain true for the upcoming deployment of 6G. Compounding this issue is the exponentially increasing demand for deep neural network (DNN) compute, including DNNs for signal processing. However, the slowing of Moore's Law due to the limitations of transistor-based electronics means that completely new paradigms for computing will be required to meet these increasing demands for advanced communications. Optical neural networks (ONNs) are promising DNN accelerators with ultra-low latency and energy consumption. Yet state-of-the-art ONNs struggle with scalability and implementing linear with in-line nonlinear operations. Here we introduce our multiplicative analog frequency transform ONN (MAFT-ONN) that encodes the data in the frequency domain, achieves matrix-vector products in a single shot using photoelectric multiplication, and uses a single electro-optic modulator for the nonlinear activation of all neurons in each layer. We experimentally demonstrate the first hardware accelerator that computes fully-analog deep learning on raw RF signals, performing single-shot modulation classification with 85% accuracy, where a 'majority vote' multi-measurement scheme can boost the accuracy to 95% within 5 consecutive measurements. In addition, we demonstrate frequency-domain finite impulse response (FIR) linear-time-invariant (LTI) operations, enabling a powerful combination of traditional and AI signal processing. We also demonstrate the scalability of our architecture by computing nearly 4 million fully-analog multiplies-and-accumulates for MNIST digit classification. Our latency estimation model shows that due to the Shannon capacity-limited analog data movement, MAFT-ONN is hundreds of times faster than traditional RF receivers operating at their theoretical peak performance.

Analog Deep Neural Network Based On Nor Flash Computing Array For High Speed/Energy Efficiency Computation

Hardware Implementation of Energy Efficient Deep Learning Neural Network Based on Nanoscale Flash Computing Array

DaDianNao: A Machine-Learning Supercomputer

AnalogNet: Convolutional Neural Network Inference on Analog Focal Plane Sensor Processors

Flash Memory Array for Efficient Implementation of Deep Neural Networks

AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing

High-Throughput In-Memory Computing for Binary Deep Neural Networks with Monolithically Integrated RRAM and 90nm CMOS

Specific ADC of NVM-Based Computation-in-Memory for Deep Neural Networks

Efficient and Robust Spike-Driven Deep Convolutional Neural Networks Based on NOR Flash Computing Array

AICNN: Implementing Typical CNN Algorithms with Analog-to-Information Conversion Architecture

Neural Synaptic Plasticity-Inspired Computing: A High Computing Efficient Deep Convolutional Neural Network Accelerator

Equivalent-accuracy accelerated neural-network training using analogue memory

Improving the accuracy of neural networks in analog computing-in-memory systems by analog weight.

Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine

RF-Photonic Deep Learning Processor with Shannon-Limited Data Movement

Special Topic on Nonvolatile Memory for Efficient Implementation of Neural/Neuromorphic Computing

FPGA Based Implementation of Deep Neural Networks Using On-chip Memory Only

Spatial-Temporal Hybrid Neural Network With Computing-in-Memory Architecture

An Analog-Memoryless Near Sensor Computing Architecture for Always-On Intelligent Perception Applications

A Low-Latency DNN Accelerator Enabled by DFT-Based Convolution Execution Within Crossbar Arrays

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware