Abstract:Ever-growing deep-learning technologies are making revolutionary changes for modern life.However,conventional computing architectures are designed to process sequential and digital programs but are burdened with performing massive parallel and adaptive deep-learning applications.Photonic integrated circuits provide an efficient approach to mitigate bandwidth limitations and the power-wall brought on by its electronic counterparts,showing great potential in ultrafast and energy-free high-performance computation.Here,we propose an optical computing ar-chitecture enabled by on-chip diffraction to implement convolutional acceleration,termed"optical convolution unit"(OCU).We demonstrate that any real-valued convolution kernels can be exploited by the OCU with a promi-nent computational throughput boosting via the concept of structral reparameterization.With the OCU as the fundamental unit,we build an optical convolutional neural network(oCNN)to implement two popular deep learn-ing tasks:classification and regression.For classification,Fashion Modified National Institute of Standards and Technology(Fashion-MNIST)and Canadian Institute for Advanced Research(CIFAR-4)data sets are tested with accuracies of 91.63％and 86.25％,respectively.For regression,we build an optical denoising convolutional neural network to handle Gaussian noise in gray-scale images with noise level σ=10,15,and 20,resulting in clean images with an average peak signal-to-noise ratio(PSNR)of 31.70,29.39,and 27.72 dB,respectively.The proposed OCU presents remarkable performance of low energy consumption and high information density due to its fully passive nature and compact footprint,providing a parallel while lightweight solution for future compute-in-memory architecture to handle high dimensional tensors in deep learning.

Optoelectronic Convolutional Neural Networks Based on Time-Stretch Method

Electro-Optical Neural Networks Based on Time-Stretch Method

Optical Convolution Based Computational Method for Low-Power Image Processing

Optical Convolutional Neural Network Based on an Amplitude Modulation Spatial Light Modulator and a 4-Level Phase Plate

Optical-electronic Hybrid Fourier Convolutional Neural Network Based on Super-Pixel Complex-Valued Modulation

Convolutional Neural Network Based Computational Imaging Spectroscopy

Multilayer Optoelectronic Hybrid Convolutional Neural Network with an Optical 4F-System Recurrent Structure

Optronic Convolutional Neural Networks of Multi-Layers with Different Functions Executed in Optics for Image Classification.

Optical patching scheme for optical convolutional neural networks based on wavelength-division multiplexing and optical delay lines

Photonic Convolution Neural Network Based on Interleaved Time-Wavelength Modulation

Optical Neural Networks of Handwriting Recognition Using Optical Scattering Unit System

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks

11 TOPS photonic convolutional accelerator for optical neural networks

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

OP-FCNN: an Optronic Fully Convolutional Neural Network for Imaging Through Scattering Media.

11 Tera-OPs/s Photonic Convolutional Accelerator and Deep Optical Neural Network Based on an Integrated Kerr Soliton Crystal Microcomb

Multi-layer Optical Convolutional Neural Network with Nonlinear Activation

Compressed Meta-Optical Encoder for Image Classification

Optical Convolutional Neural Network with WDM-Based Optical Patching and Microring Weighting Banks

Sophisticated Deep Learning with On-Chip Optical Diffractive Tensor Processing