Abstract:Optical convolution computing is gaining traction owing to its inherent parallelism, multi-dimensional processing, and energy efficiency. To handle input dimensions of N, conventional implementations necessitate N2 optical elements, such as Mach-Zehnder interferometers or micro-ring resonators, to process multiply-accumulate (MAC) operations, limiting scalability and resulting in elevated power consumption. Here, a direct convolution computing method based on wavelength routing, utilizing the unique sliding property of an arrayed waveguide grating router (AWGR) to perform the sliding window operation of the convolution in the wavelength-space domains is proposed. With two input vectors directly loaded onto two modulator arrays, the convolution result is instantaneously produced at a photodetector array. The entire convolution computation is executed within a single clock cycle without the need for preprocessing or decomposition into elementary MAC operations. The number of active elements is minimal, only needed for input/output. The proposed optical convolution unit has striking advantages of high scalability, high speed, and processing simplicity compared to those based on optical matrix-vector multipliers. In the first experimental demonstration, a remarkable classification accuracy of up to 98.2% in handwritten digit recognition tasks using a LeNet-5 neural network is achieved. A direct convolution computing method based on wavelength routing, utilizing the unique sliding property of an arrayed waveguide grating router (AWGR) to perform the sliding window operation of the convolution in the wavelength-space domains is proposed and demonstrated. With two inputs vectors directly loaded onto modulator arrays, the convolution result is instantaneously produced at a photodetector array. image

Optical Convolutional Neural Networks -- Combining Silicon Photonics and Fourier Optics for Computer Vision

Optical Convolution Based Computational Method for Low-Power Image Processing

Optical-electronic Hybrid Fourier Convolutional Neural Network Based on Super-Pixel Complex-Valued Modulation

11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

11 Tera-OPs/s Photonic Convolutional Accelerator and Deep Optical Neural Network Based on an Integrated Kerr Soliton Crystal Microcomb

Towards On-Chip Optical FFTs for Convolutional Neural Networks

11 TOPS photonic convolutional accelerator for optical neural networks

A Winograd-based Integrated Photonics Accelerator for Convolutional Neural Networks

High Throughput Multi-Channel Parallelized Diffraction Convolutional Neural Network Accelerator

Optical neuromorphic processing at Tera-OP/s speeds based on Kerr soliton crystal microcombs

Design and testing of silicon photonic 4F system for convolutional neural networks

Sophisticated Deep Learning with On-Chip Optical Diffractive Tensor Processing

High-accuracy optical convolution unit architecture for convolutional neural networks by cascaded acousto-optical modulator arrays

Photonic Convolution Neural Network Based on Interleaved Time-Wavelength Modulation

Optical neuromorphic processing with soliton crystal Kerr microcombs: Scaling the network in size and speed

An Optical Frontend for a Convolutional Neural Network

Diffraction‐Driven Parallel Convolution Processing with Integrated Photonics

Integrated Photonic FFT for Optical Convolutions towards Efficient and High-Speed Neural Networks

A Convolution Neural Network Implemented by Three 3 × 3 Photonic Integrated Reconfigurable Linear Processors

Direct Optical Convolution Computing Based on Arrayed Waveguide Grating Router