Abstract:Optical convolution computing is gaining traction owing to its inherent parallelism, multi-dimensional processing, and energy efficiency. To handle input dimensions of N, conventional implementations necessitate N2 optical elements, such as Mach-Zehnder interferometers or micro-ring resonators, to process multiply-accumulate (MAC) operations, limiting scalability and resulting in elevated power consumption. Here, a direct convolution computing method based on wavelength routing, utilizing the unique sliding property of an arrayed waveguide grating router (AWGR) to perform the sliding window operation of the convolution in the wavelength-space domains is proposed. With two input vectors directly loaded onto two modulator arrays, the convolution result is instantaneously produced at a photodetector array. The entire convolution computation is executed within a single clock cycle without the need for preprocessing or decomposition into elementary MAC operations. The number of active elements is minimal, only needed for input/output. The proposed optical convolution unit has striking advantages of high scalability, high speed, and processing simplicity compared to those based on optical matrix-vector multipliers. In the first experimental demonstration, a remarkable classification accuracy of up to 98.2% in handwritten digit recognition tasks using a LeNet-5 neural network is achieved. A direct convolution computing method based on wavelength routing, utilizing the unique sliding property of an arrayed waveguide grating router (AWGR) to perform the sliding window operation of the convolution in the wavelength-space domains is proposed and demonstrated. With two inputs vectors directly loaded onto modulator arrays, the convolution result is instantaneously produced at a photodetector array. image

High-Performance Optical Convolutional Neural Network Accelerator with High-Speed Optical Modulator and Carrier-Injection-Type Attenuator

High-Speed Optical Convolutional Neural Network Accelerator with 100 Gbaud EO-polymer/Si Hybrid Optical Modulator

11 TOPS photonic convolutional accelerator for optical neural networks

Optical Convolution Based Computational Method for Low-Power Image Processing

11 Tera-OPs/s Photonic Convolutional Accelerator and Deep Optical Neural Network Based on an Integrated Kerr Soliton Crystal Microcomb

11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks

An Optical Neural Network Architecture based on Highly Parallelized WDM-Multiplier-Accumulator

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

High Throughput Multi-Channel Parallelized Diffraction Convolutional Neural Network Accelerator

Optical-electronic Hybrid Fourier Convolutional Neural Network Based on Super-Pixel Complex-Valued Modulation

Performance evaluation of an integrated photonic convolutional neural network based on delay buffering and wavelength division multiplexing

Multi-layer Optical Convolutional Neural Network with Nonlinear Activation

High-accuracy optical convolution unit architecture for convolutional neural networks by cascaded acousto-optical modulator arrays

Direct Optical Convolution Computing Based on Arrayed Waveguide Grating Router

Optical neuromorphic processing at Tera-OP/s speeds based on Kerr soliton crystal microcombs

Optical Multi-Imaging-Casting Accelerator for Fully Parallel Universal Convolution Computing

Sophisticated Deep Learning with On-Chip Optical Diffractive Tensor Processing

High‐Throughput Multichannel Parallelized Diffraction Convolutional Neural Network Accelerator

Compact optical convolution processing unit based on multimode interference

Compressed Meta-Optical Encoder for Image Classification

Photonic Convolution Neural Network Based on Interleaved Time-Wavelength Modulation