Abstract:A novel convolutional processor is proposed using the shifted spectral response of a pair of arrayed waveguide gratings (AWGs) to mimic the kernel shifts during image convolution. This inherent mixing of inputs in the AWG's spectral response eliminates the need for repetitive element‐wise computations while enabling the simultaneous generation of convolved output maps. Convolutional neural networks are a powerful category of artificial neural networks that can extract features from raw data to provide greatly reduced parametric complexity and enhance pattern recognition and the accuracy of prediction. Optical neural networks offer the promise of dramatically accelerating computing speed while maintaining low power consumption even when using high‐speed data streams running at hundreds of gigabit/s. Here, we propose an optical convolutional processor (CP) that leverages the spectral response of an arrayed waveguide grating (AWG) to enhance convolution speed by eliminating the need for repetitive element‐wise multiplication. Our design features a balanced AWG configuration, enabling both positive and negative weightings essential for convolutional kernels. A proof‐of‐concept demonstration of an 8‐bit resolution processor is experimentally implemented using a pair of AWGs with a broadband Mach–Zehnder interferometer (MZI) designed to achieve uniform weighting across the whole spectrum. Experimental results demonstrate the CP's effectiveness in edge detection and achieved 96% accuracy in a convolutional neural network for MNIST recognition. This approach can be extended to other common operations, such as pooling and deconvolution in Generative Adversarial Networks. It is also scalable to more complex networks, making it suitable for applications like autonomous vehicles and real‐time video recognition.

High-Speed Optical Convolutional Neural Network Accelerator with 100 Gbaud EO-polymer/Si Hybrid Optical Modulator

High-Performance Optical Convolutional Neural Network Accelerator with High-Speed Optical Modulator and Carrier-Injection-Type Attenuator

11 TOPS photonic convolutional accelerator for optical neural networks

11 Tera-OPs/s Photonic Convolutional Accelerator and Deep Optical Neural Network Based on an Integrated Kerr Soliton Crystal Microcomb

11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks

Optical-electronic Hybrid Fourier Convolutional Neural Network Based on Super-Pixel Complex-Valued Modulation

High Throughput Multi-Channel Parallelized Diffraction Convolutional Neural Network Accelerator

An Optical Neural Network Architecture based on Highly Parallelized WDM-Multiplier-Accumulator

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Optical Convolutional Neural Network with WDM-Based Optical Patching and Microring Weighting Banks

Direct Optical Convolution Computing Based on Arrayed Waveguide Grating Router

High-accuracy optical convolution unit architecture for convolutional neural networks by cascaded acousto-optical modulator arrays

Optical Convolutional Neural Network Based on an Amplitude Modulation Spatial Light Modulator and a 4-Level Phase Plate

Optical neuromorphic processing at Tera-OP/s speeds based on Kerr soliton crystal microcombs

OECS: A Novel Deep Convolutional Neural Network Accelerator Based on 3D Hybrid Optical-Electrical NoC

Photonic Neural Activation Function Based on High-Speed Electro-Absorption Modulated Laser

Accelerating Convolutional Processing by Harnessing Channel Shifts in Arrayed Waveguide Gratings

High-performance Optoelectronics for Integrated Photonic Neural Networks

High‐Throughput Multichannel Parallelized Diffraction Convolutional Neural Network Accelerator

Multi-layer Optical Convolutional Neural Network with Nonlinear Activation

Deep Neural Network Enhanced Chip-on-board Hybrid-Packaged Photonic-Electrical Silicon Transceiver for High-speed Optical Interconnects