Abstract:A novel convolutional processor is proposed using the shifted spectral response of a pair of arrayed waveguide gratings (AWGs) to mimic the kernel shifts during image convolution. This inherent mixing of inputs in the AWG's spectral response eliminates the need for repetitive element‐wise computations while enabling the simultaneous generation of convolved output maps. Convolutional neural networks are a powerful category of artificial neural networks that can extract features from raw data to provide greatly reduced parametric complexity and enhance pattern recognition and the accuracy of prediction. Optical neural networks offer the promise of dramatically accelerating computing speed while maintaining low power consumption even when using high‐speed data streams running at hundreds of gigabit/s. Here, we propose an optical convolutional processor (CP) that leverages the spectral response of an arrayed waveguide grating (AWG) to enhance convolution speed by eliminating the need for repetitive element‐wise multiplication. Our design features a balanced AWG configuration, enabling both positive and negative weightings essential for convolutional kernels. A proof‐of‐concept demonstration of an 8‐bit resolution processor is experimentally implemented using a pair of AWGs with a broadband Mach–Zehnder interferometer (MZI) designed to achieve uniform weighting across the whole spectrum. Experimental results demonstrate the CP's effectiveness in edge detection and achieved 96% accuracy in a convolutional neural network for MNIST recognition. This approach can be extended to other common operations, such as pooling and deconvolution in Generative Adversarial Networks. It is also scalable to more complex networks, making it suitable for applications like autonomous vehicles and real‐time video recognition.

Accelerating Convolutional Processing by Harnessing Channel Shifts in Arrayed Waveguide Gratings

Direct Optical Convolution Computing Based on Arrayed Waveguide Grating Router

Optical Convolution Based Computational Method for Low-Power Image Processing

Parallel Photonic Convolutional Processing On-Chip with Cross-Connect Architecture and Cyclic AWGs

High Throughput Multi-Channel Parallelized Diffraction Convolutional Neural Network Accelerator

Redundancy-free integrated optical convolver for optical neural networks based on arrayed waveguide grating

11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks

Towards On-Chip Optical FFTs for Convolutional Neural Networks

11 TOPS photonic convolutional accelerator for optical neural networks

Compact optical convolution processing unit based on multimode interference

High‐Resolution Optical Convolutional Neural Networks Using Phase‐Change Material‐Based Microring Hybrid Waveguides

Parallel Photonic Acceleration Processor for Matrix-Matrix Multiplication

11 Tera-OPs/s Photonic Convolutional Accelerator and Deep Optical Neural Network Based on an Integrated Kerr Soliton Crystal Microcomb

Integrated Photonic FFT for Optical Convolutions towards Efficient and High-Speed Neural Networks

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Diffraction‐Driven Parallel Convolution Processing with Integrated Photonics

Performance evaluation of an integrated photonic convolutional neural network based on delay buffering and wavelength division multiplexing

A Winograd-based Integrated Photonics Accelerator for Convolutional Neural Networks

An Energy-Efficient Convolutional Neural Network Processor Architecture Based on a Systolic Array

A Convolution Neural Network Implemented by Three 3 x 3 Photonic Integrated Reconfigurable Linear Processors

Optical neuromorphic processing at Tera-OP/s speeds based on Kerr soliton crystal microcombs