Abstract:Abstract The rapid development of information technology has fueled an ever-increasing demand for ultrafast and ultralow-energy-consumption computing. Existing computing instruments are pre-dominantly electronic processors. The scaling of computing speed is limited not only by data transfer between memory and processing units, but also by RC delay associated with integrated circuits. Using photons as information carriers is a promising alternative. Here, we report a strategy to realize ultrafast and ultralow-energy-consumption all-optical computing based on convolutional neural networks, leveraging entirely linear optical interactions. The device is constructed from cascaded silicon Y-shaped waveguides with side-coupled silicon waveguide segments to enable complete phase and amplitude control in each waveguide branch. The generic device concept can be used for equation solving, multifunctional logic operation, Fourier transformation, series expanding and encoding, as well as many other mathematical operations. Multiple computing functions were experimentally demonstrated to validate all-optical computing performances. The time-of-flight of light through the network structure corresponds to an ultrafast computing time of the order of several picoseconds with an ultralow energy consumption of dozens of femtojoules per bit. Our approach can be further expanded to fulfill other complex computing tasks based on non-von Neumann architectures and thus paves a new way for on-chip all-optical computing.

Optical convolutional neural network with atomic nonlinearity

Free-space optical neural network based on thermal atomic nonlinearity

Lensless Opto-Electronic Neural Network with Quantum Dot Nonlinear Activation

Lensless opto-electronic neural network with quantum dots nonlinear activation

Programmable low-threshold optical nonlinear activation functions for photonic neural networks

All-optical neural network with nonlinear activation functions

Optical-electronic Hybrid Fourier Convolutional Neural Network Based on Super-Pixel Complex-Valued Modulation

Optical Nonlinear Activation Functions Based on MZI-Structure for Optical Neural Networks

All-Optical Computing Based on Convolutional Neural Networks

Dual Optical Frequency Comb Neuron: Co-Developing Hardware and Algorithm

Efficient Nonlinear Activation Function in Optical Neural Network

Inverse-designed Integrated All-optical Nonlinear Activators for Optical Computing

Multi-layer Optical Convolutional Neural Network with Nonlinear Activation

Optical Neural Network with Complementary Decomposition to Overcome the Phase Insensitive Constrains

Nonlinear Processing with Linear Optics

Compact optical convolution processing unit based on multimode interference

An Optical Frontend for a Convolutional Neural Network

Experimental Realization of Arbitrary Activation Functions for Optical Neural Networks

Multiplexable all-optical nonlinear activator for optical computing

All‐Optical Nonlinear Neuron Based on Metallic Quantum Wells

11 TOPS photonic convolutional accelerator for optical neural networks