Abstract:Abstract Endowed with the superior computing speed and energy efficiency, optical neural networks (ONNs) have attracted ever-growing attention in recent years. Existing optical computing architectures are mainly single-channel due to the lack of advanced optical connection and interaction operators, solving simple tasks such as hand-written digit classification, saliency detection, etc. The limited computing capacity and scalability of single-channel ONNs restrict the optical implementation of advanced machine vision. Herein, we develop Monet: a multichannel optical neural network architecture for a universal multiple-input multiple-channel optical computing based on a novel projection-interference-prediction framework where the inter- and intra- channel connections are mapped to optical interference and diffraction. In our Monet, optical interference patterns are generated by projecting and interfering the multichannel inputs in a shared domain. These patterns encoding the correspondences together with feature embeddings are iteratively produced through the projection-interference process to predict the final output optically. For the first time, Monet validates that multichannel processing properties can be optically implemented with high-efficiency, enabling real-world intelligent multichannel-processing tasks solved via optical computing, including 3D/motion detections. Extensive experiments on different scenarios demonstrate the effectiveness of Monet in handling advanced machine vision tasks with comparative accuracy as the electronic counterparts yet achieving a ten-fold improvement in computing efficiency. For intelligent computing, the trends of dealing with real-world advanced tasks are irreversible. Breaking the capacity and scalability limitations of single-channel ONN and further exploring the multichannel processing potential of wave optics, we anticipate that the proposed technique will accelerate the development of more powerful optical AI as critical support for modern advanced machine vision.

Neuromorphic computing using wavelength-division multiplexing

Neuromorphic Computing Based on Wavelength-Division Multiplexing

Photonic Multiplexing Techniques for Neuromorphic Computing

Multi-dimensional optical neural network

Advances and Marine Applications of Optical Neural Network

Slimmed optical neural networks with multiplexed neuron sets and a corresponding backpropagation training algorithm

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Optical neural networks: progress and challenges

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

An Optical Neural Network Architecture based on Highly Parallelized WDM-Multiplier-Accumulator

Photonic Neural Networks and Its Applications

Multi-Wavelength Photonic Neuromorphic Computing for Intra and Inter-Channel Distortion Compensations in WDM Optical Communication Systems

Single photonic perceptron based on a soliton crystal Kerr microcomb for high-speed, scalable, optical neural networks

Deep learning with coherent VCSEL neural networks

Space-efficient optical computing with an integrated chip diffractive neural network

Optical neuromorphic processing at Tera-OP/s speeds based on Kerr soliton crystal microcombs

Photonic single perceptron at Giga-OP/s speeds with Kerr microcombs for scalable optical neural networks

Digital-analog hybrid matrix multiplication processor for optical neural networks

A multichannel optical computing architecture for advanced machine vision

Photonic neuromorphic architecture for tens-of-task lifelong learning

High-performance Optoelectronics for Integrated Photonic Neural Networks