Abstract:Abstract Endowed with the superior computing speed and energy efficiency, optical neural networks (ONNs) have attracted ever-growing attention in recent years. Existing optical computing architectures are mainly single-channel due to the lack of advanced optical connection and interaction operators, solving simple tasks such as hand-written digit classification, saliency detection, etc. The limited computing capacity and scalability of single-channel ONNs restrict the optical implementation of advanced machine vision. Herein, we develop Monet: a multichannel optical neural network architecture for a universal multiple-input multiple-channel optical computing based on a novel projection-interference-prediction framework where the inter- and intra- channel connections are mapped to optical interference and diffraction. In our Monet, optical interference patterns are generated by projecting and interfering the multichannel inputs in a shared domain. These patterns encoding the correspondences together with feature embeddings are iteratively produced through the projection-interference process to predict the final output optically. For the first time, Monet validates that multichannel processing properties can be optically implemented with high-efficiency, enabling real-world intelligent multichannel-processing tasks solved via optical computing, including 3D/motion detections. Extensive experiments on different scenarios demonstrate the effectiveness of Monet in handling advanced machine vision tasks with comparative accuracy as the electronic counterparts yet achieving a ten-fold improvement in computing efficiency. For intelligent computing, the trends of dealing with real-world advanced tasks are irreversible. Breaking the capacity and scalability limitations of single-channel ONN and further exploring the multichannel processing potential of wave optics, we anticipate that the proposed technique will accelerate the development of more powerful optical AI as critical support for modern advanced machine vision.

An Integrated All-Optical Multimodal Learning Engine Built by Reconfigurable Phase-Change Meta-Atoms.

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

Multimodal In-Sensor Computing Implemented by Easily-Fabricated Oxide-Heterojunction Optoelectronic Synapses

Photonic neuromorphic architecture for tens-of-task lifelong learning

Reconfigurable Analog Computing Architecture Based on Planar Optical Waveguides

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Multimodal deep learning using on-chip diffractive optics with in situ training capability

All-Optical Computing Based on Convolutional Neural Networks

Amorphous gallium oxide homojunction-based optoelectronic synapse for multi-functional signal processing

Optical Neural Network with Complementary Decomposition to Overcome the Phase Insensitive Constrains

Self-learning photonic signal processor with an optical neural network chip

Device‐System End‐to‐End Design of Photonic Neuromorphic Processor Using Reinforcement Learning

A multichannel optical computing architecture for advanced machine vision

Device-system Co-design of Photonic Neuromorphic Processor using Reinforcement Learning

Chalcogenide phase-change devices for neuromorphic photonic computing

All-Optical Synapse with Directional Coupler Structure Based on Phase Change Material

Non-volatile and Reconfigurable On-Chip Optical Digital Neural Network Based on Sb2Se3-assisted Phase Shifters

All-Chalcogenide Programmable All-Optical Deep Neural Networks

Non-Volatile Reconfigurable Optical Digital Diffractive Neural Network Based on Phase Change Material