Abstract:Scalable, high-capacity, and low-power computing architecture is the primary assurance for increasingly manifold and large-scale machine learning tasks. Traditional electronic artificial agents by conventional power-hungry processors have faced the issues of energy and scaling walls, hindering them from the sustainable performance improvement and iterative multi-task learning. Referring to another modality of light, photonic computing has been progressively applied in high-efficient neuromorphic systems. Here, we innovate a reconfigurable lifelong-learning optical neural network (L 2 ONN), for highly-integrated tens-of-task machine intelligence with elaborated algorithm-hardware co-design. Benefiting from the inherent sparsity and parallelism in massive photonic connections, L 2 ONN learns each single task by adaptively activating sparse photonic neuron connections in the coherent light field, while incrementally acquiring expertise on various tasks by gradually enlarging the activation. The multi-task optical features are parallelly processed by multi-spectrum representations allocated with different wavelengths. Extensive evaluations on free-space and on-chip architectures confirm that for the first time, L 2 ONN avoided the catastrophic forgetting issue of photonic computing, owning versatile skills on challenging tens-of-tasks (vision classification, voice recognition, medical diagnosis, etc.) with a single model. Particularly, L 2 ONN achieves more than an order of magnitude higher efficiency than the representative electronic artificial neural networks, and 14× larger capacity than existing optical neural networks while maintaining competitive performance on each individual task. The proposed photonic neuromorphic architecture points out a new form of lifelong learning scheme, permitting terminal/edge AI systems with light-speed efficiency and unprecedented scalability.

Temporal optical neurons for serial deep learning

High-speed serial deep learning through temporal optical neurons

Optical Analog Computing Devices Designed by Deep Neural Network

Deep learning with coherent VCSEL neural networks

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

High-throughput optical neural networks based on temporal computing

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Single-shot optical neural network

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

An Optical Neural Network Architecture based on Highly Parallelized WDM-Multiplier-Accumulator

Optical Neural Network Architecture for Deep Learning with Temporal Synthetic Dimension

Training large-scale optoelectronic neural networks with dual-neuron optical-artificial learning

All-optical spiking neurosynaptic networks with self-learning capabilities

Neural networks within multi-core optic fibers

Spatially Varying Nanophotonic Neural Networks

Single photonic perceptron based on a soliton crystal Kerr microcomb for high-speed, scalable, optical neural networks

Multimodal deep learning using on-chip diffractive optics with in situ training capability

Nanoprinted high-neuron-density optical linear perceptrons performing near-infrared inference on a CMOS chip

Optical neural networks: progress and challenges

Integrated Diffractive Optical Neural Network with Space-Time Interleaving

Photonic neuromorphic architecture for tens-of-task lifelong learning