Abstract:Scalable, high-capacity, and low-power computing architecture is the primary assurance for increasingly manifold and large-scale machine learning tasks. Traditional electronic artificial agents by conventional power-hungry processors have faced the issues of energy and scaling walls, hindering them from the sustainable performance improvement and iterative multi-task learning. Referring to another modality of light, photonic computing has been progressively applied in high-efficient neuromorphic systems. Here, we innovate a reconfigurable lifelong-learning optical neural network (L 2 ONN), for highly-integrated tens-of-task machine intelligence with elaborated algorithm-hardware co-design. Benefiting from the inherent sparsity and parallelism in massive photonic connections, L 2 ONN learns each single task by adaptively activating sparse photonic neuron connections in the coherent light field, while incrementally acquiring expertise on various tasks by gradually enlarging the activation. The multi-task optical features are parallelly processed by multi-spectrum representations allocated with different wavelengths. Extensive evaluations on free-space and on-chip architectures confirm that for the first time, L 2 ONN avoided the catastrophic forgetting issue of photonic computing, owning versatile skills on challenging tens-of-tasks (vision classification, voice recognition, medical diagnosis, etc.) with a single model. Particularly, L 2 ONN achieves more than an order of magnitude higher efficiency than the representative electronic artificial neural networks, and 14× larger capacity than existing optical neural networks while maintaining competitive performance on each individual task. The proposed photonic neuromorphic architecture points out a new form of lifelong learning scheme, permitting terminal/edge AI systems with light-speed efficiency and unprecedented scalability.

Fully forward mode training for optical neural networks

Forward-Forward Training of an Optical Neural Network

<i>In situ</i> optical backpropagation training of diffractive optical neural networks

Optical backpropagation training method and its applications

Training neural networks with end-to-end optical backpropagation

In Situ Optical Backpropagation Training of Diffractive Optical Neural Networks

Optical training of large-scale Transformers and deep neural networks with direct feedback alignment

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Training Optronic Convolutional Neural Networks on an Optical System Through Backpropagation Algorithms.

Optical neural network via loose neuron array and functional learning

Spatially Varying Nanophotonic Neural Networks

Photonic neuromorphic architecture for tens-of-task lifelong learning

All-Optical Computing Based on Convolutional Neural Networks

Photonic extreme learning machine by free-space optical propagation

Single chip photonic deep neural network with accelerated training

11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks

All-optical spiking neurosynaptic networks with self-learning capabilities

Fundamentals and recent developments of free-space optical neural networks

Multimodal deep learning using on-chip diffractive optics with in situ training capability

Space-efficient optical computing with an integrated chip diffractive neural network