Abstract:Scalable, high-capacity, and low-power computing architecture is the primary assurance for increasingly manifold and large-scale machine learning tasks. Traditional electronic artificial agents by conventional power-hungry processors have faced the issues of energy and scaling walls, hindering them from the sustainable performance improvement and iterative multi-task learning. Referring to another modality of light, photonic computing has been progressively applied in high-efficient neuromorphic systems. Here, we innovate a reconfigurable lifelong-learning optical neural network (L 2 ONN), for highly-integrated tens-of-task machine intelligence with elaborated algorithm-hardware co-design. Benefiting from the inherent sparsity and parallelism in massive photonic connections, L 2 ONN learns each single task by adaptively activating sparse photonic neuron connections in the coherent light field, while incrementally acquiring expertise on various tasks by gradually enlarging the activation. The multi-task optical features are parallelly processed by multi-spectrum representations allocated with different wavelengths. Extensive evaluations on free-space and on-chip architectures confirm that for the first time, L 2 ONN avoided the catastrophic forgetting issue of photonic computing, owning versatile skills on challenging tens-of-tasks (vision classification, voice recognition, medical diagnosis, etc.) with a single model. Particularly, L 2 ONN achieves more than an order of magnitude higher efficiency than the representative electronic artificial neural networks, and 14× larger capacity than existing optical neural networks while maintaining competitive performance on each individual task. The proposed photonic neuromorphic architecture points out a new form of lifelong learning scheme, permitting terminal/edge AI systems with light-speed efficiency and unprecedented scalability.

All-optical spiking neurosynaptic networks with self-learning capabilities

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

Photonic Spiking Neural Networks with Highly Efficient Training Protocols for Ultrafast Neuromorphic Computing Systems

Neuromorphic encoding of image pixel data into rate-coded optical spike trains with a photonic VCSEL-neuron

On-chip Spiking Neural Networks Based on Add-Drop Ring Microresonators and Electrically Reconfigurable Phase-Change Material Photonic Switches

Photonic neuromorphic architecture for tens-of-task lifelong learning

Optoelectronic Neuromorphic System Using the Neural Engineering Framework

All-Optical Synapse with Directional Coupler Structure Based on Phase Change Material

Neuromorphic Photonic Networks

Plastic Photonic Synapse Based on VCSOA for Self-Learning in Photonic Spiking Neural Network

Optical Bio-Inspired Synaptic Devices

Self-powered Photonic Synapses with Rapid Optical Erasing Ability for Neuromorphic Visual Perception

All Optical Artificial Synapses Based on Long-Afterglow Material for Optical Neural Network

All-Optical Spiking Neuron Based on Passive Microresonator

All-Optical Spiking Neuron Based On Passive Micro-Resonator

Photonic extreme learning machine by free-space optical propagation

Emergent self-adaptation in an integrated photonic neural network for backpropagation-free learning

Hardware-algorithm collaborative computing with photonic spiking neuron chip based on an integrated Fabry-Perot laser with a saturable absorber

Self-learning photonic signal processor with an optical neural network chip

GHz Rate Neuromorphic Photonic Spiking Neural Network with a Single Vertical-Cavity Surface-Emitting Laser (VCSEL)

Pattern Recognition in Multi-Synaptic Photonic Spiking Neural Networks Based on a DFB-SA Chip