Abstract:Silicon-photonics-based optical neural network (ONN) is a promising hardware platform that could represent a paradigm shift in efficient AI with its CMOS-compatibility, flexibility, ultra-low execution latency, and high energy efficiency. In-situ training on the online programmable photonic chips is appealing but still encounters challenging issues in on-chip implementability, scalability, and efficiency. In this work, we propose a closed-loop ONN on-chip learning framework L2ight to enable scalable ONN mapping and efficient in-situ learning. L2ight adopts a three-stage learning flow that first calibrates the complicated photonic circuit states under challenging physical constraints, then performs photonic core mapping via combined analytical solving and zeroth-order optimization. A subspace learning procedure with multi-level sparsity is integrated into L2ight to enable in-situ gradient evaluation and fast adaptation, unleashing the power of optics for real on-chip intelligence. Extensive experiments demonstrate our proposed L2ight outperforms prior ONN training protocols with 3-order-of-magnitude higher scalability and over 30X better efficiency, when benchmarked on various models and learning tasks. This synergistic framework is the first scalable on-chip learning solution that pushes this emerging field from intractable to scalable and further to efficient for next-generation self-learnable photonic neural chips. From a co-design perspective, L2ight also provides essential insights for hardware-restricted unitary subspace optimization and efficient sparse training. We open-source our framework at <a class="link-external link-https" href="https://github.com/JeremieMelo/L2ight" rel="external noopener nofollow">this https URL</a>.

Strategies for Training Optical Neural Networks

Countering Variations and Thermal Effects for Accurate Optical Neural Networks.

Optical Analog Computing Devices Designed by Deep Neural Network

Optical neural networks: progress and challenges

Advances and Marine Applications of Optical Neural Network

Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order Optimization

Advances and Challenges of Optical Neural Networks

Training large-scale optoelectronic neural networks with dual-neuron optical-artificial learning

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Training neural networks with end-to-end optical backpropagation

Training Large-Scale Optical Neural Networks with Two-Pass Forward Propagation

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Photonic Neural Networks and Its Applications

Low-Depth Optical Neural Networks

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

End-to-End Optimization for a Compact Optical Neural Network Based on Nanostructured 2 x 2 Optical Processors

Slimmed optical neural networks with multiplexed neuron sets and a corresponding backpropagation training algorithm

Hybrid training of optical neural networks

L2ight: Enabling On-Chip Learning for Optical Neural Networks via Efficient in-situ Subspace Optimization

Free-Space Optical Spiking Neural Network

Optical backpropagation training method and its applications