Abstract:Silicon-photonics-based optical neural network (ONN) is a promising hardware platform that could represent a paradigm shift in efficient AI with its CMOS-compatibility, flexibility, ultra-low execution latency, and high energy efficiency. In-situ training on the online programmable photonic chips is appealing but still encounters challenging issues in on-chip implementability, scalability, and efficiency. In this work, we propose a closed-loop ONN on-chip learning framework L2ight to enable scalable ONN mapping and efficient in-situ learning. L2ight adopts a three-stage learning flow that first calibrates the complicated photonic circuit states under challenging physical constraints, then performs photonic core mapping via combined analytical solving and zeroth-order optimization. A subspace learning procedure with multi-level sparsity is integrated into L2ight to enable in-situ gradient evaluation and fast adaptation, unleashing the power of optics for real on-chip intelligence. Extensive experiments demonstrate our proposed L2ight outperforms prior ONN training protocols with 3-order-of-magnitude higher scalability and over 30X better efficiency, when benchmarked on various models and learning tasks. This synergistic framework is the first scalable on-chip learning solution that pushes this emerging field from intractable to scalable and further to efficient for next-generation self-learnable photonic neural chips. From a co-design perspective, L2ight also provides essential insights for hardware-restricted unitary subspace optimization and efficient sparse training. We open-source our framework at <a class="link-external link-https" href="https://github.com/JeremieMelo/L2ight" rel="external noopener nofollow">this https URL</a>.

Optical implementation of localized interconnected neural network

Local Interconnection Neural Network and Its Optical Implementation

Optical Analog Computing Devices Designed by Deep Neural Network

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Optical implementations of neural networks: A review

Optical implementation of a 2-D three-layer neural associative memory

Space-efficient optical computing with an integrated chip diffractive neural network

High order local interconnected neural network for associative memory

Three-order locally interconnected neural network for associative memory

Optical neural network via loose neuron array and functional learning

L2ight: Enabling On-Chip Learning for Optical Neural Networks via Efficient in-situ Subspace Optimization

Optical Neural Network with Bipolar Neural States.

Low-power scalable multilayer optoelectronic neural networks enabled with incoherent light

All Optical Artificial Synapses Based on Long-Afterglow Material for Optical Neural Network

Hardware-software co-design of slimmed optical neural networks.

All-optical neural network with nonlinear activation functions

High speed and reconfigurable optronic neural network with digital nonlinear activation

Real-time optical fuzzy associative memory neural network

Slimmed optical neural networks with multiplexed neuron sets and a corresponding backpropagation training algorithm