Abstract:Photonics inverse design relies on human experts to search for a design topology that satisfies certain optical specifications with their experience and intuitions, which is relatively labor-intensive, slow, and sub-optimal. Machine learning has emerged as a powerful tool to automate this inverse design process. However, supervised or semi-supervised deep learning is unsuitable for this task due to: (1) a severe shortage of available training data due to the high computational complexity of physics-based simulations along with a lack of open-source datasets and/or the need for a pre-trained neural network model; (2) the issue of one-to-many mapping or non-unique solutions; and (3) the inability to perform optimization of the photonic structure beyond inverse designing. Reinforcement Learning (RL) has the potential to overcome the above three challenges. Here, we propose Learning to Design Optical-Resonators (L2DO) to leverage RL that learns to autonomously inverse design nanophotonic laser cavities without any prior knowledge while retrieving unique design solutions. L2DO incorporates two different algorithms – Deep Q-learning and Proximal Policy Optimization. We evaluate L2DO on two laser cavities: a long photonic crystal (PC) nanobeam and a PC nanobeam with an L3 cavity, both popular structures for semiconductor lasers. Trained for less than 152 hours on limited hardware resources, L2DO has improved state-of-the-art results in the literature by over 2 orders of magnitude and obtained 10 times better performance than a human expert working the same task for over a month. L2DO first learned to meet the required maxima of Q -factors (>50 million) and then proceeded to optimize some additional good-to-have features (e.g., resonance frequency, modal volume). Compared with iterative human designs and inverse design via supervised learning, L2DO can achieve over two orders of magnitude higher sample-efficiency without suffering from the three issues above. This work confirms the potential of deep RL algorithms to surpass human designs and marks a solid step towards a fully automated AI framework for photonics inverse design.

Reinforcement learning enabled the design of compact and efficient integrated photonic devices

Integrated silicon photonic device design by attractor selection mechanism based on artificial neural networks: optical coupler and asymmetric light transmitter.

Reinforcement Learning for Photonic Component Design

Deep reinforcement learning empowers automated inverse design and optimization of photonic crystals for nanoscale laser cavities

Machine Learning enables Ultra-Compact Integrated Photonics through Silicon-Nanopattern Digital Metamaterials

Machine learning based compact photonic structure design for strong light confinement

Device‐System End‐to‐End Design of Photonic Neuromorphic Processor Using Reinforcement Learning

Device-system Co-design of Photonic Neuromorphic Processor using Reinforcement Learning

High-efficiency reinforcement learning with hybrid architecture photonic integrated circuit

Hybrid supervised and reinforcement learning for the design and optimization of nanophotonic structures

Deep Neural Network Inverse Design of Integrated Nanophotonic Devices

A manufacture-friendly design framework for optical neural networks

Physics-informed reinforcement learning for sample-efficient optimization of freeform nanophotonic devices

Deep Photonic Networks with Arbitrary and Broadband Functionality

Reinforcement Learning in a large scale photonic Recurrent Neural Network

Physical Information-Embedded Deep Learning for Forward Prediction and Inverse Design of Nanophotonic Devices

Deep Neural Network-Based Inverse Design of a Novel Reconfigurable Multi-Tap Optical Filter

Deep learning enabled inverse design in nanophotonics

L2ight: Enabling On-Chip Learning for Optical Neural Networks via Efficient in-situ Subspace Optimization

Deep learning for the design of photonic structures

Designing Silicon Photonic Devices using Artificial Neural Networks