Abstract:The resolution and contrast of microscope imaging is often affected by aberrations introduced by imperfect optical systems and inhomogeneous refractive structures in specimens. Adaptive optics (AO) compensates these aberrations and restores diffraction limited performance. A wide range of AO solutions have been introduced, often tailored to a specific microscope type or application. Until now, a universal AO solution -- one that can be readily transferred between microscope modalities -- has not been deployed. We propose versatile and fast aberration correction using a physics-based machine learning (ML) assisted wavefront-sensorless AO control method. Unlike previous ML methods, we used a bespoke neural network (NN) architecture, designed using physical understanding of image formation, that was embedded in the control loop of the microscope. The approach means that not only is the resulting NN orders of magnitude simpler than previous NN methods, but the concept is translatable across microscope modalities. We demonstrated the method on a two-photon, a three-photon and a widefield three-dimensional (3D) structured illumination microscope. Results showed that the method outperformed commonly-used modal-based sensorless AO methods. We also showed that our ML-based method was robust in a range of challenging imaging conditions, such as extended 3D sample structures, specimen motion, low signal to noise ratio and activity-induced fluorescence fluctuations. Moreover, as the bespoke architecture encapsulated physical understanding of the imaging process, the internal NN configuration was no-longer a ``black box'', but provided physical insights on internal workings, which could influence future designs.

Robust sensorless wavefront sensing via neural network in a single-shot

Simplifying the detection of optical distortions by machine learning

A Sensorless Adaptive Optics Control System for Microscopy Based on Extreme Learning Machine

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Deep learning based wavefront sensor for complex wavefront detection in adaptive optical microscopes.

Improved Machine Learning Approach for Wavefront Sensing

Machine learning guided rapid focusing with sensor-less aberration corrections.

High robustness single-shot wavefront sensing method using a near-field profile image and fully-connected retrieval neural network for a high power laser facility

Universal adaptive optics for microscopy through embedded neural network control

Fast single pixel modal wavefront sensing using neural networks

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Learning-based Shack-Hartmann Wavefront Sensor for High-Order Aberration Detection.

Aberration Correction Method For Fourier Ptychographic Microscopy Based On Neural Network

Conformal Convolutional Neural Network (CCNN) for Single-Shot Sensorless Wavefront Sensing.

High-precision, real-time wavefront sensing via sparse diffractive deep neural networks

Neural Network Assisted High Flexibility and High Resolution Shack-Hartmann Wavefront Sensing for Astronomical Observation in Darker Sky Areas

Neural network algorithm for under-sampled wavefront reconstruction: mathematical analysis and implementation

Highly Stable Spatio-Temporal Prediction Network of Wavefront Sensor Slopes in Adaptive Optics

Enhancing Open-Loop Wavefront Prediction in Adaptive Optics through 2D-LSTM Neural Network Implementation

In‐Situ Wavefront Correction Via Physics‐Informed Neural Network

Coordinate-based neural representations for computational adaptive optics in widefield microscopy