Abstract:A whole slide imaging (WSI) system has recently been approved for primary diagnostic use in the US. The image quality and system throughput of WSI is largely determined by the autofocusing process. Traditional approaches acquire multiple images along the optical axis and maximize a figure of merit for autofocusing. Here we explore the use of deep convolution neural networks (CNNs) to predict the focal position of the acquired image without axial scanning. We investigate the autofocusing performance with three illumination settings: incoherent Kohler illumination, partially coherent illumination with two plane waves, and one-plane-wave illumination. We acquire ~130,000 images with different defocus distances as the training data set. Different defocus distances lead to different spatial features of the captured images. However, solely relying on the spatial information leads to a relatively bad performance of the autofocusing process. It is better to extract defocus features from transform domains of the acquired image. For incoherent illumination, the Fourier cutoff frequency is directly related to the defocus distance. Similarly, autocorrelation peaks are directly related to the defocus distance for two-plane-wave illumination. In our implementation, we use the spatial image, the Fourier spectrum, the autocorrelation of the spatial image, and combinations thereof as the inputs for the CNNs. We show that the information from the transform domains can improve the performance and robustness of the autofocusing process. The resulting focusing error is ~0.5 µm, which is within the 0.8-µm depth-of-field range. The reported approach requires little hardware modification for conventional WSI systems and the images can be captured on the fly without focus map surveying. It may find applications in WSI and time-lapse microscopy. The transform- and multi-domain approaches may also provide new insights for developing microscopy-related deep-learning networks. We have made our training and testing data set (~12 GB) open-source for the broad research community.

A Deep-Learning-based Workflow to Deal with the Defocusing Problem in High-Throughput Experiments

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Deep Tissue Focusing Based on Machine Learning

Machine learning guided rapid focusing with sensor-less aberration corrections.

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Efficient high-resolution fluorescence projection imaging over an extended depth of field through optical hardware and deep learning optimizations

PostFocus: Automated Selective Post-acquisition High-throughput Focus Restoration using Diffusion model for Label-free Time-lapse Microscopy

Single-shot autofocusing of microscopy images using deep learning

Rapid Whole Slide Imaging via Learning-based Two-shot Virtual Autofocusing

An Automatic Method for Robust and Fast Cell Detection in Bright Field Images from High-Throughput Microscopy.

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Deep Learning-Based Single-Shot Autofocus Method for Digital Microscopy

Towards smart optical focusing: Deep learning-empowered wavefront shaping in nonstationary scattering media

HH-Net: Image Driven Microscope Fast Auto-Focus with Deep Neural Network

Learning to High-Performance Autofocus Microscopy with Laser Illumination

Real-Time Resolution Enhancement of Confocal Laser Scanning Microscopy via Deep Learning

Defocus Deblur Microscopy via Head-to-Tail Cross-scale Fusion

Low-cost whole slide imaging system with single-shot autofocusing based on color-multiplexed illumination and deep learning

Extended Focused Imaging in Microscopy Using Structure Tensor and Guided Filtering

DeepFocus: Fast focus and astigmatism correction for electron microscopy

Transform- and Multi-Domain Deep Learning for Single-Frame Rapid Autofocusing in Whole Slide Imaging