Abstract:A whole slide imaging (WSI) system has recently been approved for primary diagnostic use in the US. The image quality and system throughput of WSI is largely determined by the autofocusing process. Traditional approaches acquire multiple images along the optical axis and maximize a figure of merit for autofocusing. Here we explore the use of deep convolution neural networks (CNNs) to predict the focal position of the acquired image without axial scanning. We investigate the autofocusing performance with three illumination settings: incoherent Kohler illumination, partially coherent illumination with two plane waves, and one-plane-wave illumination. We acquire ~130,000 images with different defocus distances as the training data set. Different defocus distances lead to different spatial features of the captured images. However, solely relying on the spatial information leads to a relatively bad performance of the autofocusing process. It is better to extract defocus features from transform domains of the acquired image. For incoherent illumination, the Fourier cutoff frequency is directly related to the defocus distance. Similarly, autocorrelation peaks are directly related to the defocus distance for two-plane-wave illumination. In our implementation, we use the spatial image, the Fourier spectrum, the autocorrelation of the spatial image, and combinations thereof as the inputs for the CNNs. We show that the information from the transform domains can improve the performance and robustness of the autofocusing process. The resulting focusing error is ~0.5 µm, which is within the 0.8-µm depth-of-field range. The reported approach requires little hardware modification for conventional WSI systems and the images can be captured on the fly without focus map surveying. It may find applications in WSI and time-lapse microscopy. The transform- and multi-domain approaches may also provide new insights for developing microscopy-related deep-learning networks. We have made our training and testing data set (~12 GB) open-source for the broad research community.

Extended Focused Imaging in Microscopy Using Structure Tensor and Guided Filtering

Extended Depth of Field Reconstruction with Complex Field Estimation

Multi-image-distance Imaging System for Extending Depth-of-field

Deep Tissue Focusing Based on Machine Learning

Joint Focusing Method Based on Optimal Image-Distance Interval for Multi-Image-distance Imaging System

Acceleration of Autofocusing with Improved Edge Extraction Using Structure Tensor and Schatten Norm.

Efficient high-resolution fluorescence projection imaging over an extended depth of field through optical hardware and deep learning optimizations

Wide-field and Full-Focus Optical Microscopic Imaging System

High‐Speed Multi‐Modal Extended Depth‐of‐Field Microscopy with an Electrically Tunable Lens

Autofocusing and Image Fusion for Multi-Focus Plankton Imaging by Digital Holographic Microscopy.

Fast Digital Refocusing and Depth of Field Extended Fourier Ptychography Microscopy

Enhance imaging depth in wide-field two-photon microscopy by extended detection and computational reconstruction

Fast Autofocusing Based on Pixel Difference with the Tanimoto Coefficient Between Images

Focus depth extension for microscopic visual system based on wavelet analysis

Fast Autofocus of Microscopy Images Based on Depth-from-Defocus

Auto-Focusing And Quantitative Phase Imaging Using Deep Learning For The Incoherent Illumination Microscopy System

Depth of Focus Extension by Filtering in the Frequency Domain in Laser Frequency-Shifted Feedback Imaging.

Real-Time 3d Image Fusion Based on Wavelet Transform in Microscope Auto-Focusing System

Extended Depth of Focus for Transmission X-Ray Microscope.

Digital Multi-Focusing from a Single Photograph Taken with an Uncalibrated Conventional Camera

Transform- and Multi-Domain Deep Learning for Single-Frame Rapid Autofocusing in Whole Slide Imaging