Abstract:A whole slide imaging (WSI) system has recently been approved for primary diagnostic use in the US. The image quality and system throughput of WSI is largely determined by the autofocusing process. Traditional approaches acquire multiple images along the optical axis and maximize a figure of merit for autofocusing. Here we explore the use of deep convolution neural networks (CNNs) to predict the focal position of the acquired image without axial scanning. We investigate the autofocusing performance with three illumination settings: incoherent Kohler illumination, partially coherent illumination with two plane waves, and one-plane-wave illumination. We acquire ~130,000 images with different defocus distances as the training data set. Different defocus distances lead to different spatial features of the captured images. However, solely relying on the spatial information leads to a relatively bad performance of the autofocusing process. It is better to extract defocus features from transform domains of the acquired image. For incoherent illumination, the Fourier cutoff frequency is directly related to the defocus distance. Similarly, autocorrelation peaks are directly related to the defocus distance for two-plane-wave illumination. In our implementation, we use the spatial image, the Fourier spectrum, the autocorrelation of the spatial image, and combinations thereof as the inputs for the CNNs. We show that the information from the transform domains can improve the performance and robustness of the autofocusing process. The resulting focusing error is ~0.5 µm, which is within the 0.8-µm depth-of-field range. The reported approach requires little hardware modification for conventional WSI systems and the images can be captured on the fly without focus map surveying. It may find applications in WSI and time-lapse microscopy. The transform- and multi-domain approaches may also provide new insights for developing microscopy-related deep-learning networks. We have made our training and testing data set (~12 GB) open-source for the broad research community.

Dual-LED-based multichannel microscopy for whole-slide multiplane, multispectral, and phase imaging

Widefield and total internal reflection fluorescent structured illumination microscopy with scanning galvo mirrors.

Light Sheet Microscopy Using Line Scan Confocal with Bidirectional Bessel Beam Illumination

Rapid and Robust Whole Slide Imaging Based on LED-array Illumination and Color-Multiplexed Single-Shot Autofocusing

Brightfield, fluorescence, and phase-contrast whole slide imaging via dual-LED autofocusing.

Deep Learned Optical Multiplexing for Multi-Focal Plane Microscopy

A dual-wavelength line-scan confocal endomicroscopy system for rapid molecular imaging (Conference Presentation)

High-throughput lensless whole slide imaging via continuous height-varying modulation of tilted sensor

Development and Assessment of Multiple Illumination Color Fourier Ptychographic Microscopy for High Throughput Sample Digitization

Depth-multiplexed ptychographic microscopy for high-throughput imaging of stacked bio-specimens on a chip

Super Resolution Microscope Imaging Based on Three Channels

Multiplexed phase-space imaging for 3D fluorescence microscopy

Single-pixel phase and fluorescence microscope

Simultaneous Fluorescence And Quantitative Phase Microscopy With Single-Pixel Detectors

DaXi-high-resolution, large imaging volume and multi-view single-objective light-sheet microscopy

Bi-Plane Multicolor Scanning Illumination Microscopy with Multispot Excitation and a Distorted Diffraction Grating

Low-cost whole slide imaging system with single-shot autofocusing based on color-multiplexed illumination and deep learning

Multi-channel beam-scanning imaging at kHz frame rates by Lissajous trajectory microscopy

Wide-field Endoscope Accessory for Multiplexed Fluorescence Imaging

Single-frame Rapid Autofocusing for Brightfield and Fluorescence Whole Slide Imaging.

Transform- and Multi-Domain Deep Learning for Single-Frame Rapid Autofocusing in Whole Slide Imaging