Rapid Whole Slide Imaging via Learning-based Two-shot Virtual Autofocusing

Qiang Li,Xianming Liu,Kaige Han,Cheng Guo,Xiangyang Ji,Xiaolin Wu
DOI: https://doi.org/10.48550/arXiv.2003.06630
2020-03-14
Abstract:Whole slide imaging (WSI) is an emerging technology for digital pathology. The process of autofocusing is the main influence of the performance of WSI. Traditional autofocusing methods either are time-consuming due to repetitive mechanical motions, or require additional hardware and thus are not compatible to current WSI systems. In this paper, we propose the concept of \textit{virtual autofocusing}, which does not rely on mechanical adjustment to conduct refocusing but instead recovers in-focus images in an offline learning-based manner. With the initial focal position, we only perform two-shot imaging, in contrast traditional methods commonly need to conduct as many as 21 times image shooting in each tile scanning. Considering that the two captured out-of-focus images retain pieces of partial information about the underlying in-focus image, we propose a U-Net-inspired deep neural network based approach for fusing them into a recovered in-focus image. The proposed scheme is fast in tissue slides scanning, enabling a high-throughput generation of digital pathology images. Experimental results demonstrate that our scheme achieves satisfactory refocusing performance.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: in Whole Slide Imaging (WSI), traditional autofocus methods are inefficient and rely on mechanical adjustments, resulting in long scanning times and poor hardware compatibility. Specifically: 1. **Limitations of traditional autofocus methods**: - Traditional methods usually require repetitive mechanical movements to obtain images at multiple different focal lengths (for example, up to 21 shots are required for each scan), which is very time - consuming. - These methods rely on creating a focus map and require a high - precision mechanical system to ensure that the sample returns to the correct position for focus shooting. 2. **The newly proposed virtual autofocus method**: - The paper proposes a two - shot virtual autofocusing method based on learning, aiming to reduce scanning time and improve system compatibility. - This method does not require mechanical adjustment for refocusing, but restores clear images through offline learning. Specifically, only two shots (two out - of - focus images) are required, instead of the traditional multiple shots. 3. **Main innovation points**: - **High speed and high throughput**: Compared with traditional methods, this scheme significantly reduces scanning time and can avoid autofocus during the scanning process, thereby increasing the scanning speed. - **High - quality imaging**: The two - step method utilizes part of the information in the two out - of - focus images for feature fusion and compensation, so it has higher imaging quality than the one - step method. - **System compatibility**: This method does not require any hardware modification to the existing WSI system, maintaining the system's compatibility. 4. **Technical implementation**: - Determine the initial focal plane position by collecting a dense z - stack of images near the initial focal plane. - For each subsequent area, only two out - of - focus images with different offsets are taken. - Use a U - Net - inspired deep neural network to fuse these two out - of - focus images into one clear image. In summary, this paper aims to solve the problems of low efficiency and high hardware requirements of traditional autofocus methods in WSI by introducing a two - step virtual autofocusing method based on learning, thereby achieving faster and higher - quality digital generation of pathological images.