Abstract:Computer aid auto-focus system is necessary for accurate microscope diagnosis, especially for the high precision microscope, which leaves little physical distance for focus adjusting manually. We proposed an image-driven microscope fast auto-focus system with a deep neural network. There are two main contributions. First, combining the high-level feature learning ability advantages of convolution neural network (CNN) and the handcraft feature selection ability of statistical learning, we proposed a High-level-Handcraft Neural Network (HH-Net) to accurately determine the distance index between microscope lens and cell smear by evaluating the image focus quality. It deployed 13 layers CNN for the high-level feature extraction from image patches. While the handcraft features which provide global information from the raw image were extracted by statistical algorithms and merged into CNN features. Finally, the combined features are utilized by the fully connected layers in the network to obtain the final distance index by classifying the biomedical image focus quality. Second, cooperated with the HH-Net, we propose an end to end image driven microscope fast auto-focus system, which can learn auto-focus policies from visual input and finish at a clear spot automatically. The accuracy of our patch level focus quality prediction is 92.4% with HH-Net, while the real-time image level focus quality predication can be 99.99% with 0.025s cost time by certainty voting strategy. Our auto-focus system can also cooperate with the X-Y Micro platform to automatically scan the whole cell smear and get the real-time best-in-focus image of a microscope with fast response, accuracy, and robustness.

A Single-Shot Autofocus Approach for Surface Plasmon Resonance Microscopy

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Label-free Surface-Sensitive Photonic Microscopy with High Spatial Resolution Using Azimuthal Rotation Illumination

Machine learning guided rapid focusing with sensor-less aberration corrections.

Automated Nanoparticle Analysis in Surface Plasmon Resonance Microscopy.

Enhanced Detection of Surface Plasmon Resonance Microscope Via Multiangle Illumination and Pretrained Deep Neural Network

Postrecording Pixel-Reconstruction Approach for Correcting the Lateral Drifts in Surface Plasmon Resonance Microscope

Learning to High-Performance Autofocus Microscopy with Laser Illumination

Deep Learning-Based Single-Shot Autofocus Method for Digital Microscopy

Single-shot autofocusing of microscopy images using deep learning

Flexible Incidence Angle Scanning Surface Plasmon Resonance Microscopy for Morphology Detection with Enhanced Contrast

Deep learning-driven adaptive optics for single-molecule localization microscopy

Non-scan and real-time multichannel angular surface plasmon resonance imaging method.

Achieving High Spatial Resolution Surface Plasmon Resonance Microscopy with Image Reconstruction.

Optimizing surface plasmon resonance spectral imaging through AOTF-calibrated light sources and image feedback

Enhanced Nanoparticle Recognition via Deep Learning-Accelerated Plasmonic Sensing

High spatial resolution surface plasmon resonance imaging using a plasmonic chip

Studying the Electrochemistry of Single Nanoparticles with Surface Plasmon Resonance Microscopy

Resolution enhancement of random adsorbed single-molecule localization based on surface plasmon resonance illumination.

A Deep-Learning-based Workflow to Deal with the Defocusing Problem in High-Throughput Experiments

HH-Net: Image Driven Microscope Fast Auto-Focus with Deep Neural Network