Fast image-free autofocus method for passive FSPI microscopy

Mingyang Ni,Yu Cai,Yihao Xue,Huaxia Deng,Xinglong Gong

DOI: https://doi.org/10.1364/ol.516755

IF: 3.6

2024-05-30

Optics Letters

Abstract:Mingyang Ni, Yu Cai, Yihao Xue, Huaxia Deng, Xinglong Gong Autofocus is crucial for capturing sharp images with imaging devices for information acquisition. Traditional autofocus strategies based on ... [Opt. Lett. 49, 3110-3113 (2024)]

optics

What problem does this paper attempt to address?

A Fast Image-Free Autofocus Method for Passive Fourier Single-Pixel Imaging Microscopy

Mingyang Ni,Yu Cai,Yihao Xue,Huaxia Deng,xinglong gong

DOI: https://doi.org/10.1364/ol.516755

IF: 3.6

2024-01-01

Optics Letters

Abstract:Autofocus is crucial for capturing sharp images with imaging devices for information acquisition. Traditional autofocus strategies based on post-processing become less efficient for passive FSPI microscopy of yet low temporal resolution. In this Letter, a fast and image-free autofocus system is proposed for passive FSPI microscopy. Based on the complementary design of an optical path, the system can measure the focus degree at 5000 fps while maintaining a high light efficiency for imaging. The proposed system can be easily combined with existing trinocular microscopes, which provides a welcomed boost to the practicability of passive FSPI microscopy.
Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Yanhong Gan,Zitong Ye,Yubing Han,Ye Ma,Chuankang Li,Qiulan Liu,Wenjie Liu,Cuifang Kuang,Xu Liu

DOI: https://doi.org/10.1016/j.optlaseng.2023.107663

IF: 5.666

2023-01-01

Optics and Lasers in Engineering

Abstract:Light sheet fluorescence microscopy (LSFM) has been proposed as a promising tool for biological research due to its ability to observe the dynamics of living cells for hours and days. Nonetheless, this raises the strict requirement for the overlapping between the light sheet and the detection focal plane to get optimal image quality. Here, we describe a fast and accurate deep learning-based autofocusing method to overcome the challenge of unstable focusing in LSFM with a single shot. This method is compatible with any light sheet imaging setup with a spatial light modulator for light sheet generation. A predicted root-mean-square error of 0.0942 & mu;m across a range of & PLUSMN; 0.7 & mu;m in a light sheet microscope using a 1.1 numerical aperture detection objective can be obtained. The neural network architecture we proposed shows advantages in small memory size, few training data set requirements, and good generalization to untrained sample types.
Dynamic Focus Window Selecting Strategy For Digital Cameras

Yibin Tian,Huajun Feng,Zhihai Xu,Jianqi Huang

DOI: https://doi.org/10.1117/12.586482

2005-01-01

Abstract:The purpose of selecting focus window is not only to reduce computation, but also to improve image sharpness of object(s) of interest. A simple geometrical model is built using thin lens Gauss equation. The necessity of utilizing different focus window selecting strategies is demonstrated with the model. Then a dynamic focus window selecting method is described.It's reasonable to assume that a photographer's gaze direction points to the object(s) of his interest when he is taking a picture. The gaze direction is trackable by various pupil-tracking methods. A simple modification of viewfinder allows us to take images of photographer's eye with the built-in image sensor. The images are then processed to determine the photographer's gaze direction. One small area in the target image is matched to the gaze direction and selected as focus window. Within the focus window, an uneven sampling method can be used to reduce the computational need further. The uneven sampling works the same way as the human retina.This dynamic focus window selecting method can greatly increase the probability of getting sharply focused object(s) of interest, at the same time only less than 1% of the target image is needed to apply the focus measure.
A Fast Autofocus Method for Multispectral Imaging System

WANG Wei,ZHENG Zhihuan,SHEN Huiliang

DOI: https://doi.org/10.3969/j.issn.1003-501X.2013.09.006

2013-01-01

Abstract:A multispectral imaging system acquires spectral color images by splitting the light spectrum into multiple bands.Due to the different refractive index for individual wavelength,the focus positions of the channels are different,and thus each channel should be adjusted to obtain sharp image.We propose a fast autofocus method based on the similarity of focus measure distributions,which is suitable to multispectral imaging.In the proposed method,we first obtain the focus measure distribution of a reference channel using traditional autofocus method.Then,the clear focus positions of other channels are located according to the distribution similarity between individual channels.As only a few images are needed,the autofocus for these channels is quite fast.Experimental results validate that the proposed method performs better than the traditional techniques.
High-accuracy Differential Autofocus System with an Electrically Tunable Lens.

Kuangwei DU,Dakai Zhou,Sijia Zhou,Jinfeng Zhang,Qingqing Liu,Xuejian Bai,Qiulan Liu,Youhua Chen,Wenjie Liu,Cuifang Kuang

DOI: https://doi.org/10.1364/ol.488673

IF: 3.6

2023-01-01

Optics Letters

Abstract:We propose a quasi-confocal microscopy autofocus system incorporating an electrically tunable lens (ETL) to achieve differential detection. The ETL changes its focal length to collect differential curves at speeds <300 Hz, allowing selective locking onto desired focal layers and high-speed differential operations close to the locked focal plane. By segmenting the system's pupil, the interference between the outgoing and incoming near-infrared beams is avoided, thereby greatly improving the signal-to-noise ratio. This ultra-sensitive system, with a focus drift accuracy better than 1/22 focal depth (∼20 nm @100× objective), provides a new, to the best of our knowledge, implementation pathway to meet the requirements of various microscopy techniques.
Method of Improving Autofocus Speed Based on Defocus Estimation

LI Qi,FENG Hua-jun,XU Zhi-hai

DOI: https://doi.org/10.3321/j.issn:1005-0086.2005.07.022

2005-01-01

Abstract:A new location method of focused position for autofocus was put forward.In current autofocus system,a lot of time was taken to acquire and process a serial of images and drive focus lens through all possible imaging positions,which is not compatible with the demand of rapid focus.The new method estimated defocus degree at three imaging position respectively,driven lens to focused range,then searched within the range and found best imaging position.Proposed method has some advantages,such as higher accuracy,shorter focus time,and neednt calibrate exactly imaging system.Experiments show that the new method has improved focus speed remarkably (about 37%),and has the same accuracy as depth from focus(DFF) method.
Fast Auto-Focus Scheme Based on Optical Defocus Fitting Model

Yeru Wang,Huajun Feng,Zhihai Xu,Qi Li,Yueting Chen,Min Cen

DOI: https://doi.org/10.1080/09500340.2017.1411540

IF: 1.3

2018-01-01

Journal of Modern Optics

Abstract:An optical defocus fitting model-based (ODFM) auto-focus scheme is proposed. Considering the basic optical defocus principle, the optical defocus fitting model is derived to approximate the potential-focus position. By this accurate modelling, the proposed auto-focus scheme can make the stepping motor approach the focal plane more accurately and rapidly. Two fitting positions are first determined for an arbitrary initial stepping motor position. Three images (initial image and two fitting images) at these positions are then collected to estimate the potential-focus position based on the proposed ODFM method. Around the estimated potential-focus position, two reference images are recorded. The auto-focus procedure is then completed by processing these two reference images and the potential-focus image to confirm the in-focus position using a contrast based method. Experimental results prove that the proposed scheme can complete auto-focus within only 5 to 7 steps with good performance even under low-light condition.
Autofocus for Multispectral Camera Using Focus Symmetry.

Hui-Liang Shen,Zhi-Huan Zheng,Wei Wang,Xin Du,Si-Jie Shao,John H. Xin

DOI: https://doi.org/10.1364/ao.51.002616

IF: 1.9

2012-01-01

Applied Optics

Abstract:A multispectral camera acquires spectral color images with high fidelity by splitting the light spectrum into more than three bands. Because of the shift of focal length with wavelength, the focus of each channel should be mechanically adjusted in order to obtain sharp images. Because progressive adjustment is quite time consuming, the clear focus must be determined by using a limited number of images. This paper exploits the symmetry of focus measure distribution and proposes a simple yet efficient autofocus method. The focus measures are computed using first-order image derivatives, and the focus curve is obtained by spline interpolation. The optimal focus position, which maximizes the symmetry of the focus measure distribution, is then computed according to distance metrics. The effectiveness of the proposed method is validated in the multispectral camera system, and it is also applicable to relevant imaging systems.
Fast Autofocusing Strategy for Phase Retrieval Based on Statistical Gradient Optimization

Wen Cao,Ling Bai,Yueshu Xu,Cuifang Kuang,Xu Liu

DOI: https://doi.org/10.1016/j.optlaseng.2024.108636

IF: 5.666

2025-01-01

Optics and Lasers in Engineering

Abstract:Axial error arises from the error inherent in man-made measurement of distance between object and detector for in-line holography, resulting in image blurring, defocusing and low reconstruction quality. Nevertheless, existing methods for autofocusing and axial correction requires computing parameters with several distances neighboring current distance, which incorporates additional loops into the iterative algorithms. In this study, we propose an approach that updates diffraction distance directly based on statistical information of reconstructed object, thus eliminating the need for additional loops and reducing reconstruction time. Besides, our methods could achieve high reconstruction accuracy, while maintaining high convergence rate, stability and wide initialization space. The effectiveness of our proposed method has been validated through both simulation and experiments.
Fast autofocusing based on single-pixel moment detection

Huiling Chen,Dongfeng Shi,Zijun Guo,Runbo Jiang,Linbin Zha,Yingjian Wang,Jan Flusser

DOI: https://doi.org/10.1038/s44172-024-00288-z

2024-10-09

Abstract:Traditional image processing-based autofocusing techniques require the acquisition, storage, and processing of large amounts of image sequences, constraining focusing speed and cost. Here we propose an autofocusing technique, which directly and exactly acquires the geometric moments of the target object in real time at different locations by means of a proper image modulation and detection by a single-pixel detector. An autofocusing criterion is then formulated using the central moments, and the fast acquisition of the focal point is achieved by searching for the position that minimizes the criterion. Theoretical analysis and experimental validation of the method are performed and the results show that the method can achieve fast and accurate autofocusing. The proposed method requires only three single-pixel detections for each focusing position of the target object to evaluate the focusing criterion without imaging the target object. The method does not require any active object-to-camera distance measurement. Comparing to local differential methods such as contrast or gradient measurement, our method is more stable to noise and requires very little data compared with the traditional image processing methods. It may find a wide range of potential applications and prospects, particularly in low-light imaging and near-infra imaging, where the level of noise is typically high.
Machine learning guided rapid focusing with sensor-less aberration corrections.

Yuncheng Jin,Yiye Zhang,Lejia Hu,Haiyang Huang,Qiaoqi Xu,Xinpei Zhu,Limeng Huang,Yao Zheng,Hui-Liang Shen,Wei Gong,Ke Si

DOI: https://doi.org/10.1364/OE.26.030162

IF: 3.8

2018-01-01

Optics Express

Abstract:Non-invasive, real-time imaging and deep focus into tissue are in high demand in biomedical research. However, the aberration that is introduced by the refractive index inhomogeneity of biological tissue hinders the way forward. A rapid focusing with sensorless aberration corrections, based on machine learning, is demonstrated in this paper. The proposed method applies the Convolutional Neural Network (CNN), which can rapidly calculate the low-order aberrations from the point spread function images with Zernike modes after training. The results show that approximately 90 percent correction accuracy can be achieved. The average mean square error of each Zernike coefficient in 200 repetitions is 0.06. Furthermore, the aberration induced by 1-mm-thick phantom samples and 300-mu m-thick mouse brain slices can be efficiently compensated through loading a compensation phase on an adaptive element placed at the back-pupil plane. The phase reconstruction requires less than 0.2 s. Therefore, this method offers great potential for in vivo real-time imaging in biological science. (c) 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
Design and Optimization for Microscope Autofocus Systems Based on the Analysis of Video Signals

Peng Ge,Bangfu Mao,Huajun Feng,Zhihai Xu,Qi Li,Yipeng Liu

DOI: https://doi.org/10.1117/12.832537

2009-01-01

Abstract:An autofocus system applied to microscope has been designed, which is based on the analysis of analog video signals' processing. A multi-feedback band-pass active filter retains high frequency components of analog video signals from CCD, then high frequency components that represent image details information are amplified and performed integral operation, which is defined as focusing measure. After A/D transformation a MCU controls the focusing procedure and drives a stepping motor to find focused-position. The selection of bandwidths of filter, selection of focusing windows, step-size in search and hill climbing algorithms are discussed and optimized to improve focus accuracy and shorten focus time.
A Method Of Autofocus For Remote Sensing Camera

Xixi Meng,Huajun Feng,Zhihai Xu,Qi Li,Yueting Chen

DOI: https://doi.org/10.1117/12.859990

2010-01-01

Abstract:Because of the flight of the remote sensing camera in the orbit, the successive images of the scenes captured by the remote sensing camera are different at any time. So it is difficult for the camera to implement autofocus. In this paper, an auto-focusing method in the remote sensing camera is proposed based on successive two images captured in a short time which have an overlapped region where scenes are same. Firstly, the space camera moving in the orbit, shoots one picture every time the camera adjusts its focus, and then we can obtain a sequence of images after several times, from which the displacement and the overlapped regions of two adjacent images can be calculated by image registration algorithm. We can take every two adjacent images as a group. Therefore, every image has a value of focusing accuracy by performing a sharpness evaluation function on the overlapped region of each image. Finally, according to the transfer characteristic of evaluation values of every two partly overlapped images, we can unify the evaluation values in a same merit evaluation system. And then find the maximum value of image evaluation values in a same evaluation system, so we can find the accurate focus. Simulation experiment shows that this method works pretty well in auto focusing when relative motion between the camera and the object is existed. This method can be used in aerial camera and remote sensing camera.
Study on Auto—focusing of Laser Scanning Confocal Microscopy

LI Jing,ZHANG Heng-yi,ZHANG Le,ZHENG Xiao-xiang

DOI: https://doi.org/10.3969/j.issn.0253-2743.2006.06.017

2006-01-01

Abstract:Objective:For the disability of the auto-focusing of the laser scanning confocal microscopy(LSCM) in the plane,the paper advances a fast image process algorithm to focus on an object image based on the auto-focusing theory of the automatic optical microscopy.Method:Obtain the series images of microscope specimen with different focus from LSCM,focuses the whole field of image with gradation variance operator firstly.Secondly,Entropy function based on the Sobel operator is applied to focuses the object image region.Employ one direction search strategy to fast the pace of auto-focusing.Results:The Experiment results show that this method can be applied to LSCM auto-focusing whether with fluorescence or not.Two steps of rude and elaborate focusing can improve the precision.Eentropy function based on the Sobel operator is sensitive with image border and more suitable to the biology microscopes specimen than the former special auto-focusing methods.
Autofocusing Imaging System Based on Laser Ranging and a Retina-Like Sample.

Jie Cao,Yang Cheng,Peng Wang,Kaiyu Zhang,Yuqing Xiao,Kun Li,Yuxin Peng,Qun Hao

DOI: https://doi.org/10.1364/ao.56.006222

IF: 1.9

2017-01-01

Applied Optics

Abstract:A novel autofocusing method combining active and passive techniques is proposed to improve autofocusing performance. The proposed method is divided into coarse and fine autofocusing stages. First, a laser ranging finder viewed as the active technique is used to obtain a reasonable initial position of the compensating lens group during the coarse autofocusing stage. Second, a retina-like sampling method is used to decrease the volume of processing data during the fine autofocusing stage. We developed a prototype and performed comparative experiments using different targets based on the proposed method and the traditional passive method (TPM). Under optical power of 9×, the TPM consumed 2.5 s, while the proposed method performed at 1.3 s. The comparative experiments also showed that the proposed method exhibited a better anti-interference property than the traditional method.
Autofocus methods based on laser illumination

Zhijie Hua,Xu Zhang,Dawei Tu

DOI: https://doi.org/10.1364/oe.499655

IF: 3.8

2023-08-19

Optics Express

Abstract:Zhijie Hua, Xu Zhang, Dawei Tu Autofocusing system plays an important role in microscopic measurement. However, natural-image-based autofocus methods encounter ... [Opt. Express 31, 29465-29479 (2023)]

optics
Single-shot autofocusing of microscopy images using deep learning

Yilin Luo,Luzhe Huang,Yair Rivenson,Aydogan Ozcan

DOI: https://doi.org/10.1021/acsphotonics.0c01774

2021-01-22

Abstract:We demonstrate a deep learning-based offline autofocusing method, termed Deep-R, that is trained to rapidly and blindly autofocus a single-shot microscopy image of a specimen that is acquired at an arbitrary out-of-focus plane. We illustrate the efficacy of Deep-R using various tissue sections that were imaged using fluorescence and brightfield microscopy modalities and demonstrate snapshot autofocusing under different scenarios, such as a uniform axial defocus as well as a sample tilt within the field-of-view. Our results reveal that Deep-R is significantly faster when compared with standard online algorithmic autofocusing methods. This deep learning-based blind autofocusing framework opens up new opportunities for rapid microscopic imaging of large sample areas, also reducing the photon dose on the sample.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Optics
High-robustness autofocusing method in the microscope with laser-based arrayed spots

Zhihao Wang,Xin Zhang,Xindong Chen,Liang Miao,Ke Kang,Chenggang Mo

DOI: https://doi.org/10.1364/oe.510835

IF: 3.8

2024-01-30

Optics Express

Abstract:Zhihao Wang, Xin Zhang, Xindong Chen, Liang Miao, Ke Kang, Chenggang Mo Accurate and rapid autofocus technology plays a crucial role in various fields, including automatic optical inspection technology, ... [Opt. Express 32, 4902-4915 (2024)]

optics
High-speed Fourier Ptychographic Microscopy for Quantitative Phase Imaging.

Yi Xiao,Shiyuan Wei,Shaolong Xue,Cuifang Kuang,Anli Yang,Maoliang Wei,Hongtao Lin,Renjie Zhou

DOI: https://doi.org/10.1364/ol.428731

IF: 3.6

2021-01-01

Optics Letters

Abstract:Fourier ptychographic microscopy (FPM), as an emerging computational imaging method, has been applied to quantitative phase imaging with resolution bypassing the physical limit of the detection objective. Due to the weak illumination intensity and long image acquisition time, the achieved imaging speed in current FPM methods is still low, making them unsuitable for real-time imaging applications. We propose and demonstrate a high-speed FPM method based on using laser illumination and digital micro-mirror devices for illumination angle scanning. In this new, to the best of our knowledge, FPM method, we realized quantitative phase imaging and intensity imaging at over 42 frames per second (fps) with around 1 µm lateral resolution. The quantitative phase images have revealed membrane height fluctuations of red blood cells with nanometer-scale sensitivity, while the intensity images have resolved subcellular features in stained cancer tissue slices.
Fast, high precision autofocus on a motorised microscope: automating blood sample imaging on the OpenFlexure Microscope

Joe Knapper,Joel T. Collins,Julian Stirling,Samuel McDermott,William Wadsworth,Richard Bowman

DOI: https://doi.org/10.48550/arXiv.2109.06842

2021-09-15

Abstract:The OpenFlexure Microscope is a 3D printed, low-cost microscope capable of automated image acquisition through the use of a motorised translation stage and a Raspberry Pi imaging system. This automation has applications in research and healthcare, including in supporting the diagnosis of malaria in low resource settings. The plasmodium parasites which cause malaria require high magnification imaging, which has a shallow depth of field, necessitating the development of an accurate and precise autofocus procedure. We present methods of identifying the focal plane of the microscope, and procedures for reliably acquiring a stack of focused images on a system affected by backlash and drift. We also present and assess a method to verify the success of autofocus during the scan. The speed, reliability and precision of each method is evaluated, and the limitations discussed in terms of the end users' requirements.

Instrumentation and Detectors

Fast image-free autofocus method for passive FSPI microscopy

A Fast Image-Free Autofocus Method for Passive Fourier Single-Pixel Imaging Microscopy

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Dynamic Focus Window Selecting Strategy For Digital Cameras

A Fast Autofocus Method for Multispectral Imaging System

High-accuracy Differential Autofocus System with an Electrically Tunable Lens.

Method of Improving Autofocus Speed Based on Defocus Estimation

Fast Auto-Focus Scheme Based on Optical Defocus Fitting Model

Autofocus for Multispectral Camera Using Focus Symmetry.

Fast Autofocusing Strategy for Phase Retrieval Based on Statistical Gradient Optimization

Fast autofocusing based on single-pixel moment detection

Machine learning guided rapid focusing with sensor-less aberration corrections.

Design and Optimization for Microscope Autofocus Systems Based on the Analysis of Video Signals

A Method Of Autofocus For Remote Sensing Camera

Study on Auto—focusing of Laser Scanning Confocal Microscopy

Autofocusing Imaging System Based on Laser Ranging and a Retina-Like Sample.

Autofocus methods based on laser illumination

Single-shot autofocusing of microscopy images using deep learning

High-robustness autofocusing method in the microscope with laser-based arrayed spots

High-speed Fourier Ptychographic Microscopy for Quantitative Phase Imaging.

Fast, high precision autofocus on a motorised microscope: automating blood sample imaging on the OpenFlexure Microscope