Lens-free auto-focusing imaging algorithm for the ultra-broadband light source

Jialin Zhang,Yumin Wu,Ying Yang,Zhenguo Wang

DOI: https://doi.org/10.1364/oe.509985

IF: 3.8

2024-01-13

Optics Express

Abstract:Jialin Zhang, Yumin Wu, Ying Yang, Zhenguo Wang Auto-focusing is an essential task for lens-free holographic microscopy, which has developed many methods for high precision or fast ... [Opt. Express 32, 2619-2630 (2024)]

optics

What problem does this paper attempt to address?

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Yanhong Gan,Zitong Ye,Yubing Han,Ye Ma,Chuankang Li,Qiulan Liu,Wenjie Liu,Cuifang Kuang,Xu Liu

DOI: https://doi.org/10.1016/j.optlaseng.2023.107663

IF: 5.666

2023-01-01

Optics and Lasers in Engineering

Abstract:Light sheet fluorescence microscopy (LSFM) has been proposed as a promising tool for biological research due to its ability to observe the dynamics of living cells for hours and days. Nonetheless, this raises the strict requirement for the overlapping between the light sheet and the detection focal plane to get optimal image quality. Here, we describe a fast and accurate deep learning-based autofocusing method to overcome the challenge of unstable focusing in LSFM with a single shot. This method is compatible with any light sheet imaging setup with a spatial light modulator for light sheet generation. A predicted root-mean-square error of 0.0942 & mu;m across a range of & PLUSMN; 0.7 & mu;m in a light sheet microscope using a 1.1 numerical aperture detection objective can be obtained. The neural network architecture we proposed shows advantages in small memory size, few training data set requirements, and good generalization to untrained sample types.
Machine learning guided rapid focusing with sensor-less aberration corrections.

Yuncheng Jin,Yiye Zhang,Lejia Hu,Haiyang Huang,Qiaoqi Xu,Xinpei Zhu,Limeng Huang,Yao Zheng,Hui-Liang Shen,Wei Gong,Ke Si

DOI: https://doi.org/10.1364/OE.26.030162

IF: 3.8

2018-01-01

Optics Express

Abstract:Non-invasive, real-time imaging and deep focus into tissue are in high demand in biomedical research. However, the aberration that is introduced by the refractive index inhomogeneity of biological tissue hinders the way forward. A rapid focusing with sensorless aberration corrections, based on machine learning, is demonstrated in this paper. The proposed method applies the Convolutional Neural Network (CNN), which can rapidly calculate the low-order aberrations from the point spread function images with Zernike modes after training. The results show that approximately 90 percent correction accuracy can be achieved. The average mean square error of each Zernike coefficient in 200 repetitions is 0.06. Furthermore, the aberration induced by 1-mm-thick phantom samples and 300-mu m-thick mouse brain slices can be efficiently compensated through loading a compensation phase on an adaptive element placed at the back-pupil plane. The phase reconstruction requires less than 0.2 s. Therefore, this method offers great potential for in vivo real-time imaging in biological science. (c) 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
Broadband Ultrasonic Focusing in Water with an Ultra-Compact Metasurface Lens

Jian Chen,Jing Rao,Danylo Lisevych,Zheng Fan

DOI: https://doi.org/10.1063/1.5090956

IF: 4

2019-01-01

Applied Physics Letters

Abstract:Focusing of ultrasonic waves in water plays an important role in various scenarios ranging from biomedical imaging to nondestructive testing. Acoustic metasurfaces have been largely explored for acoustic focusing, but they are generally narrowband and mainly implemented for airborne sound because of their structural complexity. Nevertheless, our previous development of metasurfaces provides a great opportunity to solve the challenges. Here, we present numerically and experimentally the broadband focusing of ultrasonic waves in water with a metasurface lens consisting of an array of deep-subwavelength sized and spaced slots. The slot widths of the metasurface are optimized based on microscopic coupled-wave theory. Due to the non-resonant arrangement, the focusing effect is demonstrated over a broad band of frequencies. The metasurface lens with simplicity and an ultra-compact size provides a feasible means for the design of thin and lightweight ultrasonic devices and is suitable for practical applications in biomedical and industrial fields.
Robust autofocusing method for multi-wavelength lensless imaging.

Jian Liu,Yixuan Zhao,Cheng Guo,Weisong Zhao,Yutian Zhang,Changliang Guo,Haoyu Li

DOI: https://doi.org/10.1364/OE.27.023814

IF: 3.8

2019-01-01

Optics Express

Abstract:Lensless imaging based on multi-wavelength phase retrieval becomes a promising technology widely used as it has simple acquisition, miniaturized size and low-cost setup. However, measuring the sample-to-sensor distance with high accuracy, which is the key for high-resolution reconstruction, is still a challenge. In this work, we propose a multiwavelength criterion to realize autofocusing modulation, i.e., achieving much higher accuracy in determining the sample-to-sensor distance, compared to the conventional methods. Three beams in different spectrums are adopted to illuminate the sample, and the resulting holograms are recorded by a CCD camera. The patterns calculated by performing back propagation of the recorded holograms, with exhaustively searched sample-to-sensor distance value, are adopted to access the criterion. Image sharpness can be accessed and the optimal sample-to-sensor distance can be finely determined by targeting the valley of the curve given by the criterion. Through our novel multi-wavelength based autofocusing strategy and executing further phase retrieval process, high-resolution images can be finally retrieved. The applicability and robustness of our method is validated both in simulations and experiments. Our technique provides a useful tool for multi-wavelength lensless imaging under limited experimental conditions. (C) 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
Autofocus methods based on laser illumination

Zhijie Hua,Xu Zhang,Dawei Tu

DOI: https://doi.org/10.1364/oe.499655

IF: 3.8

2023-08-19

Optics Express

Abstract:Zhijie Hua, Xu Zhang, Dawei Tu Autofocusing system plays an important role in microscopic measurement. However, natural-image-based autofocus methods encounter ... [Opt. Express 31, 29465-29479 (2023)]

optics
Lensfree Auto-Focusing Imaging with Coarse-to-fine Tuning Method

Zhihui Ding,Shenghao Zheng,Feilong Zhang,Qiang Li,Cheng Guo

DOI: https://doi.org/10.1016/j.optlaseng.2024.108366

IF: 5.666

2024-01-01

Optics and Lasers in Engineering

Abstract:Sample-to-sensor distance is a crucial predefined parameter for lensfree on-chip microscopes. Inaccurate estimation of the distance could lead to a failure of high-frequency detail recovery. To address it, conventional methods either evaluate the sharpness of back-propagated Z-stack holograms or adopt a pretrained end-to-end classification neural network. However, fast and robust distance estimation is still a challenging task. Here we propose a coarse-to-fine auto-focusing method to achieve fast and robust distance estimation for lensfree on-chip microscopy. In our method, a simulation-driven focus network (sFocusNet) is designed as a coarse tuning to decrease the distance searching range, and then a regularization of gradient (RoG) metric is constructed as a fine tuning to achieve an accurate estimation. Experimental results of different samples are given to verify the superiority and generalization of our method. We believe that our method will offer a practical auto-focusing solution for the commercialization of lensfree microscopes.
Study on Auto—focusing of Laser Scanning Confocal Microscopy

LI Jing,ZHANG Heng-yi,ZHANG Le,ZHENG Xiao-xiang

DOI: https://doi.org/10.3969/j.issn.0253-2743.2006.06.017

2006-01-01

Abstract:Objective:For the disability of the auto-focusing of the laser scanning confocal microscopy(LSCM) in the plane,the paper advances a fast image process algorithm to focus on an object image based on the auto-focusing theory of the automatic optical microscopy.Method:Obtain the series images of microscope specimen with different focus from LSCM,focuses the whole field of image with gradation variance operator firstly.Secondly,Entropy function based on the Sobel operator is applied to focuses the object image region.Employ one direction search strategy to fast the pace of auto-focusing.Results:The Experiment results show that this method can be applied to LSCM auto-focusing whether with fluorescence or not.Two steps of rude and elaborate focusing can improve the precision.Eentropy function based on the Sobel operator is sensitive with image border and more suitable to the biology microscopes specimen than the former special auto-focusing methods.
High-robustness autofocusing method in the microscope with laser-based arrayed spots

Zhihao Wang,Xin Zhang,Xindong Chen,Liang Miao,Ke Kang,Chenggang Mo

DOI: https://doi.org/10.1364/oe.510835

IF: 3.8

2024-01-30

Optics Express

Abstract:Zhihao Wang, Xin Zhang, Xindong Chen, Liang Miao, Ke Kang, Chenggang Mo Accurate and rapid autofocus technology plays a crucial role in various fields, including automatic optical inspection technology, ... [Opt. Express 32, 4902-4915 (2024)]

optics
Autofocusing of Digital Holographic Microscopy Based on Off-Axis Illuminations.

Peng Gao,Baoli Yao,Junwei Min,Rongli Guo,Baiheng Ma,Juanjuan Zheng,Ming Lei,Shaohui Yan,Dan,Tong Ye

DOI: https://doi.org/10.1364/ol.37.003630

IF: 3.6

2012-01-01

Optics Letters

Abstract:An auto-focusing method for digital holographic microscopy has been proposed by employing two off-axis illumination beams. When specimens are illuminated by two plane waves in different directions, it is found that the farther the reconstruction plane is from the image plane, the wider the two reconstructed images are separated from each other. Thus, the image plane can be determinated by finding the minimum of the variation between the two reconstructed object waves on both the amplitude and phase distributions. The feasibility of the proposed method is demonstrated by the corresponding simulation and experiment.
Lensfree on-chip digital holographic microscope with auto-focusing

Wentao Han,Xiwei Huang,Maoyu Wei,Renjie Wang,Xuefeng Xu,Jiangfan Yao,Jin Chen,Lingling Sun

DOI: https://doi.org/10.1109/ICTA53157.2021.9661767

2021-01-01

Abstract:Lensfree on-chip digital holographic microscope (LFOCDHM) is a simple and efficient miniaturized digital microscope with unique advantages of compact structure, large field-of-view (FOV), and high numerical aperture (NA) for point-of-care diagnostics. However, a compact and simple structure will increase the instability of an optical system that requires high precision. In practice, the distance b...
Learning to High-Performance Autofocus Microscopy with Laser Illumination

Zhijie Hua,Xu Zhang,Dawei Tu,Xingzhao Wang,Nuodi Huang

DOI: https://doi.org/10.1016/j.measurement.2023.112964

IF: 5.6

2023-01-01

Measurement

Abstract:The autofocusing plays a crucial role in various industrial microscopic measurements. However, conventional autofocus methods involve axial scanning and are prone to inaccuracies caused by surface noises, such as defects and texture, making them both time-consuming and unreliable. In this work, a novel high-performance autofocus pipeline with laser illumination was introduced, namely Learning Split-image Prediction Model (LSPM), to accurately predict the defocus distance from a single split image. To effectively reduce the interference of the noises as foregrounds, a lightweight generation network was built to restore the incomplete split images. Furthermore, a new judgment mechanism for split images was proposed to identify the ideal focal plane of each focal stack. The experiment demonstrated LSPM outperforms the state-of-the-art methods, in terms of focusing accuracy, especially when the defocusing amount is relatively small, achieving only 1/15 depth of field. LSPM has the advantages of high accuracy, high speed, and robustness in industrial measurement.
Development of an Autofocusing System Using an Electrically Tunable Lens in Large Area Holographic Lithography.

Rui Hou,Jia Yu,Yanyan Huang,Huaheng Ke,Huiping Liu

DOI: https://doi.org/10.1364/ao.379853

IF: 1.9

2020-01-01

Applied Optics

Abstract:Due to the limited processing accuracy of the platform and unevenness of the glass substrate itself, a holographic lithography system is prone to out-of-focus imaging problems; therefore, the real-time focusing components are critical for holographic lithography systems. In this paper, a real-time focus monitoring and adjusting system using an electrically tunable lens (ETL) for large-area lithography is introduced. Combined with the ETL, the limited depth of field of the microscopic objective has been effectively expanded, and the automatic focusing evaluation and adjustment are achieved. The development, including simulation using Zemax, optics system design and implementation, experiments, and evaluation are demonstrated in this paper. The results show that the out-of-focus problem in our large-area holographic lithography system has been significantly alleviated.
Lensfree Auto-Focusing Imaging Using Nuclear Norm of Gradient

Cheng Guo,Feilong Zhang,Xianming Liu,Qiang Li,Shenghao Zheng,Jiubin Tan,Zhengjun Liu,Weibo Wang

DOI: https://doi.org/10.1016/j.optlaseng.2022.107076

IF: 5.666

2022-01-01

Optics and Lasers in Engineering

Abstract:Auto-focusing is an essential task for lensfree holographic microscopy, where the optimal focal plane needs to be determined from refocused Z-stack data. In this work, we propose a new auto-focusing criterion, nuclear norm of gradient (NoG), to enhance the accuracy of distance estimation for lensfree imaging. The NoG metric is composed of three parts: shape acquisition, gradient calculation, and gradient fusion. The experiment is conducted in a multi-height on-chip system, where 20 sets of samples including resolution target, stained slide, and label-free cell are employed. The experimental results demonstrate that the accuracy of the NoG metric on auto-focusing is superior to state-of-the-art metrics. Also, the experiment of a multi-layer target proves that the NoG metric has a good optical-sectioning capability. We believe that the NoG metric is expected to be a useful tool for lensfree on-chip microscopes.
Compact Multi-Band Fluorescent Microscope with an Electrically Tunable Lens for Autofocusing.

Zhaojun Wang,Ming Lei,Baoli Yao,Yanan Cai,Yansheng Liang,Yanlong Yang,Xibin Yang,Hui Li,Daxi Xiong

DOI: https://doi.org/10.1364/boe.6.004353

IF: 3.4

2015-01-01

Biomedical Optics Express

Abstract:Autofocusing is a routine technique in redressing focus drift that occurs in time-lapse microscopic image acquisition. To date, most automatic microscopes are designed on the distance detection scheme to fulfill the autofocusing operation, which may suffer from the low contrast of the reflected signal due to the refractive index mismatch at the water/glass interface. To achieve high autofocusing speed with minimal motion artifacts, we developed a compact multi-band fluorescent microscope with an electrically tunable lens (ETL) device for autofocusing. A modified searching algorithm based on equidistant scanning and curve fitting is proposed, which no longer requires a single-peak focus curve and then efficiently restrains the impact of external disturbance. This technique enables us to achieve an autofocusing time of down to 170 ms and the reproductivity of over 97%. The imaging head of the microscope has dimensions of 12 cm × 12 cm × 6 cm. This portable instrument can easily fit inside standard incubators for real-time imaging of living specimens.
Autofocus system for microscope

Qingxiang Li,Lifen Bai,Shifu Xue,Luyun Chen

DOI: https://doi.org/10.1117/1.1473639

IF: 1.3

2002-06-01

Optical Engineering

Abstract:A technique is developed for microscope autofocusing, which is called the eccentric light beam approach with high resolution, wide focusing range, and compact construction. The principle is described. The theoretical formula of the eccentric light beam approach deduced can be applied not only to an object lens whose objective plane is just at the focal plane, but also to an object lens whose objective plane is not at the focal plane. The experimental setup uses a semiconductor laser device as the light source. The laser beam that enters into the microscope is eccentric with the main light axis. A defocused signal is acquired by a symmetrical silicon photocell for the change of the reflected light position caused by differential amplification and processed by a microprocessor. Then the electric signal is power-amplified and drives a dc motor, which moves a fine working platform to an automatic focus of the microscope. The result of the experiments shows a ±0.1-μm precision of autofocusing for a range of ±500-μm defocusing. The system has high reliability and can meet the requirements of various accurate micro measurement systems. © 2002 Society of Photo-Optical Instrumentation Engineers.

optics
Fast Autofocusing in Digital Holography Using the Magnitude Differential

Meng Lyu,Caojin Yuan,Dayan Li,Guohai Situ

DOI: https://doi.org/10.1364/ao.56.00f152

IF: 1.9

2017-01-01

Applied Optics

Abstract:Typical methods of automatic estimation of focusing in digital holography calculate every single reconstructed frame to get a critical function and then ascertain the focal plane by finding the extreme value of that function. Here, we propose a digital holographic autofocusing method that computes the focused distance using the first longitudinal difference of the magnitude of the reconstructed image. We demonstrate the proposed method with both numerical simulations and optical experiments of amplitude-contrast and phase-contrast objects. The results suggest that the proposed method performs better than other existing methods, in terms of applicability and computation efficiency, with potential applications in industrial and biomedical inspections where automatic focus tracking is necessary.
Nonmechanical parfocal and autofocus features based on wave propagation distribution in lensfree holographic microscopy

Agus Budi Dharmawan,Shinta Mariana,Gregor Scholz,Philipp Hörmann,Torben Schulze,Kuwat Triyana,Mayra Garcés-Schröder,Ingo Rustenbeck,Karsten Hiller,Hutomo Suryo Wasisto,Andreas Waag

DOI: https://doi.org/10.1038/s41598-021-81098-7

2021-02-05

Abstract:Performing long-term cell observations is a non-trivial task for conventional optical microscopy, since it is usually not compatible with environments of an incubator and its temperature and humidity requirements. Lensless holographic microscopy, being entirely based on semiconductor chips without lenses and without any moving parts, has proven to be a very interesting alternative to conventional microscopy. Here, we report on the integration of a computational parfocal feature, which operates based on wave propagation distribution analysis, to perform a fast autofocusing process. This unique non-mechanical focusing approach was implemented to keep the imaged object staying in-focus during continuous long-term and real-time recordings. A light-emitting diode (LED) combined with pinhole setup was used to realize a point light source, leading to a resolution down to 2.76 μm. Our approach delivers not only in-focus sharp images of dynamic cells, but also three-dimensional (3D) information on their (x, y, z)-positions. System reliability tests were conducted inside a sealed incubator to monitor cultures of three different biological living cells (i.e., MIN6, neuroblastoma (SH-SY5Y), and Prorocentrum minimum). Altogether, this autofocusing framework enables new opportunities for highly integrated microscopic imaging and dynamic tracking of moving objects in harsh environments with large sample areas.
Lensless ultrafast optical imaging

Jian Zhao,Mingsheng Li

DOI: https://doi.org/10.1038/s41377-022-00789-6

2022-01-01

Abstract:Lensless single-shot ultrafast optical imaging is realized by integrating an acousto-optic programmable dispersive filter with spectrally filtered sequentially time all-optical mapping photography,which enables independent control of frame rate,frame intensity,and exposure time with a simple system design.
Fast Autofocus of Microscopy Images Based on Depth-from-Defocus

Liguo Chen,Zhiliang Yang,Lining Sun

DOI: https://doi.org/10.1109/iros.2008.4650658

2008-01-01

Abstract:Microscopic computer vision differs significantly from macroscale computer vision. Autofocusing techniques is of fundamental importance to automated micromanipulation in providing high level task understanding, task planning and real time control. Depth-from-Focus (DFF) based autofocusing method is widely used in many microscope systems, while the low efficiency limited its application in micromanipulation system which needs fast autofocus for real time control. In this paper, depth-from-defocus (DFD) algorithms are proposed to improve autofocusing performance and robustness for microscopic optics. Two different schemes based on look-up table and function relation are investigated and evaluated through actual experiments. Experimental results validate the performances of the two proposed autofocusing methods.
Auto-focusing femtosecond laser manufacturing system via acoustic emission technology

Yanzhe Fu,Yao Su,Jiayong Wei,Bing Wang,Jiebo Li

DOI: https://doi.org/10.1364/ol.516076

IF: 3.6

2024-01-23

Optics Letters

Abstract:Yanzhe Fu, Yao Su, Jiayong Wei, Bing Wang, Jiebo Li Auto-focusing technology in ultrafast laser processing, especially for non-planar structures, holds paramount importance. The existing ... [Opt. Lett. 49, 558-561 (2024)]

optics

Lens-free auto-focusing imaging algorithm for the ultra-broadband light source

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Machine learning guided rapid focusing with sensor-less aberration corrections.

Broadband Ultrasonic Focusing in Water with an Ultra-Compact Metasurface Lens

Robust autofocusing method for multi-wavelength lensless imaging.

Autofocus methods based on laser illumination

Lensfree Auto-Focusing Imaging with Coarse-to-fine Tuning Method

Study on Auto—focusing of Laser Scanning Confocal Microscopy

High-robustness autofocusing method in the microscope with laser-based arrayed spots

Autofocusing of Digital Holographic Microscopy Based on Off-Axis Illuminations.

Lensfree on-chip digital holographic microscope with auto-focusing

Learning to High-Performance Autofocus Microscopy with Laser Illumination

Development of an Autofocusing System Using an Electrically Tunable Lens in Large Area Holographic Lithography.

Lensfree Auto-Focusing Imaging Using Nuclear Norm of Gradient

Compact Multi-Band Fluorescent Microscope with an Electrically Tunable Lens for Autofocusing.

Autofocus system for microscope

Fast Autofocusing in Digital Holography Using the Magnitude Differential

Nonmechanical parfocal and autofocus features based on wave propagation distribution in lensfree holographic microscopy

Lensless ultrafast optical imaging

Fast Autofocus of Microscopy Images Based on Depth-from-Defocus

Auto-focusing femtosecond laser manufacturing system via acoustic emission technology