Advancing Computational Miniature Mesoscope with Simulator-based Deep Learning Reconstruction

Qianwan Yang,Guorong Hu,Yujia Xue,Lei Tian

DOI: https://doi.org/10.1364/3d.2023.dm1a.2

2023-01-01

Abstract:We demonstrate an advanced Computational Miniature Mesoscope with novel miniature optics and deep learning reconstruction to achieve wide field-of-view, high-resolution, single-shot 3D fluorescence imaging in a miniaturized platform.

What problem does this paper attempt to address?

Deep-learning-augmented Computational Miniature Mesoscope

Yujia Xue,Qianwan Yang,Guorong Hu,Kehan Guo,Lei Tian

DOI: https://doi.org/10.1364/OPTICA.464700

2022-09-08

Abstract:Fluorescence microscopy is essential to study biological structures and dynamics. However, existing systems suffer from a tradeoff between field-of-view (FOV), resolution, and complexity, and thus cannot fulfill the emerging need of miniaturized platforms providing micron-scale resolution across centimeter-scale FOVs. To overcome this challenge, we developed Computational Miniature Mesoscope (CM$^2$) that exploits a computational imaging strategy to enable single-shot 3D high-resolution imaging across a wide FOV in a miniaturized platform. Here, we present CM$^2$ V2 that significantly advances both the hardware and computation. We complement the 3$\times$3 microlens array with a new hybrid emission filter that improves the imaging contrast by 5$\times$, and design a 3D-printed freeform collimator for the LED illuminator that improves the excitation efficiency by 3$\times$. To enable high-resolution reconstruction across the large imaging volume, we develop an accurate and efficient 3D linear shift-variant (LSV) model that characterizes the spatially varying aberrations. We then train a multi-module deep learning model, CM$^2$Net, using only the 3D-LSV simulator. We show that CM$^2$Net generalizes well to experiments and achieves accurate 3D reconstruction across a $\sim$7-mm FOV and 800-$\mu$m depth, and provides $\sim$6-$\mu$m lateral and $\sim$25-$\mu$m axial resolution. This provides $\sim$8$\times$ better axial localization and $\sim$1400$\times$ faster speed as compared to the previous model-based algorithm. We anticipate this simple and low-cost computational miniature imaging system will be impactful to many large-scale 3D fluorescence imaging applications.

Optics,Image and Video Processing
Fluorescence Interference Structured Illumination Microscopy for 3D Morphology Imaging with High Axial Resolution

Yile Sun,Hongfei Zhu,Lu Yin,Hanmeng Wu,Mingxuan Cai,Weiyun Sun,Yueshu Xu,Xinxun Yang,Jiaxiao Han,Wenjie Liu,Yubing Han,Xiang Hao,Renjie Zhou,Cuifang Kuang,Xu Liu

DOI: https://doi.org/10.1117/1.ap.5.5.056007

IF: 13.582

2023-01-01

Advanced Photonics

Abstract:Imaging three-dimensional, subcellular structures with high axial resolution has always been the core purpose of fluorescence microscopy. However, trade-offs exist between axial resolution and other important technical indicators, such as temporal resolution, optical power density, and imaging process complexity. We report a new imaging modality, fluorescence interference structured illumination microscopy（FI-SIM）, which is based on three-dimensional structured illumination microscopy for wide-field lateral imaging and fluorescence interference for axial reconstruction. FI-SIM can acquire images quickly within the order of hundreds of milliseconds and exhibit even 30 nm axial resolution in half the wavelength depth range without z-axis scanning. Moreover, the relatively low laser power density relaxes the requirements for dyes and enables a wide range of applications for observing fixed and live subcellular structures.
Single-Shot 3D Widefield Fluorescence Imaging with a Computational Miniature Mesoscope

Yujia Xue,Ian G. Davison,David A. Boas,Lei Tian

DOI: https://doi.org/10.48550/arXiv.2003.11994

2020-03-26

Optics

Abstract:Fluorescence imaging is indispensable to biology and neuroscience. The need for large-scale imaging in freely behaving animals has further driven the development in miniaturized microscopes (miniscopes). However, conventional microscopes / miniscopes are inherently constrained by their limited space-bandwidth-product, shallow depth-of-field, and the inability to resolve 3D distributed emitters. Here, we present a Computational Miniature Mesoscope (CM$^2$) that overcomes these bottlenecks and enables single-shot 3D imaging across an 8 $\times$ 7-mm$^2$ field-of-view and 2.5-mm depth-of-field, achieving 7-$\mu$m lateral resolution and better than 200-$\mu$m axial resolution. Notably, the CM$^2$ has a compact lightweight design that integrates a microlens array for imaging and an LED array for excitation in a single platform. Its expanded imaging capability is enabled by computational imaging that augments the optics by algorithms. We experimentally validate the mesoscopic 3D imaging capability on volumetrically distributed fluorescent beads and fibers. We further quantify the effects of bulk scattering and background fluorescence on phantom experiments.
DeepLeMiN: Deep-learning-empowered Physics-aware Lensless Miniscope

Feng Tian,Ben Mattison,Weijian Yang

DOI: https://doi.org/10.1101/2024.05.03.592471

2024-05-06

Abstract:Mask-based lensless fluorescence microscopy is a compact, portable imaging technique promising for biomedical research. It forms images through a thin optical mask near the camera without bulky optics, enabling snapshot three-dimensional imaging and a scalable field of view (FOV) without increasing device thickness. Lensless microscopy relies on computational algorithms to solve the inverse problem of object reconstruction. However, there has been a lack of efficient reconstruction algorithms for large-scale data. Furthermore, the entire FOV is typically reconstructed as a whole, which demands substantial computational resources and limits the scalability of the FOV. Here, we developed DeepLeMiN, a lensless microscope with a custom designed optical mask and a multi-stage physics-informed deep learning model. This not only enables the reconstruction of localized FOVs, but also significantly reduces the computational resource demands and facilitates real-time reconstruction. Our deep learning algorithm can reconstruct object volumes over 4×6×0.6 mm , achieving lateral and axial resolution of ∼10 µm and ∼50 µm respectively. We demonstrated significant improvement in both reconstruction quality and speed compared to traditional methods, across various fluorescent samples with dense structures. Notably, we achieved high-quality reconstruction of 3D motion of hydra and the neuronal activity with cellular resolution in awake mouse cortex. DeepLeMiN holds great promise for scalable, large FOV, real-time, 3D imaging applications with compact device footprint.

Neuroscience
Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Yuncheng Jin,Jiajia Chen,Chenxue Wu,Zhihong Chen,Xingyu Zhang,Hui-liang Shen,Wei Gong,Ke Si

DOI: https://doi.org/10.1364/oe.396321

IF: 3.8

2020-01-01

Optics Express

Abstract:The application of machine learning in wavefront reconstruction has brought great benefits to real-time, non-invasive, deep tissue imaging in biomedical research. However, due to the diversity and heterogeneity of biological tissues, it is difficult to train the dataset with a unified model. In general, the utilization of some unified models will result in the specific sample falling outside the training set, leading to low accuracy of the machine learning model in some real applications. This paper proposes a sensorless wavefront reconstruction method based on transfer learning to overcome the domain shift introduced by the difference between the training set and the target test set. We build a weights-sharing two-stream convolutional neural network (CNN) framework for the prediction of Zernike coefficient, in which a large number of labeled randomly generated samples serve as the source-domain data and the unlabeled specific samples serve as the target-domain data at the same time. By training on massive labeled simulated data with domain adaptation to unlabeled target-domain data, the network shows better performance on the target tissue samples. Experimental results show that the accuracy of the proposed method is 18.5% higher than that of conventional CNN-based method and the peak intensities of the point spread function (PSF) are more than 20% higher with almost the same training time and processing time. The better compensation performance on target sample could have more advantages when handling complex aberrations, especially the aberrations caused by various histological characteristics, such as refractive index inhomogeneity and biological motion in biological tissues.
3D Super-Resolution Microscopy Based on Nonlinear Gradient Descent Structured Illumination.

Hongfei Zhu,Yile Sun,Lu Yin,Jiaxiao Han,Mingxuan Cai,Qiulan Liu,Cuifang Kuang,Xiang Hao,Xu Liu

DOI: https://doi.org/10.1364/oe.424740

IF: 3.8

2021-01-01

Optics Express

Abstract:Three-dimensional structured illumination microscopy (3D-SIM) is an essential tool for volumetric fluorescence imaging, which improves both axial and lateral resolution by down-modulating high-frequency information of the sample into the passband of optical transfer function (OTF). And when combining with the 4Pi structure, the performance of 3D-SIM can be further improved. The reconstruction results of generally used linear 3D algorithm, however, are lack of high-fidelity and proneess to generate artifacts. In this paper, we proposed a novel iterative algorithm based on gradient descent combined with a nonlinear optimizer, which can be applied to all 3D-SIM setups (including I5S setup). We verified through simulation that the proposed solution, termed as nonlinear gradient descent structured illumination microscopy (NGD-SIM), achieves more fidelity results which can reach the limitation of theoretical resolution improvement of SIM. Moreover, it can be firmly validated on simulation that this algorithm can effectively reduce the amount of raw data in the case of sinusoidal-pattern illumination, i.e., the algorithm doesn't need five-step phase shifting; data with any number of phases can theoretically be reconstructed. Our method also provides the possibility to extend the application of sinusoidal-pattern illumination to any kind of interference fringe, which is generated by diversified types of illumination mode.
Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Qianwan Yang,Ruipeng Guo,Guorong Hu,Yujia Xue,Yunzhe Li,Lei Tian

2024-05-31

Abstract:Traditional fluorescence microscopy is constrained by inherent trade-offs among resolution, field-of-view, and system complexity. To navigate these challenges, we introduce a simple and low-cost computational multi-aperture miniature microscope, utilizing a microlens array for single-shot wide-field, high-resolution imaging. Addressing the challenges posed by extensive view multiplexing and non-local, shift-variant aberrations in this device, we present SV-FourierNet, a novel multi-channel Fourier neural network. SV-FourierNet facilitates high-resolution image reconstruction across the entire imaging field through its learned global receptive field. We establish a close relationship between the physical spatially-varying point-spread functions and the network's learned effective receptive field. This ensures that SV-FourierNet has effectively encapsulated the spatially-varying aberrations in our system, and learned a physically meaningful function for image reconstruction. Training of SV-FourierNet is conducted entirely on a physics-based simulator. We showcase wide-field, high-resolution video reconstructions on colonies of freely moving C. elegans and imaging of a mouse brain section. Our computational multi-aperture miniature microscope, augmented with SV-FourierNet, represents a major advancement in computational microscopy and may find broad applications in biomedical research and other fields requiring compact microscopy solutions.

Optics,Image and Video Processing
Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Min Guo,Yue Li,Yijun Su,Talley Lambert,Damian Dalle Nogare,Mark W. Moyle,Leighton H. Duncan,Richard Ikegami,Anthony Santella,Ivan Rey-Suarez,Daniel Green,Anastasia Beiriger,Jiji Chen,Harshad Vishwasrao,Sundar Ganesan,Victoria Prince,Jennifer C. Waters,Christina M. Annunziata,Markus Hafner,William A. Mohler,Ajay B. Chitnis,Arpita Upadhyaya,Ted B. Usdin,Zhirong Bao,Daniel Colon-Ramos,Patrick La Riviere,Huafeng Liu,Yicong Wu,Hari Shroff

DOI: https://doi.org/10.1038/s41587-020-0560-x

IF: 46.9

2020-01-01

Nature Biotechnology

Abstract:The contrast and resolution of images obtained with optical microscopes can be improved by deconvolution and computational fusion of multiple views of the same sample, but these methods are computationally expensive for large datasets. Here we describe theoretical and practical advances in algorithm and software design that result in image processing times that are tenfold to several thousand fold faster than with previous methods. First, we show that an 'unmatched back projector' accelerates deconvolution relative to the classic Richardson-Lucy algorithm by at least tenfold. Second, three-dimensional image-based registration with a graphics processing unit enhances processing speed 10- to 100-fold over CPU processing. Third, deep learning can provide further acceleration, particularly for deconvolution with spatially varying point spread functions. We illustrate our methods from the subcellular to millimeter spatial scale on diverse samples, including single cells, embryos and cleared tissue. Finally, we show performance enhancement on recently developed microscopes that have improved spatial resolution, including dual-view cleared-tissue light-sheet microscopes and reflective lattice light-sheet microscopes.
Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy (Adv. Sci. 27/2023)

Jianhui Liao,Chenshuang Zhang,Xiangcong Xu,Liangliang Zhou,Bin Yu,Danying Lin,Jia Li,Junle Qu

DOI: https://doi.org/10.1002/advs.202370185

IF: 15.1

2023-09-27

Advanced Science

Abstract:Deep Learning In article number 2300947, Jia Li, Junle Qu, and their co‐workers develop a deep‐learning‐based reconstruction algorithm for multifocal structured illumination microscopy to obtain the super‐resolution image. It is validated on diverse biological structures and very fast, showing the potential for real‐time reconstruction, without compromising spatial resolution.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
GEOMScope: Large Field-of-view 3D Lensless Microscopy with Low Computational Complexity

Feng Tian,Junjie Hu,Weijian Yang

DOI: https://doi.org/10.1002/lpor.202100072

2021-01-20

Abstract:Recent development of lensless imagers has enabled three-dimensional (3D) imaging through a thin piece of optics in close proximity to a camera sensor. A general challenge of wide-field lensless imaging is the high computational complexity and slow speed to reconstruct 3D objects through iterative optimization process. Here, we demonstrated GEOMScope, a lensless 3D microscope that forms image through a single layer of microlens array and reconstructs objects through a geometrical-optics-based pixel back projection algorithm and background suppressions. Compared to others, our method allows local reconstruction, which significantly reduces the required computation resource and increases the reconstruction speed by orders of magnitude. This enables near real-time object reconstructions across a large volume of 23x23x5 mm^3, with a lateral resolution of 40 um and axial resolution of 300 um. Our system opens new avenues for broad biomedical applications such as endoscopy, which requires both miniaturized device footprint and real-time high resolution visualization.

Optics,Image and Video Processing
Robust single-shot 3D fluorescence imaging in scattering media with a simulator-trained neural network

Jeffrey Alido,Joseph Greene,Yujia Xue,Guorong Hu,Yunzhe Li,Mitchell Gilmore,Kevin J. Monk,Brett T. DiBenedictis,Ian G. Davison,Lei Tian

2023-12-09

Abstract:Imaging through scattering is a pervasive and difficult problem in many biological applications. The high background and the exponentially attenuated target signals due to scattering fundamentally limits the imaging depth of fluorescence microscopy. Light-field systems are favorable for high-speed volumetric imaging, but the 2D-to-3D reconstruction is fundamentally ill-posed, and scattering exacerbates the condition of the inverse problem. Here, we develop a scattering simulator that models low-contrast target signals buried in heterogeneous strong background. We then train a deep neural network solely on synthetic data to descatter and reconstruct a 3D volume from a single-shot light-field measurement with low signal-to-background ratio (SBR). We apply this network to our previously developed Computational Miniature Mesoscope and demonstrate the robustness of our deep learning algorithm on scattering phantoms with different scattering conditions. The network can robustly reconstruct emitters in 3D with a 2D measurement of SBR as low as 1.05 and as deep as a scattering length. We analyze fundamental tradeoffs based on network design factors and out-of-distribution data that affect the deep learning model's generalizability to real experimental data. Broadly, we believe that our simulator-based deep learning approach can be applied to a wide range of imaging through scattering techniques where experimental paired training data is lacking.

Signal Processing,Biological Physics,Optics
Deep-learning Light-Field Microscopy with Improved Resolution and Reconstruction Speed

Guo Li,Zhaoqiang Wang,Hao Zhang,Lanxin Zhu,Peng Fei

DOI: https://doi.org/10.1364/translational.2020.jw5a.1

2020-01-01

Abstract:We demonstrate a deep-learning based light-field microscopy method, which achieves greatly improved spatial resolution and video-rate reconstruction throughput, thereby allowing sustained volumetric recording of fast biological dynamics at high spatiotemporal resolution.
Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy

Jianhui Liao,Chenshuang Zhang,Xiangcong Xu,Liangliang Zhou,Bin Yu,Danying Lin,Jia Li,Junle Qu

DOI: https://doi.org/10.1002/advs.202300947

IF: 15.1

2023-07-10

Advanced Science

Abstract:This work develops a deep‐learning‐based algorithm which reconstructs the super‐resolution image directly from raw images of multifocal structured illumination microscopy. The method is validated on microtubules, static and live‐cell mitochondria, and live‐zebrafish at a depth of 100 μm, and achieves state‐of‐the‐art performance with one‐fourths numbers of raw images and one‐third of the runtime required by conventional reconstruction method. Fast and precise reconstruction algorithm is desired for for multifocal structured illumination microscopy (MSIM) to obtain the super‐resolution image. This work proposes a deep convolutional neural network (CNN) to learn a direct mapping from raw MSIM images to super‐resolution image, which takes advantage of the computational advances of deep learning to accelerate the reconstruction. The method is validated on diverse biological structures and in vivo imaging of zebrafish at a depth of 100 μm. The results show that high‐quality, super‐resolution images can be reconstructed in one‐third of the runtime consumed by conventional MSIM method, without compromising spatial resolution. Last but not least, a fourfold reduction in the number of raw images required for reconstruction is achieved by using the same network architecture, yet with different training data.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
Field-dependent deep learning enables high-throughput whole-cell 3D super-resolution imaging

Shuang Fu,Wei Shi,Tingdan Luo,Yingchuan He,Lulu Zhou,Jie Yang,Zhichao Yang,Jiadong Liu,Xiaotian Liu,Zhiyong Guo,Chengyu Yang,Chao Liu,Zhen-li Huang,Jonas Ries,Mingjie Zhang,Peng Xi,Dayong Jin,Yiming Li

DOI: https://doi.org/10.1038/s41592-023-01775-5

IF: 48

2023-02-25

Nature Methods

Abstract:Single-molecule localization microscopy in a typical wide-field setup has been widely used for investigating subcellular structures with super resolution; however, field-dependent aberrations restrict the field of view (FOV) to only tens of micrometers. Here, we present a deep-learning method for precise localization of spatially variant point emitters (FD-DeepLoc) over a large FOV covering the full chip of a modern sCMOS camera. Using a graphic processing unit-based vectorial point spread function (PSF) fitter, we can fast and accurately model the spatially variant PSF of a high numerical aperture objective in the entire FOV. Combined with deformable mirror-based optimal PSF engineering, we demonstrate high-accuracy three-dimensional single-molecule localization microscopy over a volume of ~180 × 180 × 5 μm 3 , allowing us to image mitochondria and nuclear pore complexes in entire cells in a single imaging cycle without hardware scanning; a 100-fold increase in throughput compared to the state of the art.

biochemical research methods
Large depth-of-field ultra-compact microscope by progressive optimization and deep learning

Yuanlong Zhang,Xiaofei Song,Jiachen Xie,Jing Hu,Jiawei Chen,Xiang Li,Haiyu Zhang,Qiqun Zhou,Lekang Yuan,Chui Kong,Yibing Shen,Jiamin Wu,Lu Fang,Qionghai Dai

DOI: https://doi.org/10.1038/s41467-023-39860-0

2023-07-13

Guangxue Jishu/Optical Technique

Abstract:Abstract The optical microscope is customarily an instrument of substantial size and expense but limited performance. Here we report an integrated microscope that achieves optical performance beyond a commercial microscope with a 5×, NA 0.1 objective but only at 0.15 cm 3 and 0.5 g, whose size is five orders of magnitude smaller than that of a conventional microscope. To achieve this, a progressive optimization pipeline is proposed which systematically optimizes both aspherical lenses and diffractive optical elements with over 30 times memory reduction compared to the end-to-end optimization. By designing a simulation-supervision deep neural network for spatially varying deconvolution during optical design, we accomplish over 10 times improvement in the depth-of-field compared to traditional microscopes with great generalization in a wide variety of samples. To show the unique advantages, the integrated microscope is equipped in a cell phone without any accessories for the application of portable diagnostics. We believe our method provides a new framework for the design of miniaturized high-performance imaging systems by integrating aspherical optics, computational optics, and deep learning.
Compressive Confocal Microscopy Imaging at the Single-Photon Level with Ultra-Low Sampling Ratios

Shuai Liu,Bin Chen,Wenzhen Zou,Hao Sha,Xiaochen Feng,Sanyang Han,Xiu Li,Xuri Yao,Jian Zhang,Yongbing Zhang

DOI: https://doi.org/10.1038/s44172-024-00236-x

2024-01-01

Communications Engineering

Abstract:Laser-scanning confocal microscopy serves as a critical instrument for microscopic research in biology. However, it suffers from low imaging speed and high phototoxicity. Here we build a novel deep compressive confocal microscope, which employs a digital micromirror device as a coding mask for single-pixel imaging and a pinhole for confocal microscopic imaging respectively. Combined with a deep learning reconstruction algorithm, our system is able to achieve high-quality confocal microscopic imaging with low phototoxicity. Our imaging experiments with fluorescent microspheres demonstrate its capability of achieving single-pixel confocal imaging with a sampling ratio of only approximately 0.03% in specific sparse scenarios. Moreover, the deep compressive confocal microscope allows single-pixel imaging at the single-photon level, thus reducing the excitation light power requirement for confocal imaging and suppressing the phototoxicity. We believe that our system has great potential for long-duration and high-speed microscopic imaging of living cells.
Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Kevin de Haan,Y. Rivenson,Yichen Wu,A. Ozcan

DOI: https://doi.org/10.1109/JPROC.2019.2949575

IF: 20.6

2020-01-01

Proceedings of the IEEE

Abstract:In recent years, deep learning has been shown to be one of the leading machine learning techniques for a wide variety of inference tasks. In addition to its mainstream applications, such as classification, it has created transformative opportunities for image reconstruction and enhancement in optical microscopy. Some of these emerging applications of deep learning range from image transformations between microscopic imaging systems to adding new capabilities to existing imaging techniques, as well as solving various inverse problems based on microscopy image data. Deep learning is helping us move toward data-driven instrument designs that blend microscopy and computing to achieve what neither can do alone. This article provides an overview of some of the recent work using deep neural networks to advance computational microscopy and sensing systems, also covering their current and future biomedical applications.

Physics,Engineering,Computer Science
Simulation-driven Learning: a Deep Learning Approach for Image Scanning Microscopy Via Physical Imaging Models

Baoyuan Zhang,Xuefeng Sun,Hongxia Yang,Cheng Guo,Biwei Wu,Jiubin Tan,Weibo Wang

DOI: https://doi.org/10.1364/oe.450429

IF: 3.8

2022-01-01

Optics Express

Abstract:Image reconstruction based on deep learning has become an effective tool in fluorescence microscopy. Most deep learning reconstruction methods ignore the mechanism of the imaging process where a large number of datasets are required. In addition, a lot of time is spent solving the aliasing problem from multi-scaled image pairs for data pre-processing. Here we demonstrate an improved generative adversarial network for image scanning microscopy (ISM) that can be trained by simulation data and has good generalization. Based on physical imaging models, this method can generate matching image pairs from simulation images and uses them as datasets for network training, without capturing a large number of real ISM images and avoiding image alignment preprocessing. Simulation and experimental results show that this simulation data-driven method improves the imaging quality of conventional microscopic images and reduces the cost of experiments. This method provides inspiration for optimizing network generalizability of the deep learning network.
DeepLFM: Deep Learning-based 3D Reconstruction for Light Field Microscopy

Xiaoxu Li,Hui Qiao,Jiamin Wu,Zhi Lu,Tao Yan,Ruxin Zhang,Xu Zhang,Qionghai Dai

DOI: https://doi.org/10.1364/ntm.2019.nm3c.2

2019-01-01

Abstract:We propose a high-resolution 3D reconstruction method for light field microscopy via deep learning. Experimental results on K562 cells verify its superior performance, which exhibit less artifacts especially near the native object plane.

Advancing Computational Miniature Mesoscope with Simulator-based Deep Learning Reconstruction

Deep-learning-augmented Computational Miniature Mesoscope

Fluorescence Interference Structured Illumination Microscopy for 3D Morphology Imaging with High Axial Resolution

Single-Shot 3D Widefield Fluorescence Imaging with a Computational Miniature Mesoscope

DeepLeMiN: Deep-learning-empowered Physics-aware Lensless Miniscope

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

3D Super-Resolution Microscopy Based on Nonlinear Gradient Descent Structured Illumination.

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy (Adv. Sci. 27/2023)

GEOMScope: Large Field-of-view 3D Lensless Microscopy with Low Computational Complexity

Robust single-shot 3D fluorescence imaging in scattering media with a simulator-trained neural network

Deep-learning Light-Field Microscopy with Improved Resolution and Reconstruction Speed

Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy

Field-dependent deep learning enables high-throughput whole-cell 3D super-resolution imaging

Large depth-of-field ultra-compact microscope by progressive optimization and deep learning

Compressive Confocal Microscopy Imaging at the Single-Photon Level with Ultra-Low Sampling Ratios

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Simulation-driven Learning: a Deep Learning Approach for Image Scanning Microscopy Via Physical Imaging Models

DeepLFM: Deep Learning-based 3D Reconstruction for Light Field Microscopy