Abstract:Fluorescence microscopy is essential to study biological structures and dynamics. However, existing systems suffer from a tradeoff between field-of-view (FOV), resolution, and complexity, and thus cannot fulfill the emerging need of miniaturized platforms providing micron-scale resolution across centimeter-scale FOVs. To overcome this challenge, we developed Computational Miniature Mesoscope (CM$^2$) that exploits a computational imaging strategy to enable single-shot 3D high-resolution imaging across a wide FOV in a miniaturized platform. Here, we present CM$^2$ V2 that significantly advances both the hardware and computation. We complement the 3$\times$3 microlens array with a new hybrid emission filter that improves the imaging contrast by 5$\times$, and design a 3D-printed freeform collimator for the LED illuminator that improves the excitation efficiency by 3$\times$. To enable high-resolution reconstruction across the large imaging volume, we develop an accurate and efficient 3D linear shift-variant (LSV) model that characterizes the spatially varying aberrations. We then train a multi-module deep learning model, CM$^2$Net, using only the 3D-LSV simulator. We show that CM$^2$Net generalizes well to experiments and achieves accurate 3D reconstruction across a $\sim$7-mm FOV and 800-$\mu$m depth, and provides $\sim$6-$\mu$m lateral and $\sim$25-$\mu$m axial resolution. This provides $\sim$8$\times$ better axial localization and $\sim$1400$\times$ faster speed as compared to the previous model-based algorithm. We anticipate this simple and low-cost computational miniature imaging system will be impactful to many large-scale 3D fluorescence imaging applications.

Portable Deep Learning Singlet Microscope

Deep Learning Virtual Colorization Overcoming Chromatic Aberrations in Singlet Lens Microscopy

Deep Learning Virtual Zernike Phase Contrast Imaging for Singlet Microscopy

Smart-phone Phase Contrast Microscope with a Singlet Lens and Deep Learning

Portable Deep Learning Singlet Multi-Spectral Microscope

Deep Learning Colorful Ptychographic Iterative Engine Lens-Less Diffraction Microscopy

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Portable Multi-Spectral Lens-Less Microscope with Wavelength-Self-calibrating Imaging Sensor

Large depth-of-field ultra-compact microscope by progressive optimization and deep learning

Deep-learning-augmented Computational Miniature Mesoscope

DeepLeMiN: Deep-learning-empowered Physics-aware Lensless Miniscope

Deep Learning Enhanced Achromatic Imaging with a Singlet Flat Lens.

Deep Learning Microscopy

End-to-end Computational Optics with a Singlet Lens for Large Depth-of-field Imaging

Deep learning enhanced mobile-phone microscopy

Deep Learning Virtual Colorful Lens-Free On-Chip Microscopy

Deep Learning Enables Large Depth-of-Field Images for Sub-Diffraction-Limit Scanning Superlens Microscopy

Field-portable Quantitative Lensless Microscopy Based on Translated Speckle Illumination and Sub-Sampled Ptychographic Phase Retrieval

A PORTABLE STANDALONE MICROSCOPE BY ATTACHING A COMPACT MODULE TO A DIGITAL CAMERA

Unlabeled Far‐Field Deeply Subwavelength Topological Microscopy (DSTM)

Deep learning for lensless imaging