Abstract:Fluorescence microscopy is essential to study biological structures and dynamics. However, existing systems suffer from a tradeoff between field-of-view (FOV), resolution, and complexity, and thus cannot fulfill the emerging need of miniaturized platforms providing micron-scale resolution across centimeter-scale FOVs. To overcome this challenge, we developed Computational Miniature Mesoscope (CM$^2$) that exploits a computational imaging strategy to enable single-shot 3D high-resolution imaging across a wide FOV in a miniaturized platform. Here, we present CM$^2$ V2 that significantly advances both the hardware and computation. We complement the 3$\times$3 microlens array with a new hybrid emission filter that improves the imaging contrast by 5$\times$, and design a 3D-printed freeform collimator for the LED illuminator that improves the excitation efficiency by 3$\times$. To enable high-resolution reconstruction across the large imaging volume, we develop an accurate and efficient 3D linear shift-variant (LSV) model that characterizes the spatially varying aberrations. We then train a multi-module deep learning model, CM$^2$Net, using only the 3D-LSV simulator. We show that CM$^2$Net generalizes well to experiments and achieves accurate 3D reconstruction across a $\sim$7-mm FOV and 800-$\mu$m depth, and provides $\sim$6-$\mu$m lateral and $\sim$25-$\mu$m axial resolution. This provides $\sim$8$\times$ better axial localization and $\sim$1400$\times$ faster speed as compared to the previous model-based algorithm. We anticipate this simple and low-cost computational miniature imaging system will be impactful to many large-scale 3D fluorescence imaging applications.

Increasing a microscope's effective field of view via overlapped imaging and machine learning

Deep Learning Colorful Ptychographic Iterative Engine Lens-Less Diffraction Microscopy

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Multi-image-distance Imaging System for Extending Depth-of-field

Nonlinear Focal Modulation Microscopy Based on Interleaved Reconstruction

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Simultaneous Multiview Capture and Fusion Improves Spatial Resolution in Wide-Field and Light-Sheet Microscopy

Large depth-of-field ultra-compact microscope by progressive optimization and deep learning

Accelerating iterative deconvolution and multiview fusion by orders of magnitude

Imaging with High Resolution and Wide Field of View Based on an Ultrathin Microlens Array

Multiple-view 3D digital image correlation based on pseudo-overlapped imaging

Optofluidic zoom system with increased field of view and less chromatic aberration

Super-Resolution Imaging via Angular Magnification

Full field-of-view hexagonal lattice structured illumination microscopy based on the phase shift of electro–optic modulators

Gigapixel imaging with a novel multi-camera array microscope

High-Quality Light Field Microscope Imaging Based on Microlens Arrays

Deep learning enables parallel camera with enhanced- resolution and computational zoom imaging

Increasing the spatial bandwidth product in Light Field Microscopy with remote scanning

Deep Learning Microscopy

Enhance imaging depth in wide-field two-photon microscopy by extended detection and computational reconstruction

Deep-learning-augmented Computational Miniature Mesoscope