Abstract:Widefield microscopy methods applied to optically thick specimens are faced with reduced contrast due to spatial crosstalk, in which the signal at each point is the result of a superposition from neighboring points that are simultaneously illuminated. In 1955, Marvin Minsky proposed confocal microscopy as a solution to this problem. Today, laser scanning confocal fluorescence microscopy is broadly used due to its high depth resolution and sensitivity, which come at the price of photobleaching, chemical, and photo-toxicity. Here, we present artificial confocal microscopy (ACM) to achieve confocal-level depth sectioning, sensitivity, and chemical specificity, on unlabeled specimens, nondestructively. We augmented a laser scanning confocal instrument with a quantitative phase imaging module, which provides optical pathlength maps of the specimen on the same field of view as the fluorescence channel. Using pairs of phase and fluorescence images, we trained a convolution neural network to translate the former into the latter. The training to infer a new tag is very practical as the input and ground truth data are intrinsically registered and the data acquisition is automated. Remarkably, the ACM images present significantly stronger depth sectioning than the input images, enabling us to recover confocal-like tomographic volumes of microspheres, hippocampal neurons in culture, and 3D liver cancer spheroids. By training on nucleus-specific tags, ACM allows for segmenting individual nuclei within dense spheroids for both cell counting and volume measurements. Furthermore, taking the estimated fluorescence volumes, as annotation for the phase data, we extracted dry mass information for individual nuclei. Finally, our results indicate that the network learning can be transferred between spheroids suspended in different media.

Real-time simultaneous refractive index and thickness mapping of sub-cellular biology at the diffraction limit

Phase Microscopy Using Light-Field Reconstruction Method for Cell Observation

Deep Tissue Focusing Based on Machine Learning

Label-free multiplexed microtomography of endogenous subcellular dynamics using generalizable deep learning

Near-Membrane Refractometry Using Supercritical Angle Fluorescence

Three-dimensional bi-functional refractive index and fluorescence microscopy (BRIEF)

3D correlative single-cell imaging utilizing fluorescence and refractive index tomography

Quantitative 3D refractive index tomography of opaque samples in epi-mode

Depth-Resolved Localization Microangiography in the NIR-II Window

Time-Resolved Scanning Ion Conductance Microscopy for Three-Dimensional Tracking of Nanoscale Cell Surface Dynamics

Improving specificity and axial spatial resolution of refractive index imaging by exploiting uncorrelated subcellular dynamics

Integral refractive index imaging of flowing cell nuclei using quantitative phase microscopy combined with fluorescence microscopy

Quantitative and long-term cell imaging with computational hyperspectral interferometry

A Polymer Index-Matched to Water Enables Diverse Applications in Fluorescence Microscopy.

Artificial confocal microscopy for deep label-free imaging

Remote imaging of single cell 3D morphology with ultrafast coherent phonons and their resonance harmonics

Quantitative refractive index distribution of single cell by combining phase-shifting interferometry and AFM imaging

Label-free Brillouin endo-microscopy for the quantitative 3D imaging of sub-micrometre biology

Fluorescence Diffraction Tomography using Explicit Neural Fields

Simultaneous microscopic imaging of thickness and refractive index of thin layers by heterodyne interferometric reflectometry (HiRef)

Label-free Tomography of Living Cellular Nanoarchitecture Using Hyperspectral Self-Interference Microscopy.