Abstract:We demonstrate a deep learning-enabled light field microscopy (LFM) to achieve 1 μm -resolution volumetric functional imaging of acting samples at high speed up to 100 Hz. For the raw light field measurement, the use of field detection optics usually limits the recoverable spatial resolution. We develop a deep learning approach to mitigate this limitation and effectively recover a time sequence of higher-resolution 3-D images based on the raw 2-D light field video. Unlike slow iterative LF reconstruction methods, our network approach permits direct inference at video-rate processing throughput (16 volumes per second), which is well suited for sustained volumetric recording of biological dynamics. To obtain optimal network recovery for reconstructing thick specimens, we further use a light-sheet illumination geometry to record high-contrast light field images with less signal overlapping. We demonstrate the success of our approach by intoto imaging the neuronal activities of behaving C. elegans and visualizing the cardiovascular hemodynamics inside zebrafish embryo.

Deep Learning Light Field Microscopy for Video-Rate Volumetric Functional Imaging of Behaving Animal