Abstract:Significance: Mesoscale neural imaging in vivo has gained extreme popularity in neuroscience for its capacity of recording large-scale neurons in action. Optical imaging with single-cell resolution and millimeter-level field of view in vivo has been providing an accumulated database of neuron-behavior correspondence. Meanwhile, optical detection of neuron signals is easily contaminated by noises, background, crosstalk, and motion artifacts, while neural-level signal processing and network-level coordinate are extremely complicated, leading to laborious and challenging signal processing demands. The existing data analysis procedure remains unstandardized, which could be daunting to neophytes or neuroscientists without computational background. Aim: We hope to provide a general data analysis pipeline of mesoscale neural imaging shared between imaging modalities and systems. Approach: We divide the pipeline into two main stages. The first stage focuses on extracting high-fidelity neural responses at single-cell level from raw images, including motion registration, image denoising, neuron segmentation, and signal extraction. The second stage focuses on data mining, including neural functional mapping, clustering, and brain-wide network deduction. Results: Here, we introduce the general pipeline of processing the mesoscale neural images. We explain the principles of these procedures and compare different approaches and their application scopes with detailed discussions about the shortcomings and remaining challenges. Conclusions: There are great challenges and opportunities brought by the large-scale mesoscale data, such as the balance between fidelity and efficiency, increasing computational load, and neural network interpretability. We believe that global circuits on single-neuron level will be more extensively explored in the future.

Deep learning in mesoscale brain image analysis: A review

A Survey on Applications of Deep Learning in Microscopy Image Analysis

Review on Data Analysis Methods for Mesoscale Neural Imaging in Vivo.

Review: Deep Learning in Electron Microscopy

Deep and shallow data science for multi-scale optical neuroscience

Deep learning of brain magnetic resonance images: A brief review

Two-stage Generative Models of Simulating Training Data at the Voxel Level for Large-Scale Microscopy Bioimage Segmentation

MesoNet allows automated scaling and segmentation of mouse mesoscale cortical maps using machine learning

Biological image analysis using deep learning-based methods: Literature review

Motivation for using data-driven algorithms in research: A review of machine learning solutions for image analysis of micrographs in neuroscience

Segmentation in large-scale cellular electron microscopy with deep learning: A literature survey

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Deep Learning in Neuroimaging: Promises and challenges

Roadmap on Deep Learning for Microscopy

Deep Learning for Cardiac Image Segmentation: A Review

DeepMRSeg: A convolutional deep neural network for anatomy and abnormality segmentation on MR images

Understanding important features of deep learning models for segmentation of high-resolution transmission electron microscopy images

Advancing electron microscopy using deep learning

Deep learning-based image processing in optical microscopy

Mesoscale microscopy for micromammals: image analysis tools for understanding the rodent brain

Recent advances and clinical applications of deep learning in medical image analysis