Abstract:Ca imaging methods are widely used for studying cellular activity in the brain, allowing detailed analysis of dynamic processes across various scales. Enhanced by high-contrast optical microscopy and fluorescent Ca sensors, this technique can be used to reveal localized Ca fluctuations within neurons, including in sub-cellular compartments, such as the dendritic shaft or spines. Despite advances in Ca sensors, the analysis of miniature Synaptic Calcium Transients (mSCTs), characterized by variability in morphology and low signal-to-noise ratios, remains challenging. Traditional threshold-based methods struggle with the detection and segmentation of these small, dynamic events. Deep learning (DL) approaches offer promising solutions but are limited by the need for large annotated datasets. Positive Unlabeled (PU) learning addresses this limitation by leveraging unlabeled instances to increase dataset size and enhance performance. This approach is particularly useful in the case of mSCTs that are scarce and small, associated with a very small proportion of the foreground pixels. PU learning significantly increases the effective size of the training dataset, improving model performance. Here, we present a PU learning-based strategy for detecting and segmenting mSCTs. We evaluate the performance of two 3D deep learning models, StarDist-3D and 3D U-Net, which are well established for the segmentation of small volumetric structures in microscopy datasets. By integrating PU learning, we enhance the 3D U-Net's performance, demonstrating significant gains over traditional methods. This work pioneers the application of PU learning in Ca imaging analysis, offering a robust framework for mSCT detection and segmentation. We also demonstrate how this quantitative analysis pipeline can be used for subsequent mSCTs feature analysis. We characterize morphological and kinetic changes of mSCTs associated with the application of chemical long-term potentiation (cLTP) stimulation in cultured rat hippocampal neurons. Our data-driven approach shows that a cLTP-inducing stimulus leads to the emergence of new active dendritic regions and differently affects mSCTs subtypes.

What problem does this paper attempt to address?

This paper aims to address the challenges in the detection and segmentation of miniature Synaptic Calcium Transients (mSCTs). Specifically, mSCTs are characterized by diverse morphologies, low signal intensity, and low signal - to - noise ratio, which makes traditional threshold - based methods ineffective in detecting and segmenting these tiny dynamic events. The paper proposes a deep - learning method based on Positive Unlabeled (PU) learning to improve the detection and segmentation performance of mSCTs. ### Main problems 1. **Detection and segmentation of mSCTs**: - **Problem background**: mSCTs are NMDA - receptor - driven calcium influxes caused by the spontaneous release of glutamate vesicles in neurons. These events show wide variations in morphology, spatio - temporal propagation, and peak - to - background intensity fluctuations, but usually have low signal intensity and low signal - to - noise ratio. - **Limitations of existing methods**: Traditional threshold - based methods perform poorly when dealing with these tiny and dynamically changing events, especially when the events propagate or change in size and shape. Although deep - learning methods are effective, they require a large amount of labeled data, and mSCTs account for a very small proportion in the image, making it difficult to obtain sufficient labeled data. 2. **Challenges in data labeling**: - **Scarcity of labeled data**: mSCTs account for a very small proportion in the image (less than 0.05% of the total pixels, or less than 0.3% of the foreground pixels), so it is very difficult to obtain a large amount of labeled data. - **Labeling of negative samples**: In many experimental environments, negative samples (i.e., pixels without calcium events) occupy most of the image, which brings additional challenges to the training of deep - learning models. ### Solutions 1. **Application of PU learning**: - **Principle of PU learning**: PU learning improves the performance of the model by using unlabeled instances to increase the size of the training data set. In the PU learning framework, the network learns from positive samples (mSCTs detected by IDT) and unlabeled samples (regions extracted from the foreground). - **Specific implementation**: The paper uses two 3D deep - learning models - StarDist - 3D and 3D U - Net, and enhances the performance of 3D U - Net by introducing PU learning. 2. **Model evaluation**: - **Detection performance evaluation**: The detection performance of the model is evaluated by the Hungarian algorithm and the linear assignment problem. Evaluation metrics include precision, recall, and average precision (AP). - **Segmentation performance evaluation**: The segmentation performance of the model is evaluated by the Dice similarity score. In addition, the performance of the model is verified by the annotation consistency among experts. ### Experimental results - **Detection performance**: PU learning significantly improves the detection performance of 3D U - Net, especially when dealing with mSCTs of different intensities. - **Segmentation performance**: PU learning also significantly improves the segmentation performance of 3D U - Net, and its Dice similarity score exceeds the average consistency level among experts. ### Conclusion This paper successfully applies PU learning to solve the challenges in the detection and segmentation of mSCTs, providing a robust framework that can be used for subsequent mSCT feature analysis. By combining PU learning and 3D deep - learning models, this method shows significant advantages in detecting and segmenting mSCTs.

Quantitative Analysis of Miniature Synaptic Calcium Transients Using Positive Unlabeled Deep Learning

Learning Consistent Subcellular Landmarks to Quantify Changes in Multiplexed Protein Maps.

3D Reconstruction of Synapses with Deep Learning Based on EM Images

A Neurocomputational Method for Fully Automated 3D Dendritic Spine Detection and Segmentation of Medium-Sized Spiny Neurons

Multiscale assay of unlabeled neurite dynamics using phase imaging with computational specificity (PICS)

Fast and robust active neuron segmentation in two-photon calcium imaging using spatiotemporal deep learning

NeuroSeg-II: A Deep Learning Approach for Generalized Neuron Segmentation in Two-Photon Ca2+ Imaging

An end-to-end recurrent compressed sensing method to denoise, detect and demix calcium imaging data

Revealing architectural order with quantitative label-free imaging and deep learning

Deep-Learning-Based Segmentation of Cells and Analysis (DL-SCAN)

Effective automated pipeline for 3D reconstruction of synapses based on deep learning

Deep residual contextual and subpixel convolution network for automated neuronal structure segmentation in micro-connectomics

An Algorithm Based on a Cable-Nernst Planck Model Predicting Synaptic Activity throughout the Dendritic Arbor with Micron Specificity

SynapseNet: Deep Learning for Automatic Synapse Reconstruction

A deep learning-based strategy for producing dense 3D segmentations from sparsely annotated 2D images

NeuroSeg-III: Efficient Neuron Segmentation in Two-Photon Ca2+ Imaging Data Using Self-Supervised Learning

NeuroQuantify -- An Image Analysis Software for Detection and Quantification of Neurons and Neurites using Deep Learning

The cytoarchitectonic landscape revealed by deep learning method facilitated precise positioning in mouse neocortex

CalTrig: A GUI-Based Machine Learning Approach for Decoding Neuronal Calcium Transients in Freely Moving Rodents

Deep-learning-based flexible pipeline for segmenting and tracking cells in 3D image time series for whole brain imaging

Segmentation of Synapses in Fluorescent Images using U-Net++ and Gabor-based Anisotropic Diffusion