Abstract:Background: Spatial mapping of transcriptional states provides valuable biological insights into cellular functions and interactions in the context of the tissue. Accurate 3D cell segmentation is a critical step in the analysis of this data towards understanding diseases and normal development in situ. Current approaches designed to automate 3D segmentation include stitching masks along one dimension, training a 3D neural network architecture from scratch, and reconstructing a 3D volume from 2D segmentations on all dimensions. However, the applicability of existing methods is hampered by inaccurate segmentations along the non-stitching dimensions, the lack of high-quality diverse 3D training data, and inhomogeneity of image resolution along orthogonal directions due to acquisition constraints; as a result, they have not been widely used in practice. Methods: To address these challenges, we formulate the problem of finding cell correspondence across layers with a novel optimal transport (OT) approach. We propose CellStitch, a flexible pipeline that segments cells from 3D images without requiring large amounts of 3D training data. We further extend our method to interpolate internal slices from highly anisotropic cell images to recover isotropic cell morphology. Results: We evaluated the performance of CellStitch through eight 3D plant microscopic datasets with diverse anisotropic levels and cell shapes. CellStitch substantially outperforms the state-of-the art methods on anisotropic images, and achieves comparable segmentation quality against competing methods in isotropic setting. We benchmarked and reported 3D segmentation results of all the methods with instance-level precision, recall and average precision (AP) metrics. Conclusions: The proposed OT-based 3D segmentation pipeline outperformed the existing state-of-the-art methods on different datasets with nonzero anisotropy, providing high fidelity recovery of 3D cell morphology from microscopic images.

Efficient Betti Matching Enables Topology-Aware 3D Segmentation via Persistent Homology

Topologically Faithful Multi-class Segmentation in Medical Images

Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation.

Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation

Learning Persistent Homology of 3D Point Clouds

Topology-Aware Focal Loss for 3D Image Segmentation

Topology-Preserving Image Segmentation with Spatial-Aware Persistent Feature Matching

A hybrid framework for 3D medical image segmentation

Topology-Aware Loss for Aorta and Great Vessel Segmentation in Computed Tomography Images

Anatomically plausible segmentations: Explicitly preserving topology through prior deformations

Skeleton Recall Loss for Connectivity Conserving and Resource Efficient Segmentation of Thin Tubular Structures

Train-Free Segmentation in MRI with Cubical Persistent Homology

PI-Att: Topology Attention for Segmentation Networks through Adaptive Persistence Image Representation

Improved Topological Preservation in 3D Axon Segmentation and Centerline Detection using Geometric Assessment-driven Topological Smoothing (GATS)

TopoSeg: Topology-Aware Nuclear Instance Segmentation

One Network to Segment Them All: A General, Lightweight System for Accurate 3D Medical Image Segmentation

3x2: 3D Object Part Segmentation by 2D Semantic Correspondences

Cellstitch: 3D cellular anisotropic image segmentation via optimal transport

Lifted Wasserstein Matcher for Fast and Robust Topology Tracking

Topological Similarity Index and Loss Function for Blood Vessel Segmentation

A Learning-based Framework for Topology-Preserving Segmentation using Quasiconformal Mappings