Abstract:Abstract Invasion of neighboring tissues is a cardinal feature of malignancy, notably observed in aggressive cancers like breast cancer, where it can lead to significant morbidity. To explore cancer invasion dynamics, the implementation of a three-dimensional (3D) tumor spheroid invasion assay offers a swift approach to mimicking a tumor micro-region or micro-metastasis. Differential Interference Contrast (DIC) time-lapse imaging was chosen for its fluorescence-free and non-destructive advantages in capturing live spheroid movement. However, the subsequent analysis posed challenges, including out-of-focus cells and a voluminous dataset with diverse microscope planes and time points. Our study introduces a segmentation framework featuring in-focus spatial stacking algorithm and novel training architecture that enabling in-depth automated analysis of 3D spheroid invasion behaviors within a microenvironment. Firstly, the MDA-MB-231 breast cancer spheroids were cultured in a microwell dish and then incorporated into a collagen type I matrix for the 3D spheroid invasion assay. Capturing spheroid invasion dynamics involved acquiring 15 z-plane images (spaced at 20 μm intervals) per timepoint for each spheroid using DIC microscopy at 15-minute intervals over a 28-hour period, employing a 20X objective lens. We refined the Focus Stacking framework into Multiple Slices Blurry Stacking (MSB-Stack) by pre-filtering blurred areas before stacking images. This process produced 6390 slices consolidated into 426 labeled stacked images, highlighting Invasive area, Spheroid core, and Invasive cells post-invasion. We then enhanced Mask R-CNN (Region based-Convolutional Neural Networks) with a weak-to-strong augmentation mechanism, leveraging well-segmented samples from MSB-Stack for training on both fully stacked and blurred images. Blurry Consistency Mask R-CNN (BCMask R-CNN) demonstrates overall improvement across feature extractors, outperforming Mask R-CNN. Using Mean average precision (mAP) as the main metric for instance segmentation and detection, our proposed model achieves 73.0% and 65.2% on mAP @[0.5, 0.95], showcasing robustness. Notably, our best results for mAP @0.5 reach 96.6% and 96.7% on both tasks, underscoring the effectiveness of consistency training in mitigating unclear boundary issues during preprocessing. In conclusion, our proposed method, MSB-Stack, effectively addresses the challenge of unclear boundaries in 3D breast cancer cell DIC microscopy datasets. The integration of weak-to-strong consistency training in our model, BCMask R-CNN, not only mitigates biases but also enhances performance across different backbones, setting the stage for future advancements in cell-tracking tasks and broader migratory analyses. Citation Format: Thi Kim Ngan Ngo, Thanh-Huy Nguyen, Fang-Yu Lin, Ting-Yuan Tu. A deep learning framework for automated segmentation and analysis of 3D breast cancer spheroid invasion dynamics [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 2306.

A Confident Scale–space Shape Representation Framework for Cell Migration Detection

Model&Motion Based Shape Tracking In Large-Scale Cellular Datasets

Transfer Shape Modeling Towards High-throughput Microscopy Image Segmentation.

Automated Segmentation And Tracking Of Cells In Time-Lapse Microscopy Using Watershed And Mean Shift

Nuclei Segmentation Using Marker-Controlled Watershed, Tracking Using Mean-Shift, and Kalman Filter in Time-Lapse Microscopy

HFM-Tracker: A Cell Tracking Algorithm Based on Hybrid Feature Matching

A novel deep learning-based 3D cell segmentation framework for future image-based disease detection

Automatic Cell Segmentation in Fluorescence Images of Confluent Cell Monolayers Using Multi-object Geometric Deformable Model

Learning Pseudo Scale Instance Maps for Cell Localization

Cascaded Diffusion Models for 2D and 3D Microscopy Image Synthesis to Enhance Cell Segmentation

A Multi-Scale Cell Segmentation Method for Detecting Hematological Disorders

A novel cell contour-based instance segmentation model and its applications in HER2 breast cancer discrimination

An Image Analysis Tool for Cell Migration Assay with a Large Sample Size

Cell migration analysis: Segmenting scratch assay images with level sets and support vector machines

Constrained Multi-shape Evolution for Overlapping Cytoplasm Segmentation

A novel coarse-to-fine adaptation segmentation approach for cellular image analysis

Automated Segmentation of Overlapping Cytoplasm in Cervical Smear Images Via Contour Fragments

MCSF-Net: a multi-scale channel spatial fusion network for real-time polyp segmentation

Abstract 2306: A deep learning framework for automated segmentation and analysis of 3D breast cancer spheroid invasion dynamics

Multi-layer Segmentation Framework for Cell Nuclei Using Improved GVF Snake Model, Watershed, and Ellipse Fitting.

Adaptive Focal Inverse Distance Transform Maps for Cell Recognition