Abstract:Highlights • Introduce a data augmentation strategy to expand the required different morphological data during the training and learning phase, and improve the algorithm’s feature learning ability for complex and diverse tumor morphology CT images. • Design attention mechanisms for encoding and decoding paths to extract fine pixel level features, improve feature extraction capabilities, and achieve efficient spatial channel feature fusion. • The deep supervision layer is used to correct and decode the final image data to provide high accuracy of results. • The effectiveness of this method has been affirmed through validation on the LITS, 3DIRCADb, and SLIVER datasets. BACKGROUND: Accurately extracting liver and liver tumors from medical images is an important step in lesion localization and diagnosis, surgical planning, and postoperative monitoring. However, the limited number of radiation therapists and a great number of images make this work time-consuming. OBJECTIVE: This study designs a spatial attention deep supervised network (SADSNet) for simultaneous automatic segmentation of liver and tumors. METHOD: Firstly, self-designed spatial attention modules are introduced at each layer of the encoder and decoder to extract image features at different scales and resolutions, helping the model better capture liver tumors and fine structures. The designed spatial attention module is implemented through two gate signals related to liver and tumors, as well as changing the size of convolutional kernels; Secondly, deep supervision is added behind the three layers of the decoder to assist the backbone network in feature learning and improve gradient propagation, enhancing robustness. RESULTS: The method was testing on LITS, 3DIRCADb, and SLIVER datasets. For the liver, it obtained dice similarity coefficients of 97.03%, 96.11%, and 97.40%, surface dice of 81.98%, 82.53%, and 86.29%, 95% hausdorff distances of 8.96 mm, 8.26 mm, and 3.79 mm, and average surface distances of 1.54 mm, 1.19 mm, and 0.81 mm. Additionally, it also achieved precise tumor segmentation, which with dice scores of 87.81% and 87.50%, surface dice of 89.63% and 84.26%, 95% hausdorff distance of 12.96 mm and 16.55 mm, and average surface distances of 1.11 mm and 3.04 mm on LITS and 3DIRCADb, respectively. CONCLUSION: The experimental results show that the proposed method is effective and superior to some other methods. Therefore, this method can provide technical support for liver and liver tumor segmentation in clinical practice.

Siamese Spatial Pyramid Matching Network with Location Prior for Anatomical Landmark Tracking in 3-Dimension Ultrasound Sequence

Siamese Networks with Location Prior for Landmark Tracking in Liver Ultrasound Sequences

Tracking 3D ultrasound anatomical landmarks via three orthogonal plane-based scale discriminative correlation filter network

FPSN-FNCC: an accurate and fast motion tracking algorithm in 3D ultrasound for image-guided interventions

Landmark Tracking in Liver US images Using Cascade Convolutional Neural Networks with Long Short-Term Memory

Self-supervised context-aware correlation filter for robust landmark tracking in liver ultrasound sequences

LSDM: Long-Short Diffeomorphic Motion for Weakly-Supervised Ultrasound Landmark Tracking

3D Pyramidal Densely Connected Network with Cross-Frame Uncertainty Guidance for Intravascular Ultrasound Sequence Segmentation.

Cascaded one-shot deformable convolutional neural networks: Developing a deep learning model for respiratory motion estimation in ultrasound sequences

Deep learning-based motion tracking using ultrasound images

Deep Lesion Tracker: Monitoring Lesions in 4D Longitudinal Imaging Studies

Long-short diffeomorphism memory network for weakly-supervised ultrasound landmark tracking

Three-Dimensional Ultrasound Localization Microscopy with Bipartite Graph-Based Microbubble Pairing and Kalman-Filtering-Based Tracking on a 256-Channel Verasonics Ultrasound System with a 32 × 32 Matrix Array

Searching collaborative agents for multi-plane localization in 3D ultrasound

Deep Learning for Ultrasound Localization Microscopy

Privileged Anatomical and Protocol Discrimination in Trackerless 3D Ultrasound Reconstruction

SADSNet: A robust 3D synchronous segmentation network for liver and liver tumors based on spatial attention mechanism and deep supervision

Automatic multi-plaque tracking and segmentation in ultrasonic videos

Adaptive 3D Localization of 2D Freehand Ultrasound Brain Images

SIAMATSN: REAL-TIME CAROTID PLAQUE TRACKING AND SEGMENTATION OF ULTRASONIC VIDEOS

OS-DS tracker: Orientation-variant Siamese 3D tracking with Detection based Sampling