Abstract:Background: Targeted prostate biopsy guided by multiparametric magnetic resonance imaging (mpMRI) detects more clinically significant lesions than conventional systemic biopsy. Lesion segmentation is required for planning MRI-targeted biopsies. The requirement for integrating image features available in T2-weighted and diffusion-weighted images poses a challenge in prostate lesion segmentation from mpMRI. Purpose: A flexible and efficient multistream fusion encoder is proposed in this work to facilitate the multiscale fusion of features from multiple imaging streams. A patch-based loss function is introduced to improve the accuracy in segmenting small lesions. Methods: The proposed multistream encoder fuses features extracted in the three imaging streams at each layer of the network, thereby allowing improved feature maps to propagate downstream and benefit segmentation performance. The fusion is achieved through a spatial attention map generated by optimally weighting the contribution of the convolution outputs from each stream. This design provides flexibility for the network to highlight image modalities according to their relative influence on the segmentation performance. The encoder also performs multiscale integration by highlighting the input feature maps (low-level features) with the spatial attention maps generated from convolution outputs (high-level features). The Dice similarity coefficient (DSC), serving as a cost function, is less sensitive to incorrect segmentation for small lesions. We address this issue by introducing a patch-based loss function that provides an average of the DSCs obtained from local image patches. This local average DSC is equally sensitive to large and small lesions, as the patch-based DSCs associated with small and large lesions have equal weights in this average DSC. Results: The framework was evaluated in 931 sets of images acquired in several clinical studies at two centers in Hong Kong and the United Kingdom. In particular, the training, validation, and test sets contain 615, 144, and 172 sets of images, respectively. The proposed framework outperformed single-stream networks and three recently proposed multistream networks, attaining F1 scores of 82.2 and 87.6% in the lesion and patient levels, respectively. The average inference time for an axial image was 11.8 ms. Conclusion: The accuracy and efficiency afforded by the proposed framework would accelerate the MRI interpretation workflow of MRI-targeted biopsy and focal therapies.

Attention Guided Multi Scale Feature Fusion Network for Automatic Prostate Segmentation

Attention-guided multi-scale learning network for automatic prostate and tumor segmentation on MRI

A dual attention-guided 3D convolution network for automatic segmentation of prostate and tumor

Automatic Prostate and Peri-prostatic Fat Segmentation based on Pyramid Mechanism Fusion Network for T2-Weighted MRI

A mixed Mamba U-net for prostate segmentation in MR images

Automatic Segmentation of Prostate MRI Based on 3D Pyramid Pooling Unet

Fully automatic segmentation on prostate MR images based on cascaded fully convolution network.

3D convolutional network with edge detection for prostate gland and tumor segmentation on T2WI and ADC

Scale Normalization Cascaded Dense-Unet For Prostate Segmentation In Mr Images

CAT-Net: A Cross-Slice Attention Transformer Model for Prostate Zonal Segmentation in MRI

3D Global Convolutional Adversarial Network\\ for Prostate MR Volume Segmentation

Attention-enhanced multiscale feature fusion network for pancreas and tumor segmentation

ProstAttention-Net: A deep attention model for prostate cancer segmentation by aggressiveness in MRI scans

CCT-Unet: A U-Shaped Network Based on Convolution Coupled Transformer for Segmentation of Peripheral and Transition Zones in Prostate MRI.

ProSegNet: A New Network of Prostate Segmentation Based on MR Images

Automatic segmentation of rectal tumors from MRI using multiscale densely connected convolutional neural network based on attention mechanism

A multi-object deep neural network architecture to detect prostate anatomy in T2-weighted MRI: Performance evaluation

A two-stage CNN method for MRI image segmentation of prostate with lesion

Prostate cancer segmentation from MRI by a multistream fusion encoder

A novel approach for automatic segmentation of prostate and its lesion regions on magnetic resonance imaging

Volumetric ConvNets with Mixed Residual Connections for Automated Prostate Segmentation from 3D MR Images