Dense-sparse representation matters: A point-based method for volumetric medical image segmentation

Yun Jiang,Bingxi Liu,Zequn Zhang,Yao Yan,Huanting Guo,Yuhang Li
DOI: https://doi.org/10.1016/j.jvcir.2024.104115
IF: 2.887
2024-03-13
Journal of Visual Communication and Image Representation
Abstract:Deep learning methods utilizing Convolutional Neural Networks (CNNs) and Transformers have achieved remarkable success in volumetric medical image analysis. While successful, the symmetrical structure of numerous networks pays insufficient attention to the encoding phase, and the large amount of memory occupied by voxels leads to unnecessary redundancy in the network. In this paper, we present a novel approach to handle volumetric medical images by converting them into point cloud and introduce a new asymmetrical segmentation architecture. We propose a dual-path encoder that fully captures both dense and sparse representations of the input point cloud sampled from volumes. Moreover, the two obtained representations are subtracted at the skip connection as a complementary feature during the decoding stage. Experimental results on the Brain Tumor Segmentation (BraTS) and the Multi-sequence Cardiac MR Segmentation tasks demonstrate the great potential of our point-based method for volumetric medical image segmentation.
computer science, information systems, software engineering
What problem does this paper attempt to address?