Abstract:Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in many different 2D medical image analysis tasks. In clinical practice, however, a large part of the medical imaging data available is in 3D, e.g, magnetic resonance imaging (MRI) data, computed tomography (CT) data and data generated by many other modalities. This has motivated the development of 3D CNNs for volumetric image segmentation in order to benefit from more spatial context. Due to GPU memory restrictions caused by moving to fully 3D, state-of-the-art methods depend on subvolume/patch processing and the size of the input patch is usually small, limiting the incorporation of larger context information for a better performance. In this paper, we propose a novel Holistic Decomposition Convolution (HDC), which learns a number of separate kernels within the same layer and can be regarded as an inverse operation to the previously introduced Dense Upsampling Convolution (DUC), for an effective and efficient semantic segmentation of medical volume images. HDC consists of a periodic down-shuffling operation followed by a conventional 3D convolution. HDC has the advantage of significantly reducing the size of the data for sub-sequential processing while using all the information available in the input irrespective of the down-shuffling factors. We apply HDC directly to the input data, whose output will be used as the input to sub-sequential CNNs. In order to achieve volumetric dense prediction at final output, we need to recover full resolution, which is done by using DUC. We show that both HDC and DUC are network agnostic and can be combined with different CNNs for an improved performance in both training and testing phases. Results obtained from comprehensive experiments conducted on both MRI and CT data of different anatomical regions demonstrate the efficacy of the present approach.

Efficient 3D affinely equivariant CNNs with adaptive fusion of augmented spherical Fourier-Bessel bases

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation.

Adaptive aggregation of Monte Carlo augmented decomposed filters for efficient group-equivariant convolutional neural network

Group Shift Pointwise Convolution for Volumetric Medical Image Segmentation.

Scale-Equivariant Deep Learning for 3D Data

Leveraging SO(3)-steerable convolutions for pose-robust semantic segmentation in 3D medical data

Factoring 3D Convolutions for Medical Images by Depth-wise Dependencies-induced Adaptive Attention.

Holistic Decomposition Convolution for Effective Semantic Segmentation of Medical Volume Images.

3D Tiled Convolution for Effective Segmentation of Volumetric Medical Images

3D ConvNet+: A lightweight adaptive network for 3D medical image segmentation

Bridging 2D and 3D Segmentation Networks for Computation Efficient Volumetric Medical Image Segmentation: An Empirical Study of 2.5D Solutions

Multimodal MRI Volumetric Data Fusion With Convolutional Neural Networks

V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation

Spherical CNN for Medical Imaging Applications: Importance of Equivariance in image reconstruction and denoising

A 3D Convolutional Neural Network for Volumetric Image Semantic Segmentation

Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation

A Dynamic Group Equivariant Convolutional Networks for Medical Image Analysis.

Anisotropic Hybrid Network For Cross-Dimension Transferable Feature Learning In 3d Medical Images

Holistic Decomposition Convolution for Effective Semantic Segmentation of 3D MR Images