Abstract:Segmentation of regions of interest (ROIs) in medical images is an important step for image analysis in computer-aided diagnosis systems. In recent years, segmentation methods based on fully convolutional networks (FCNs) have achieved great success in general images. FCN performance is primarily due to it leveraging large labeled datasets to hierarchically learn the features that correspond to the shallow appearance as well as the deep semantics of the images. However, such dependence on large dataset does not translate well into medical images where there is a scarcity of annotated medical training data, and FCN results in coarse ROI detections and poor boundary definitions. To overcome this limitation, medical image-specific FCN methods have been introduced with post-processing techniques to refine the segmentation results; however, the performance of these methods is reliant on the appropriate tuning of a large number of parameters and dependence on data-specific post-processing techniques. In this study, we leverage the state-of-the-art image feature learning method of generative adversarial network (GAN) for its inherent ability to produce consistent and realistic images features by using deep neural networks and adversarial learning concept. We improve upon GAN such that ROI features can be learned at different levels of complexities (simple and complex), in a controlled manner, via our proposed dual-path adversarial learning (DAL). The outputs from our DAL are then augmented to the learned ROI features into the existing FCN training data, which increases the overall feature diversity. We conducted experiments on three public datasets with a variety of visual characteristics. Our results demonstrate that our DAL can improve FCN-based segmentation methods and outperform or be competitive in performances to the state-of-the-art methods without using medical image-specific optimizations.

Critical Assessment of Transfer Learning for Medical Image Segmentation with Fully Convolutional Neural Networks

MedFCT: A Frequency Domain Joint CNN-Transformer Network for Semi-supervised Medical Image Segmentation

Image Segmentation of Liver CT Based on Fully Convolutional Network.

Transfer learning from a sparsely annotated dataset of 3D medical images

On the Effective Transfer Learning Strategy for Medical Image Analysis in Deep Learning

Cross-dimensional transfer learning in medical image segmentation with deep learning

Self-Adaptive 2D-3D Ensemble of Fully Convolutional Networks for Medical Image Segmentation

From Patch to Image Segmentation using Fully Convolutional Networks -- Application to Retinal Images

Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation

Towards a Better Understanding of Transfer Learning for Medical Imaging: A Case Study

Automatic segmentation method using FCN with multi-scale dilated convolution for medical ultrasound image

Dual-Path Adversarial Learning for Fully Convolutional Network (FCN)-Based Medical Image Segmentation

Pick the Best Pre-trained Model: Towards Transferability Estimation for Medical Image Segmentation

Learning With Context Feedback Loop for Robust Medical Image Segmentation

A Study of CNN and Transfer Learning in Medical Imaging: Advantages, Challenges, Future Scope

TFCNs: A CNN-Transformer Hybrid Network for Medical Image Segmentation

Enhanced Medical Image Segmentation using Transfer Learning with Res101_UNet: Experimental Insights and Comparative Performance Analysis

Stacked fully convolutional networks with multi-channel learning: application to medical image segmentation

Evaluating Knowledge Transfer in Neural Network for Medical Images

Evaluate Fine-tuning Strategies for Fetal Head Ultrasound Image Segmentation with U-Net

Transfer Learning U-Net Deep Learning for Lung Ultrasound Segmentation