Abstract:Background and objective: [18f]-fluorodeoxyglucose (fdg) positron emission tomography – computed tomography (pet-ct) is now the preferred imaging modality for staging many cancers. Pet images characterize tumoral glucose metabolism while ct depicts the complementary anatomical localization of the tumor. Automatic tumor segmentation is an important step in image analysis in computer aided diagnosis systems. Recently, fully convolutional networks (fcns), with their ability to leverage annotated datasets and extract image feature representations, have become the state-of-the-art in tumor segmentation. There are limited fcn based methods that support multi-modality images and current methods have primarily focused on the fusion of multi-modality image features at various stages, i.e., early-fusion where the multi-modality image features are fused prior to fcn, late-fusion with the resultant features fused and hyper-fusion where multi-modality image features are fused across multiple image feature scales. Early- and late-fusion methods, however, have inherent, limited freedom to fuse complementary multi-modality image features. The hyper-fusion methods learn different image features across different image feature scales that can result in inaccurate segmentations, in particular, in situations where the tumors have heterogeneous textures. Methods: we propose a recurrent fusion network (rfn), which consists of multiple recurrent fusion phases to progressively fuse the complementary multi-modality image features with intermediary segmentation results derived at individual recurrent fusion phases: (1) the recurrent fusion phases iteratively learn the image features and then refine the subsequent segmentation results; and, (2) the intermediary segmentation results allows our method to focus on learning the multi-modality image features around these intermediary segmentation results, which minimize the risk of inconsistent feature learning. Results: we evaluated our method on two pathologically proven non-small cell lung cancer pet-ct datasets. We compared our method to the commonly used fusion methods (early-fusion, late-fusion and hyper-fusion) and the state-of-the-art pet-ct tumor segmentation methods on various network backbones (resnet, densenet and 3d-unet). Our results show that the rfn provides more accurate segmentation compared to the existing methods and is generalizable to different datasets. Conclusions: we show that learning through multiple recurrent fusion phases allows the iterative re-use of multi-modality image features that refines tumor segmentation results. We also identify that our rfn produces consistent segmentation results across different network architectures.

Hyper-fusion network for semi-automatic segmentation of skin lesions

Attention-Guided Network with Densely Connected Convolution for Skin Lesion Segmentation

ACFNet: an Adaptive Context Fusion Network for Skin Lesion Segmentation

Correlates and predictors of serum total cholesterol in adolescents aged 12-17 years: the National Health Examination Survey.

GA-Net: Ghost convolution adaptive fusion skin lesion segmentation network

GFANet: Gated Fusion Attention Network for skin lesion segmentation

Skin necrosis following subcutaneous heparin injection

Salient Skin Lesion Segmentation via Dilated Scale-Wise Feature Fusion Network

Recurrent Feature Fusion Learning for Multi-Modality Pet-Ct Tumor Segmentation

Fusion of U-Net and CNN model for segmentation and classification of skin lesion from dermoscopy images

A Multi-task Framework for Skin Lesion Detection and Segmentation

Multi-feature Fusion Deep Network for Skin Disease Diagnosis

FAT-Net: Feature adaptive transformers for automated skin lesion segmentation

A Cross-attention and Multi-level Feature Fusion Network for Breast Lesion Segmentation in Ultrasound Images

ADF-Net: A novel adaptive dual-stream encoding and focal attention decoding network for skin lesion segmentation

LCAUnet: A skin lesion segmentation network with enhanced edge and body fusion

Efficient and real-time skin lesion image segmentation using spatial-frequency information and channel convolutional networks

FAC-Net: Feedback Attention Network Based on Context Encoder Network for Skin Lesion Segmentation

Bi-directional Dermoscopic Feature Learning and Multi-scale Consistent Decision Fusion for Skin Lesion Segmentation

MSF-Net: A Lightweight Multi-Scale Feature Fusion Network for Skin Lesion Segmentation

Dynamically Aggregating MLPs and CNNs for Skin Lesion Segmentation with Geometry Regularization