Abstract:PURPOSE: Recent studies have illustrated that the peritumoral regions of medical images have value for clinical diagnosis. However, the existing approaches using peritumoral regions mainly focus on the diagnostic capability of the single region and ignore the advantages of effectively fusing the intratumoral and peritumoral regions. In addition, these methods need accurate segmentation masks in the testing stage, which are tedious and inconvenient in clinical applications. To address these issues, we construct a deep convolutional neural network that can adaptively fuse the information of multiple tumoral-regions (FMRNet) for breast tumor classification using ultrasound (US) images without segmentation masks in the testing stage.METHODS: To sufficiently excavate the potential relationship, we design a fused network and two independent modules to extract and fuse features of multiple regions simultaneously. First, we introduce two enhanced combined-tumoral (EC) region modules, aiming to enhance the combined-tumoral features gradually. Then, we further design a three-branch module for extracting and fusing the features of intratumoral, peritumoral, and combined-tumoral regions, denoted as the intratumoral, peritumoral, and combined-tumoral module. Especially, we design a novel fusion module by introducing a channel attention module to adaptively fuse the features of three regions. The model is evaluated on two public datasets including UDIAT and BUSI with breast tumor ultrasound images. Two independent groups of experiments are performed on two respective datasets using the fivefold stratified cross-validation strategy. Finally, we conduct ablation experiments on two datasets, in which BUSI is used as the training set and UDIAT is used as the testing set.RESULTS: We conduct detailed ablation experiments about the proposed two modules and comparative experiments with other existing representative methods. The experimental results show that the proposed method yields state-of-the-art performance on both two datasets. Especially, in the UDIAT dataset, the proposed FMRNet achieves a high accuracy of 0.945 and a specificity of 0.945, respectively. Moreover, the precision (PRE = 0.909) even dramatically improves by 21.6% on the BUSI dataset compared with the existing method of the best result.CONCLUSION: The proposed FMRNet shows good performance in breast tumor classification with US images, and proves its capability of exploiting and fusing the information of multiple tumoral-regions. Furthermore, the FMRNet has potential value in classifying other types of cancers using multiple tumoral-regions of other kinds of medical images.

Fuzzy-Inspired Nanobiosensing for Multi-Feature Soft Classification of Tumor

Fuzzy-Inspired Biosensing Strategy for Double-Feature Tumor Classification

A novel breast tumor classification algorithm using neutrosophic score features

Fuzzy-Receiver Operating Characteristics (F-ROC) for Fuzzy-Inspired Biosensing Performance Evaluation.

Classification of multi‐feature fusion ultrasound images of breast tumor within category 4 using convolutional neural networks

Multi-scale supervised clustering-based feature selection for tumor classification and identification of biomarkers and targets on genomic data

Breast Tumor Classification in Ultrasound Images by Fusion of Deep Convolutional Neural Network and Shallow LBP Feature

Breast Cancer Diagnosis Using Digitized Images of FNA Breast Biopsy and Optimized Neurofuzzy System

A Framework of Fuzzy Information Fusion for the Segmentation of Brain Tumor Tissues on MR Images

Multi-scale cross spectral coherence and phase spectral distribution based measurement in non-subsampled shearlet domain for classification of brain tumors

Fuzzy-logic-inspired Multi-contrast-agent Strategy for Optimal Tumor Classification

Deep Fuzzy Neural Networks for Biomarker Selection for Accurate Cancer Detection

Hybrid Neurocomputing for Breast Cancer Detection

Nanorobots-assisted Detection of Multifocal Cancer: A Multimodal Optimization Perspective

NGA-Inspired Nanorobots-Assisted Detection of Multifocal Cancer.

Ultrasonic classification of breast tumors based on multi-instance learning

Multiscale Detection of Cancerous Tissue in High Resolution Slide Scans

FMRNet: A fused network of multiple tumoral regions for breast tumor classification with ultrasound images

AI-driven Classification of Cancer-Associated Fibroblasts Using Morphodynamic and Motile Features

Fuzzy information fusion scheme used to segment brain tumor from MR images

A robust approach for multi-type classification of brain tumor using deep feature fusion