Abstract:Background:Early-stage diagnosis and treatment can improve survival rates of liver cancer patients. Dynamic contrast-enhanced MRI provides the most comprehensive information for differential diagnosis of liver tumors. However, MRI diagnosis is affected by subjective experience, so deep learning may supply a new diagnostic strategy. We used convolutional neural networks (CNNs) to develop a deep learning system (DLS) to classify liver tumors based on enhanced MR images, unenhanced MR images, and clinical data including text and laboratory test results. Methods:Using data from 1,210 patients with liver tumors (N= 31,608 images), we trained CNNs to get seven-way classifiers, binary classifiers, and three-way malignancy-classifiers (Model A-Model G). Models were validated in an external independent extended cohort of 201 patients (N= 6,816 images). The area under receiver operating characteristic (ROC) curve (AUC) were compared across different models. We also compared the sensitivity and specificity of models with the performance of three experienced radiologists. Results:Deep learning achieves a performance on par with three experienced radiologists on classifying liver tumors in seven categories. Using only unenhanced images, CNN performs well in distinguishing malignant from benign liver tumors (AUC, 0.946; 95% CI 0.914-0.979 vs. 0.951; 0.919-0.982,P= 0.664). New CNN combining unenhanced images with clinical data greatly improved the performance of classifying malignancies as hepatocellular carcinoma (AUC, 0.985; 95% CI 0.960-1.000), metastatic tumors (0.998; 0.989-1.000), and other primary malignancies (0.963; 0.896-1.000), and the agreement with pathology was 91.9%.These models mined diagnostic information in unenhanced images and clinical data by deep-neural-network, which were different to previous methods that utilized enhanced images. The sensitivity and specificity of almost every category in these models reached the same high level compared to three experienced radiologists. Conclusion:Trained with data in various acquisition conditions, DLS that integrated these models could be used as an accurate and time-saving assisted-diagnostic strategy for liver tumors in clinical settings, even in the absence of contrast agents. DLS therefore has the potential to avoid contrast-related side effects and reduce economic costs associated with current standard MRI inspection practices for liver tumor patients.

Liver Tumor Detection Via A Multi-Scale Intermediate Multi-Modal Fusion Network on MRI Images.

Automatic Detection of Focal Liver Lesions in Multi-phase CT Images Using A Multi-channel & Multi-scale CNN.

Multimodal Priors Guided Segmentation of Liver Lesions in MRI Using Mutual Information Based Graph Co-Attention Networks.

Segmentation and Detection of Liver Tumor in Non-contrast MRI Image Combined with Multi-modality Features

Multi-Stream Scale-Insensitive Convolutional And Recurrent Neural Networks For Liver Tumor Detection In Dynamic Ct Images

Accurate Segmentation of Liver Tumor from Multi-Modality Non-Contrast Images Using a Dual-Stream Multi-Level Fusion Framework

A Coarse-to-Fine Fusion Network for Small Liver Tumor Detection and Segmentation: A Real-World Study.

A three-path network with multi-scale selective feature fusion, edge-inspiring and edge-guiding for liver tumor segmentation

MFA-Net: Multi-Scale feature fusion attention network for liver tumor segmentation

A Multi-Scale and Multi-Level Fusion Approach for Deep Learning-Based Liver Lesion Diagnosis in Magnetic Resonance Images with Visual Explanation

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Liver Fibrosis Classification Based on Multimodal Imaging Feature Fusion

Context Fusion Network with Multi-Scale-aware Skip Connection and Twin-Split Attention for Liver Tumor Segmentation

Multiscale Feature Fusion Method for Liver Cirrhosis Classification

Systematic Comparison of Deep-Learning Based Fusion Strategies for Multi-Modal Ultrasound in Diagnosis of Liver Cancer

Cross-attention Guided Loss-Based Deep Dual-Branch Fusion Network for Liver Tumor Classification

Self-Supervised Multi-Modal Hybrid Fusion Network for Brain Tumor Segmentation.

Adaptive Multi-Phase Liver Tumor Segmentation with Multi-Scale Supervision

Adaptive Multiphase Liver Tumor Segmentation With Multiscale Supervision

United adversarial learning for liver tumor segmentation and detection of multi-modality non-contrast MRI

A Dynamic Multi-Modal Fusion Network for Ovarian Tumor Differentiation.