Abstract:Background:Early-stage diagnosis and treatment can improve survival rates of liver cancer patients. Dynamic contrast-enhanced MRI provides the most comprehensive information for differential diagnosis of liver tumors. However, MRI diagnosis is affected by subjective experience, so deep learning may supply a new diagnostic strategy. We used convolutional neural networks (CNNs) to develop a deep learning system (DLS) to classify liver tumors based on enhanced MR images, unenhanced MR images, and clinical data including text and laboratory test results. Methods:Using data from 1,210 patients with liver tumors (N= 31,608 images), we trained CNNs to get seven-way classifiers, binary classifiers, and three-way malignancy-classifiers (Model A-Model G). Models were validated in an external independent extended cohort of 201 patients (N= 6,816 images). The area under receiver operating characteristic (ROC) curve (AUC) were compared across different models. We also compared the sensitivity and specificity of models with the performance of three experienced radiologists. Results:Deep learning achieves a performance on par with three experienced radiologists on classifying liver tumors in seven categories. Using only unenhanced images, CNN performs well in distinguishing malignant from benign liver tumors (AUC, 0.946; 95% CI 0.914-0.979 vs. 0.951; 0.919-0.982,P= 0.664). New CNN combining unenhanced images with clinical data greatly improved the performance of classifying malignancies as hepatocellular carcinoma (AUC, 0.985; 95% CI 0.960-1.000), metastatic tumors (0.998; 0.989-1.000), and other primary malignancies (0.963; 0.896-1.000), and the agreement with pathology was 91.9%.These models mined diagnostic information in unenhanced images and clinical data by deep-neural-network, which were different to previous methods that utilized enhanced images. The sensitivity and specificity of almost every category in these models reached the same high level compared to three experienced radiologists. Conclusion:Trained with data in various acquisition conditions, DLS that integrated these models could be used as an accurate and time-saving assisted-diagnostic strategy for liver tumors in clinical settings, even in the absence of contrast agents. DLS therefore has the potential to avoid contrast-related side effects and reduce economic costs associated with current standard MRI inspection practices for liver tumor patients.

Small Lesion Classification in Dynamic Contrast Enhancement MRI for Breast Cancer Early Detection.

Deep Learning-Based Automatic Segmentation for Size and Volumetric Measurement of Breast Cancer on Magnetic Resonance Imaging.

Size-adaptive Mediastinal Multilesion Detection in Chest CT Images Via Deep Learning and a Benchmark Dataset

Optimizing and Visualizing Deep Learning for Benign/Malignant Classification in Breast Tumors

Weakly Supervised Breast Lesion Detection in Dynamic Contrast-Enhanced MRI

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Assessing Breast Cancer Volume Alterations Post-Neoadjuvant Chemotherapy Through DenseNet-201 Deep Learning Analysis on DCE-MRI

A deep learning model based on dynamic contrast-enhanced magnetic resonance imaging enables accurate prediction of benign and malignant breast lessons

Spatiotemporal Breast Mass Detection Network (MD-Net) in 4D DCE-MRI Images

MRI‐Based Breast Cancer Classification and Localization by Multiparametric Feature Extraction and Combination Using Deep Learning

Lesion Segmentation and Identification of Breast Tumor on Dynamic Contrast-Enhanced Magnetic Resonance Imaging

A Hybrid Deep Learning Approach to Predict Malignancy of Breast Lesions Using Mammograms

A Spatio-Temporal Fully Convolutional Network For Breast Lesion Segmentation In Dce-Mri

Breast Tumor Identification in Ultrafast MRI Using Temporal and Spatial Information

Accurate Breast Lesion Segmentation by Exploiting Spatio-Temporal Information with Deep Recurrent and Convolutional Network

An experimental study on breast lesion detection and classification from ultrasound images using deep learning architectures

Lesion detection in contrast enhanced spectral mammography

Ultrasonic Diagnosis of Breast Nodules Using Modified Faster R-CNN

Diagnosis of breast masses from dynamic contrast-enhanced and diffusion-weighted MR: a machine learning approach.

Improving Effectiveness of Different Deep Transfer Learning-Based Models for Detecting Brain Tumors From MR Images

Joint Dense Residual and Recurrent Attention Network for DCE-MRI Breast Tumor Segmentation