Abstract:Background:Early-stage diagnosis and treatment can improve survival rates of liver cancer patients. Dynamic contrast-enhanced MRI provides the most comprehensive information for differential diagnosis of liver tumors. However, MRI diagnosis is affected by subjective experience, so deep learning may supply a new diagnostic strategy. We used convolutional neural networks (CNNs) to develop a deep learning system (DLS) to classify liver tumors based on enhanced MR images, unenhanced MR images, and clinical data including text and laboratory test results. Methods:Using data from 1,210 patients with liver tumors (N= 31,608 images), we trained CNNs to get seven-way classifiers, binary classifiers, and three-way malignancy-classifiers (Model A-Model G). Models were validated in an external independent extended cohort of 201 patients (N= 6,816 images). The area under receiver operating characteristic (ROC) curve (AUC) were compared across different models. We also compared the sensitivity and specificity of models with the performance of three experienced radiologists. Results:Deep learning achieves a performance on par with three experienced radiologists on classifying liver tumors in seven categories. Using only unenhanced images, CNN performs well in distinguishing malignant from benign liver tumors (AUC, 0.946; 95% CI 0.914-0.979 vs. 0.951; 0.919-0.982,P= 0.664). New CNN combining unenhanced images with clinical data greatly improved the performance of classifying malignancies as hepatocellular carcinoma (AUC, 0.985; 95% CI 0.960-1.000), metastatic tumors (0.998; 0.989-1.000), and other primary malignancies (0.963; 0.896-1.000), and the agreement with pathology was 91.9%.These models mined diagnostic information in unenhanced images and clinical data by deep-neural-network, which were different to previous methods that utilized enhanced images. The sensitivity and specificity of almost every category in these models reached the same high level compared to three experienced radiologists. Conclusion:Trained with data in various acquisition conditions, DLS that integrated these models could be used as an accurate and time-saving assisted-diagnostic strategy for liver tumors in clinical settings, even in the absence of contrast agents. DLS therefore has the potential to avoid contrast-related side effects and reduce economic costs associated with current standard MRI inspection practices for liver tumor patients.

Multi-View Disentanglement-Based Bidirectional Generalized Distillation for Diagnosis of Liver Cancers with Ultrasound Images

B-mode ultrasound based CAD for liver cancers via multi-view privileged information learning

Multi-Source Transfer Learning Via Multi-Kernel Support Vector Machine Plus for B-Mode Ultrasound-Based Computer-Aided Diagnosis of Liver Cancers

Artificial Intelligence for Liver CEUS: the Initial Experience

Multi-View Feature Transformation Based SVM+ for Computer-Aided Diagnosis of Liver Cancers With Ultrasound Images

Multimodal Ultrasound Imaging Based Diagnosis of Liver Cancers with a Two-Stage Multi-View Learning Framework.

B-Mode Ultrasound Based Diagnosis of Liver Cancer With CEUS Images as Privileged Information.

Combining Convolutional and Recurrent Neural Networks for Classification of Focal Liver Lesions in Multi-phase CT Images.

Deep Learning Radiomics for Focal Liver Lesions Diagnosis on Long-Range Contrast-Enhanced Ultrasound and Clinical Factors

A Two-Stage Multi-View Learning Framework Based Computer-Aided Diagnosis of Liver Tumors with Contrast Enhanced Ultrasound Images.

Ceus-Based Classification Of Liver Tumors With Deep Canonical Correlation Analysis And Multi-Kernel Learning

Doubly supervised parameter transfer classifier for diagnosis of breast cancer with imbalanced ultrasound imaging modalities

Deep Doubly Supervised Transfer Network for Diagnosis of Breast Cancer with Imbalanced Ultrasound Imaging Modalities

B-mode ultrasound-based CAD by learning using privileged information with dual-level missing modality completion

Parameter Transfer Deep Neural Network for Single-Modal B-Mode Ultrasound-Based Computer-Aided Diagnosis

Systematic Comparison of Deep-Learning Based Fusion Strategies for Multi-Modal Ultrasound in Diagnosis of Liver Cancer

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Transport-Based Anatomical-Functional Metric Learning for Liver Tumor Recognition Using Dual-View Dynamic CEUS Imaging.

Ultrasound-Based Diagnosis Of Breast Tumor With Parameter Transfer Multilayer Kernel Extreme Learning Machine

Self Supervised Lesion Recognition For Breast Ultrasound Diagnosis

Hepatocellular Carcinoma Automatic Diagnosis within CEUS and B-Mode Ultrasound Images Using Advanced Machine Learning Methods