Abstract:Background:Early-stage diagnosis and treatment can improve survival rates of liver cancer patients. Dynamic contrast-enhanced MRI provides the most comprehensive information for differential diagnosis of liver tumors. However, MRI diagnosis is affected by subjective experience, so deep learning may supply a new diagnostic strategy. We used convolutional neural networks (CNNs) to develop a deep learning system (DLS) to classify liver tumors based on enhanced MR images, unenhanced MR images, and clinical data including text and laboratory test results. Methods:Using data from 1,210 patients with liver tumors (N= 31,608 images), we trained CNNs to get seven-way classifiers, binary classifiers, and three-way malignancy-classifiers (Model A-Model G). Models were validated in an external independent extended cohort of 201 patients (N= 6,816 images). The area under receiver operating characteristic (ROC) curve (AUC) were compared across different models. We also compared the sensitivity and specificity of models with the performance of three experienced radiologists. Results:Deep learning achieves a performance on par with three experienced radiologists on classifying liver tumors in seven categories. Using only unenhanced images, CNN performs well in distinguishing malignant from benign liver tumors (AUC, 0.946; 95% CI 0.914-0.979 vs. 0.951; 0.919-0.982,P= 0.664). New CNN combining unenhanced images with clinical data greatly improved the performance of classifying malignancies as hepatocellular carcinoma (AUC, 0.985; 95% CI 0.960-1.000), metastatic tumors (0.998; 0.989-1.000), and other primary malignancies (0.963; 0.896-1.000), and the agreement with pathology was 91.9%.These models mined diagnostic information in unenhanced images and clinical data by deep-neural-network, which were different to previous methods that utilized enhanced images. The sensitivity and specificity of almost every category in these models reached the same high level compared to three experienced radiologists. Conclusion:Trained with data in various acquisition conditions, DLS that integrated these models could be used as an accurate and time-saving assisted-diagnostic strategy for liver tumors in clinical settings, even in the absence of contrast agents. DLS therefore has the potential to avoid contrast-related side effects and reduce economic costs associated with current standard MRI inspection practices for liver tumor patients.

Fully-Automated Liver Tumor Localization and Characterization from Multi-Phase MR Volumes Using Key-Slice ROI Parsing: A Physician-Inspired Approach

A deep learning pipeline for localization, differentiation, and uncertainty estimation of liver lesions using multi-phasic and multi-sequence MRI

Automatic Detection of Focal Liver Lesions in Multi-phase CT Images Using A Multi-channel & Multi-scale CNN.

DeepRecS: From RECIST Diameters to Precise Liver Tumor Segmentation

Deep Liver Lesion AI System: A Liver Lesion Diagnostic System Using Deep Learning in Multiphase CT

Content-Based Retrieval of Focal Liver Lesions Using Geometrical and Textural Features of Multi-Phase CT-Scan Images

Fully automatic liver segmentation from Multi-slice spiral computed tomographic images

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Artificial Intelligence for Liver CEUS: the Initial Experience

Harvesting, Detecting, and Characterizing Liver Lesions from Large-scale Multi-phase CT Data via Deep Dynamic Texture Learning

A Cascaded Approach for ultraly High Performance Lesion Detection and False Positive Removal in Liver CT Scans

Beyond radiologist-level liver lesion detection on multi-phase contrast-enhanced CT images by deep learning

Fully automatic liver segmentation combining multi-dimensional graph cut with shape information in 3D CT images

Automatic 3D liver location and segmentation via convolutional neural networks and graph cut

Key Techniques Research in Computer-Aided Hepatic Lesion Diagnosis System Based on Multi-Phase CT Images

Liver Tumor Screening and Diagnosis in CT with Pixel-Lesion-Patient Network

Robust End-to-End Focal Liver Lesion Detection using Unregistered Multiphase Computed Tomography Images

Delving Deep into Liver Focal Lesion Detection: A Preliminary Study

Semi-automatic Liver Tumor Segmentation with Adaptive Region Growing and Graph Cuts

Diagnosis Assistant for Liver Cancer Utilizing a Large Language Model with Three Types of Knowledge

Focal liver lesion diagnosis with deep learning and multistage CT imaging