Abstract:Background:Early-stage diagnosis and treatment can improve survival rates of liver cancer patients. Dynamic contrast-enhanced MRI provides the most comprehensive information for differential diagnosis of liver tumors. However, MRI diagnosis is affected by subjective experience, so deep learning may supply a new diagnostic strategy. We used convolutional neural networks (CNNs) to develop a deep learning system (DLS) to classify liver tumors based on enhanced MR images, unenhanced MR images, and clinical data including text and laboratory test results. Methods:Using data from 1,210 patients with liver tumors (N= 31,608 images), we trained CNNs to get seven-way classifiers, binary classifiers, and three-way malignancy-classifiers (Model A-Model G). Models were validated in an external independent extended cohort of 201 patients (N= 6,816 images). The area under receiver operating characteristic (ROC) curve (AUC) were compared across different models. We also compared the sensitivity and specificity of models with the performance of three experienced radiologists. Results:Deep learning achieves a performance on par with three experienced radiologists on classifying liver tumors in seven categories. Using only unenhanced images, CNN performs well in distinguishing malignant from benign liver tumors (AUC, 0.946; 95% CI 0.914-0.979 vs. 0.951; 0.919-0.982,P= 0.664). New CNN combining unenhanced images with clinical data greatly improved the performance of classifying malignancies as hepatocellular carcinoma (AUC, 0.985; 95% CI 0.960-1.000), metastatic tumors (0.998; 0.989-1.000), and other primary malignancies (0.963; 0.896-1.000), and the agreement with pathology was 91.9%.These models mined diagnostic information in unenhanced images and clinical data by deep-neural-network, which were different to previous methods that utilized enhanced images. The sensitivity and specificity of almost every category in these models reached the same high level compared to three experienced radiologists. Conclusion:Trained with data in various acquisition conditions, DLS that integrated these models could be used as an accurate and time-saving assisted-diagnostic strategy for liver tumors in clinical settings, even in the absence of contrast agents. DLS therefore has the potential to avoid contrast-related side effects and reduce economic costs associated with current standard MRI inspection practices for liver tumor patients.

Radiomics and Deep Learning: Hepatic Applications

Deep Learning Radiomics for Focal Liver Lesions Diagnosis on Long-Range Contrast-Enhanced Ultrasound and Clinical Factors

Advances in Radiomics Applications for Intrahepatic Cholangiocarcinoma: a Comprehensive Review and Future Directions

Radiomics in the Diagnosis and Treatment of Hepatocellular Carcinoma

Radiomics Applications in Primary Liver Cancer

Deep learning based radiomics for gastrointestinal cancer diagnosis and treatment: A minireview

Deep Learning With Radiomics for Disease Diagnosis and Treatment: Challenges and Potential

Radiological Diagnosis of Chronic Liver Disease and Hepatocellular Carcinoma: A Review

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Personalized intrahepatic cholangiocarcinoma prognosis prediction using radiomics: Application and development trend

Radiomics and Radiogenomics in Evaluation of Colorectal Cancer Liver Metastasis

Radiobioinformatics: A Novel Bridge Between Basic Research and Clinical Practice for Clinical Decision Support in Diffuse Liver Diseases

Radiomics and liver: Where we are and where we are headed?

Deep learning for image-based liver analysis - A comprehensive review focusing on malignant lesions

Deep learning techniques in liver tumour diagnosis using CT and MR imaging - A systematic review

Radiomics in CT and MR imaging of the liver and pancreas: tools with potential for clinical application

State-of-the-art in radiomics of hepatocellular carcinoma: a review of basic principles, applications, and limitations

The Applications of Radiomics in Precision Diagnosis and Treatment of Oncology: Opportunities and Challenges

Radiomics and deep learning in lung cancer

Deep Learning Radiomics to Predict Regional Lymph Node Staging for Hilar Cholangiocarcinoma

Application of radiomics in diagnosis and treatment of lung cancer