Abstract:Introduction: Leveraging deep learning in the radiology community has great potential and practical significance. To explore the potential of fitting deep learning methods into the current Liver Imaging Reporting and Data System (LI-RADS) system, this paper provides a complete and fully automatic deep learning solution for the LI-RADS system and investigates its model performance in liver lesion segmentation and classification. Methods: To achieve this, a deep learning study design process is formulated, including clinical problem formulation, corresponding deep learning task identification, data acquisition, data preprocessing, and algorithm validation. On top of segmentation, a UNet++-based segmentation approach with supervised learning was performed by using 33,078 raw images obtained from 111 patients, which are collected from 2010 to 2017. The key innovation is that the proposed framework introduces one more step called feature characterization before LI-RADS score classification in comparison to prior work. In this step, a feature characterization network with multi-task learning and joint training strategy was proposed, followed by an inference module to generate the final LI-RADS score. Results: Both liver segmentation and feature characterization models were evaluated, and comprehensive statistical analysis was conducted with detailed discussions. Median DICE of liver lesion segmentation was able to achieve 0.879. Based on different thresholds, recall changes within a range of 0.7 to 0.9, and precision always stays high greater than 0.9. Segmentation model performance was also evaluated on the patient level and lesion level, and the evaluation results of (precision, recall) on the patient level were much better at approximately (1, 0.9). Lesion classification was evaluated to have an overall accuracy of 76%, and most mis-classification cases happen in the neighboring categories, which is reasonable since it is naturally difficult to distinguish LI-RADS 4 from LI-RADS 5. Discussion: In addition to investigating the performance of the proposed model itself, extensive comparison experiment was also conducted. This study shows that our proposed framework with feature characterization greatly improves the diagnostic performance which also validates the effectiveness of the added feature characterization step. Since this step could output the feature characterization results instead of simply generating a final score, it is able to unbox the black-box for the proposed algorithm thus improves the explainability.

Computerized Features for LI-RADS Based Computer-Aided Diagnosis of Liver Lesions

Deep Learning Radiomics for Focal Liver Lesions Diagnosis on Long-Range Contrast-Enhanced Ultrasound and Clinical Factors

Residual Convolutional Neural Networks With Global And Local Pathways For Classification Of Focal Liver Lesions

Deep Liver Lesion AI System: A Liver Lesion Diagnostic System Using Deep Learning in Multiphase CT

Classification of Focal Liver Lesions Using Deep Learning with Fine-Tuning

Deep Learning Method for Content-Based Retrieval of Focal Liver Lesions Using Multiphase Contrast-Enhanced Computer Tomography Images

Classification and Prognosis Prediction from Histopathological Images of Hepatocellular Carcinoma by a Fully Automated Pipeline Based on Machine Learning

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Artificial Intelligence for Liver CEUS: the Initial Experience

Key Techniques Research in Computer-Aided Hepatic Lesion Diagnosis System Based on Multi-Phase CT Images

Automatic Computer-Aided Diagnosis of Liver Disease Based on Multi-Cascade and Multi-Featured Classifier

Fully automating LI-RADS on MRI with deep learning-guided lesion segmentation, feature characterization, and score inference

Focal Liver Lesion Classification Based on Receiver Operating Characteristic Analysis

Automated machine learning for differentiation of hepatocellular carcinoma from intrahepatic cholangiocarcinoma on multiphasic MRI

A deep learning pipeline for localization, differentiation, and uncertainty estimation of liver lesions using multi-phasic and multi-sequence MRI

Radiomics Study for Differentiating Focal Hepatic Lesions Based on Unenhanced CT Images

LI-RADS for CT diagnosis of hepatocellular carcinoma: performance of major and ancillary features

Machine learning model based on dynamic contrast-enhanced ultrasound assisting LI-RADS diagnosis of HCC: A multicenter diagnostic study

Optimizing LI-RADS: ancillary features screened from LR-3/4 categories can improve the diagnosis of HCC on MRI

A Hybrid Approach to Diagnosis of Hepatic Tumors in Computed Tomography Images

Clinical application of LI-RADS in diagnostic evaluation of hepatocellular carcinoma