Abstract:Introduction: Leveraging deep learning in the radiology community has great potential and practical significance. To explore the potential of fitting deep learning methods into the current Liver Imaging Reporting and Data System (LI-RADS) system, this paper provides a complete and fully automatic deep learning solution for the LI-RADS system and investigates its model performance in liver lesion segmentation and classification. Methods: To achieve this, a deep learning study design process is formulated, including clinical problem formulation, corresponding deep learning task identification, data acquisition, data preprocessing, and algorithm validation. On top of segmentation, a UNet++-based segmentation approach with supervised learning was performed by using 33,078 raw images obtained from 111 patients, which are collected from 2010 to 2017. The key innovation is that the proposed framework introduces one more step called feature characterization before LI-RADS score classification in comparison to prior work. In this step, a feature characterization network with multi-task learning and joint training strategy was proposed, followed by an inference module to generate the final LI-RADS score. Results: Both liver segmentation and feature characterization models were evaluated, and comprehensive statistical analysis was conducted with detailed discussions. Median DICE of liver lesion segmentation was able to achieve 0.879. Based on different thresholds, recall changes within a range of 0.7 to 0.9, and precision always stays high greater than 0.9. Segmentation model performance was also evaluated on the patient level and lesion level, and the evaluation results of (precision, recall) on the patient level were much better at approximately (1, 0.9). Lesion classification was evaluated to have an overall accuracy of 76%, and most mis-classification cases happen in the neighboring categories, which is reasonable since it is naturally difficult to distinguish LI-RADS 4 from LI-RADS 5. Discussion: In addition to investigating the performance of the proposed model itself, extensive comparison experiment was also conducted. This study shows that our proposed framework with feature characterization greatly improves the diagnostic performance which also validates the effectiveness of the added feature characterization step. Since this step could output the feature characterization results instead of simply generating a final score, it is able to unbox the black-box for the proposed algorithm thus improves the explainability.

Medical Image Computing and Computer Assisted Intervention – MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part IV

Size-adaptive Mediastinal Multilesion Detection in Chest CT Images Via Deep Learning and a Benchmark Dataset

Deep Learning Radiomics for Focal Liver Lesions Diagnosis on Long-Range Contrast-Enhanced Ultrasound and Clinical Factors

Deep Lesion Tracker: Monitoring Lesions in 4D Longitudinal Imaging Studies

DeepLesion: Automated Deep Mining, Categorization and Detection of Significant Radiology Image Findings using Large-Scale Clinical Lesion Annotations

Universal Lesion Detection by Learning from Multiple Heterogeneously Labeled Datasets

An Efficient Anchor-free Universal Lesion Detection in CT-scans

Automatic detection of liver lesion from 3D computed tomography images

Learning from Multiple Datasets with Heterogeneous and Partial Labels for Universal Lesion Detection in CT

3D Anchor-Free Lesion Detector on Computed Tomography Scans

Two-stage Lesion Detection Approach Based on Dimension-Decomposition and 3D Context

Delving Deep into Liver Focal Lesion Detection: A Preliminary Study

Medical Image Computing and Computer Assisted Intervention – MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part V

DiffULD: Diffusive Universal Lesion Detection

MVP-Net: Multi-view FPN with Position-Aware Attention for Deep Universal Lesion Detection

Fully automating LI-RADS on MRI with deep learning-guided lesion segmentation, feature characterization, and score inference

Detection-aided liver lesion segmentation using deep learning

ULDor: A Universal Lesion Detector for CT Scans with Pseudo Masks and Hard Negative Example Mining

Robust Multi-scale Anatomical Landmark Detection in Incomplete 3D-CT Data

MSPA-DLA++: A Multi-Scale Phase Attention Deep Layer Aggregation for Lesion Detection in Multi-Phase CT Images

A Progressively-trained Scale-invariant and Boundary-aware Deep Neural Network for the Automatic 3D Segmentation of Lung Lesions