Abstract:Introduction: Liver transplantation (LT) is an effective treatment for hepatocellular carcinoma (HCC), the most common type of primary liver cancer. Patients with small HCC (<5 cm) are given priority over others for transplantation due to clinical allocation policies based on tumor size. Attempting to shift from the prevalent paradigm that successful transplantation and longer disease-free survival can only be achieved in patients with small HCC to expanding the transplantation option to patients with HCC of the highest tumor burden (>5 cm), we developed a convergent artificial intelligence (AI) model that combines transient clinical data with quantitative histologic and radiomic features for more objective risk assessment of liver transplantation for HCC patients. Methods: Patients who received a LT for HCC between 2008-2019 were eligible for inclusion in the analysis. All patients with post-LT recurrence were included, and those without recurrence were randomly selected for inclusion in the deep learning model. Pre- and post-transplant magnetic resonance imaging (MRI) scans and reports were compressed using CapsNet networks and natural language processing, respectively, as input for a multiple feature radial basis function network. We applied a histological image analysis algorithm to detect pathologic areas of interest from explant tissue of patients who recurred. The multilayer perceptron was designed as a feed-forward, supervised neural network topology, with the final assessment of recurrence risk. We used area under the curve (AUC) and F-1 score to assess the predictability of different network combinations. Results: A total of 109 patients were included (87 in the training group, 22 in the testing group), of which 20 were positive for cancer recurrence. Seven models (AUC; F-1 score) were generated, including clinical features only (0.55; 0.52), magnetic resonance imaging (MRI) only (0.64; 0.61), pathological images only (0.64; 0.61), MRI plus pathology (0.68; 0.65), MRI plus clinical (0.78, 0.75), pathology plus clinical (0.77; 0.73), and a combination of clinical, MRI, and pathology features (0.87; 0.84). The final combined model showed 80 % recall and 89 % precision. The total accuracy of the implemented model was 82 %. Conclusion: We validated that the deep learning model combining clinical features and multi-scale histopathologic and radiomic image features can be used to discover risk factors for recurrence beyond tumor size and biomarker analysis. Such a predictive, convergent AI model has the potential to alter the LT allocation system for HCC patients and expand the transplantation treatment option to patients with HCC of the highest tumor burden.

Multimodal NASH prognosis using 3D imaging flow cytometry and artificial intelligence to characterize liver cells

A Multi-Omics Analysis of NASH-Related Prognostic Biomarkers Associated with Drug Sensitivity and Immune Infiltration in Hepatocellular Carcinoma.

Applicability of Multidimensional Convolutional Neural Networks on Automated Detection of Diverse Focal Liver Lesions in Multiphase CT Images.

Reliable Liver Fibrosis Assessment from Ultrasound using Global Hetero-Image Fusion and View-Specific Parameterization

Intelligent Diagnosis of Non-alcoholic Fatty Liver Disease Based on Multi-modal Ultrasound Features

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Three-Dimensional Organoids as a Model to Study Nonalcoholic Fatty Liver Disease

3D Imaging of the Liver Extracellular Matrix in a Mouse Model of Non-Alcoholic Steatohepatitis

Intelligent Grading of Liver Fibrosis, Inflammation and Steatosis Using Handcrafted and Deep Features From Multimodal Ultrasound Data

Ultrasonic Assessment of Liver Fibrosis Using One-Dimensional Convolutional Neural Networks Based on Frequency Spectra of Radiofrequency Signals with Deep Learning Segmentation of Liver Regions in B-Mode Images: A Feasibility Study

AI-Driven Non-Invasive Detection and Staging of Steatosis in Fatty Liver Disease Using a Novel Cascade Model and Information Fusion Techniques

Simultaneous grading diagnosis of liver fibrosis, inflammation, and steatosis using multimodal quantitative ultrasound and artificial intelligence framework

Liver Fibrosis Assessment Using Radiomics of Ultrasound Homodyned-K imaging Based on the Artificial Neural Network Estimator

An imageomics and multi-network based deep learning model for risk assessment of liver transplantation for hepatocellular cancer

Artificial Intelligence in NAFLD: Will Liver Biopsy Still Be Necessary in the Future?

Fully connected neural network-based serum surface-enhanced Raman spectroscopy accurately identifies non-alcoholic steatohepatitis

Spatial proteomics of immune microenvironment in nonalcoholic steatohepatitis-associated hepatocellular carcinoma

Machine learning approaches for early detection of non-alcoholic steatohepatitis based on clinical and blood parameters

Assessment and integration of multiparametric MRI for liver fibrosis staging in rat non-alcoholic steatohepatitis: Evaluation of diagnostic efficiency and model interpretation

3D side-scattering imaging flow cytometer and convolutional neural network for label-free cell analysis

Noninvasive Assessment of Liver Fibrosis and Inflammation in Chronic Hepatitis B: A Dual-task Convolutional Neural Network (dtcnn) Model Based on Ultrasound Shear Wave Elastography.