Abstract:Introduction: Liver transplantation (LT) is an effective treatment for hepatocellular carcinoma (HCC), the most common type of primary liver cancer. Patients with small HCC (<5 cm) are given priority over others for transplantation due to clinical allocation policies based on tumor size. Attempting to shift from the prevalent paradigm that successful transplantation and longer disease-free survival can only be achieved in patients with small HCC to expanding the transplantation option to patients with HCC of the highest tumor burden (>5 cm), we developed a convergent artificial intelligence (AI) model that combines transient clinical data with quantitative histologic and radiomic features for more objective risk assessment of liver transplantation for HCC patients. Methods: Patients who received a LT for HCC between 2008-2019 were eligible for inclusion in the analysis. All patients with post-LT recurrence were included, and those without recurrence were randomly selected for inclusion in the deep learning model. Pre- and post-transplant magnetic resonance imaging (MRI) scans and reports were compressed using CapsNet networks and natural language processing, respectively, as input for a multiple feature radial basis function network. We applied a histological image analysis algorithm to detect pathologic areas of interest from explant tissue of patients who recurred. The multilayer perceptron was designed as a feed-forward, supervised neural network topology, with the final assessment of recurrence risk. We used area under the curve (AUC) and F-1 score to assess the predictability of different network combinations. Results: A total of 109 patients were included (87 in the training group, 22 in the testing group), of which 20 were positive for cancer recurrence. Seven models (AUC; F-1 score) were generated, including clinical features only (0.55; 0.52), magnetic resonance imaging (MRI) only (0.64; 0.61), pathological images only (0.64; 0.61), MRI plus pathology (0.68; 0.65), MRI plus clinical (0.78, 0.75), pathology plus clinical (0.77; 0.73), and a combination of clinical, MRI, and pathology features (0.87; 0.84). The final combined model showed 80 % recall and 89 % precision. The total accuracy of the implemented model was 82 %. Conclusion: We validated that the deep learning model combining clinical features and multi-scale histopathologic and radiomic image features can be used to discover risk factors for recurrence beyond tumor size and biomarker analysis. Such a predictive, convergent AI model has the potential to alter the LT allocation system for HCC patients and expand the transplantation treatment option to patients with HCC of the highest tumor burden.

Non-invasive assessment of liver quality in transplantation based on thermal imaging analysis

Application of Infrared Thermography Combined with High Frequency Color Doppler Ultrasound in Locating Perforator Before Anterolateral Thigh Perforator Flap Transplantation

Online Domain Adaptation for Continuous Cross-Subject Liver Viability Evaluation Based on Irregular Thermal Data

Noninvasive in-vivo tracing and imaging of transplanted stem cells for liver regeneration.

Clinical Application of Infrared Spectroscopy in Liver Transplantation for Rapid Assessment of Lipid Content in Liver Graft

Liver Fibrosis Assessment Using Radiomics of Ultrasound Homodyned-K imaging Based on the Artificial Neural Network Estimator

Diffusion-weighted Imaging and Variable Flip Angle T1 Mapping: a Supplement for Image-Guided Biopsy in Follow-Up Analysis of Liver Fibrosis

Point‐of‐care detection of fibrosis in liver transplant surgery using near‐infrared spectroscopy and machine learning

The Application of Liver Imaging Analysis System on Preoperative Evaluation of Liver Transplantation

An imageomics and multi-network based deep learning model for risk assessment of liver transplantation for hepatocellular cancer

LiverColor: An Artificial Intelligence Platform for Liver Graft Assessment

Intelligent Grading of Liver Fibrosis, Inflammation and Steatosis Using Handcrafted and Deep Features From Multimodal Ultrasound Data

Thermoacoustic Imaging of Liver Based on Eddy Current Loss

Intelligent Diagnosis of Non-alcoholic Fatty Liver Disease Based on Multi-modal Ultrasound Features

Liver Fibrosis Identification Based on Ultrasound Images Captured under Varied Imaging Protocols

Application of color doppler ultrasound in monitoring liver graft dynamically and diagnosis and treatment of complications following liver transplantation

Noninvasive diagnosis of liver cirrhosis: qualitative and quantitative imaging biomarkers

An Evaluation Analysis for Computed Tomography Image Quality of Primary Liver Cancer Lesions Based on Deep Learning Image Reconstruction

Prediction of Biliary Complications After Human Liver Transplantation Using Hyperspectral Imaging and Convolutional Neural Networks: A Proof-of-concept Study

Non-invasive evaluation of liver steatosis with imaging modalities: New techniques and applications

Quantitative assessment of hepatic steatosis using label-free multiphoton imaging and customized image processing program