Abstract:Objectives: To develop a deep learning model combining CT scans and clinical information to predict overall survival in advanced hepatocellular carcinoma (HCC). Methods: This retrospective study included immunotherapy-treated advanced HCC patients from 52 multi-national in-house centers between 2018 and 2022. A multi-modal prognostic model using baseline and the first follow-up CT images and 7 clinical variables was proposed. A convolutional-recurrent neural network (CRNN) was developed to extract spatial-temporal information from automatically selected representative 2D CT slices to provide a radiological score, then fused with a Cox-based clinical score to provide the survival risk. The model's effectiveness was assessed using a time-dependent area under the receiver operating curve (AUC), and risk group stratification using the log-rank test. Prognostic performances of multi-modal inputs were compared to models of missing modality, and the size-based RECIST criteria. Results: Two-hundred seven patients (mean age, 61 years ± 12 [SD], 180 men) were included. The multi-modal CRNN model reached the AUC of 0.777 and 0.704 of 1-year overall survival predictions in the validation and test sets. The model achieved significant risk stratification in validation (hazard ratio [HR] = 3.330, p = 0.008), and test sets (HR = 2.024, p = 0.047) based on the median risk score of the training set. Models with missing modalities (the single-modal imaging-based model and the model incorporating only baseline scans) can still achieve favorable risk stratification performance (all p < 0.05, except for one, p = 0.053). Moreover, results proved the superiority of the deep learning-based model to the RECIST criteria. Conclusion: Deep learning analysis of CT scans and clinical data can offer significant prognostic insights for patients with advanced HCC. Critical relevance statement: The established model can help monitor patients' disease statuses and identify those with poor prognosis at the time of first follow-up, helping clinicians make informed treatment decisions, as well as early and timely interventions. Key points: An AI-based prognostic model was developed for advanced HCC using multi-national patients. The model extracts spatial-temporal information from CT scans and integrates it with clinical variables to prognosticate. The model demonstrated superior prognostic ability compared to the conventional size-based RECIST method.

NecroGlobalGCN: Integrating Micronecrosis Information in HCC Prognosis Prediction via Graph Convolutional Neural Networks

GCN-Based Risk Prediction for Necrosis Slide of Hepatocellular Carcinoma.

MMGCN: Multi-modal multi-view graph convolutional networks for cancer prognosis prediction

Global contextual representation via graph-transformer fusion for hepatocellular carcinoma prognosis in whole-slide images

Prognostic analysis of histopathological images using pre-trained convolutional neural networks: application to hepatocellular carcinoma

Method of Tumor Pathological Micronecrosis Quantification Via Deep Learning from Label Fuzzy Proportions

Two-stage Cox-nnet: Biologically Interpretable Neural-Network Model for Prognosis Prediction and Its Application in Liver Cancer Survival Using Histopathology and Transcriptomic Data

A necroptosis-related prognostic model for predicting prognosis, immune landscape, and drug sensitivity in hepatocellular carcinoma based on single-cell sequencing analysis and weighted co-expression network

CT-based multimodal deep learning for non-invasive overall survival prediction in advanced hepatocellular carcinoma patients treated with immunotherapy

Optimizing hepatocellular carcinoma disease staging systems by incorporating tumor micronecrosis: A multi-institutional retrospective study

A Deep Neural Network for Gastric Cancer Prognosis Prediction Based on Biological Information Pathways

Developing and Verifying A Necroptic Gene-Based Prognostic Index in Patients with Hepatocellular Carcinoma

Clinical prediction of microvascular invasion in hepatocellular carcinoma using an MRI-Based graph convolutional network model integrated with nomogram

Integrating Bulk and Single-Cell RNA Sequencing Data to Establish Necroptosis-Related Lncrna Risk Model and Analyze the Immune Microenvironment in Hepatocellular Carcinoma

A comprehensive analysis of the potential role of necroptosis in hepatocellular carcinoma using single-cell RNA Seq and bulk RNA Seq

Hybrid Graph Convolutional Network With Online Masked Autoencoder for Robust Multimodal Cancer Survival Prediction

PathoGraph: An Attention-Based Graph Neural Network Capable of Prognostication Based on CD276 Labelling of Malignant Glioma Cells

Development of prognostic models for advanced multiple hepatocellular carcinoma based on Cox regression, deep learning and machine learning algorithms

Survival Prediction Across Diverse Cancer Types Using Neural Networks

Deep Learning-Based Prediction of Post-treatment Survival in Hepatocellular Carcinoma Patients Using Pre-treatment CT Images and Clinical Data

Multilayered insights: a machine learning approach for personalized prognostic assessment in hepatocellular carcinoma