Abstract:Objective:To evaluate the predictive value of digital pathological model based on convolutional neural network (CNN) in the early warning of recurrence of hepatocellular carcinoma (HCC).Methods:This study consisted of 4 HCC cohorts. Cohort 1 and 3 were taken as the training sets, and cohort 2 and 4 as the validation sets. 1 119 HCC patients admitted to the First Affiliated Hospital of Zhejiang University from January 2012 to January 2017 were enrolled and assigned into cohort 1 (n=202), 2 (n=179) and 3 (n=738), respectively. 361 patients from The Cancer Genome Atlas (TCGA) were allocated incohort 4. First, 7 CNNs (AlexNet, Squeezenet, InceptionV3, GoogleNet, DenseNet201, VGG19 and ResNet18) were used to train the automatic recognition model of pathological sections of HCC to distinguish tumor region from normal tissues. The optimal neural network model was chosen. The component extraction model for tumor region was constructed through transfer learning, and 5 different components (tumor cells, lymphocytes, stroma, necrosis and background) in the tumor region were analyzed and were validated by cohort 2. The correlation between these 5 components and postoperative recurrence of HCC was analyzed in cohort 3. A warning model of postoperative recurrence of HCC was constructed based on clinical features, which was subjected to independent external validation in cohort 4. Survival analysis was conducted by Kaplan-Meier method and Log-rank test. Prognostic factors were analyzed by Cox proportional hazards regression model with LASSO method.Results:In cohort 1, the accuracy rates of AlexNet, DenseNet201, VGG19 and ResNet18 in distinguishing HCC lesions were all above 95.0%. In cohort 2, the accuracy rate of neural network VGG19 was the highest up to 96.4%. When VGG19 was transferred to the component extraction model in the tumor region, the accuracy rate of segmenting 5 components reached 99.0%. Incohort 3, multivariate Cox analysis showed that high lymphocyte (LYM) neural network score and low stroma (STR) neural network score were significantly correlated with postoperative recurrence (HR=0.70, 1.38; P<0.05). Based on LYM, STR, AFP and American Joint Committee on Cancer (AJCC) staging, the early warning model of the risk of postoperative recurrence was constructed. In the training and validation sets, the models could accurately classify the risk of postoperative recurrence risk of patients (χ2=45.06, 15.49; P<0.05). In the independent cohort 4, the early warning model of HCC recurrence was further validated, and the comprehensive scores of LYM and STR pathological features could improve the prediction capability of AJCC staging for recurrence-free survival.Conclusions:The CNN-based automatic recognition model for HCC lesions and the component extraction model in tumor region can deliver intelligent segmentation of digital pathological sections of HCC and provide early warning of postoperative recurrence of HCC. LYM and STR are novel pathological predictors for postoperative recurrence.

Exploring pathological signatures for predicting the recurrence of early-stage hepatocellular carcinoma based on deep learning

Deep Learning-Based Radiomics Models for Early Recurrence Prediction of Hepatocellular Carcinoma with Multi-phase CT Images and Clinical Data.

Deep Learning-based Risk Prediction Model for Recurrence-free Survival in Patients with Hepatocellular Carcinoma Using Multi-phase CT Image

Deep Fusion Models of Multi-Phase CT and Selected Clinical Data for Preoperative Prediction of Early Recurrence in Hepatocellular Carcinoma.

Exploring prognostic indicators in the pathological images of hepatocellular carcinoma based on deep learning

Novel immune classification based on machine learning of pathological images predicts early recurrence of hepatocellular carcinoma

Deep learning for prediction of hepatocellular carcinoma recurrence after resection or liver transplantation: a discovery and validation study

Deep learning-based Spatial Feature Extraction for Prognostic Prediction of Hepatocellular Carcinoma from Pathological Images

Identification of a novel gene signature for the prediction of recurrence in HCC patients by machine learning of genome-wide databases

CT-Based Radiomics for the Recurrence Prediction of Hepatocellular Carcinoma after Surgical Resection

Study of digital pathological model based on convolutional neural network for early warning of recurrence of hepatocellular carcinoma

Development of a deep pathomics score for predicting hepatocellular carcinoma recurrence after liver transplantation

An imageomics and multi-network based deep learning model for risk assessment of liver transplantation for hepatocellular cancer

Prediction of HER2-positive breast cancer recurrence and metastasis risk from histopathological images and clinical information via multimodal deep learning

Predict Early Recurrence of Resectable Hepatocellular Carcinoma Using Multi-Dimensional Artificial Intelligence Analysis of Liver Fibrosis

Early Identification of High-Risk Patients with HCC Relapse: A Spatial Immune Scoring System Enabled by Artificial Intelligence

Clinically Applicable Deep Learning for Predicting Prognosis of Hepatocellular Carcinoma Directly From Histology Images

Combining a deep learning model with clinical data better predicts hepatocellular carcinoma behavior following surgery

A clinical‐radiomic‐pathomic model for prognosis prediction in patients with hepatocellular carcinoma after radical resection

Clinical and Morpho-Molecular Classifiers for Prediction of Hepatocellular Carcinoma Prognosis and Recurrence after Surgical Resection.

Prediction of 3-year recurrence rate of hepatocellular carcinoma after resection based on contrast-enhanced CT: a single-centre study