Clinically Applicable Deep Learning for Predicting Prognosis of Hepatocellular Carcinoma Directly From Histology Images

Zhikun Liu,Yuan Hong,Bajin Wei,Yichao Wu,Haiyang Xie,Lin Zhou,Shusen Zheng,Xiao Xu
DOI: https://doi.org/10.2139/ssrn.3772764
2021-01-01
Abstract:Background: Prognosis classifier is necessary for patients with hepatocellular carcinoma (HCC). Here, we developed a clinically applicable automatic system to predict prognosis directly from HCC histology image. Methods: In total, 1480 participants were enrolled (ZJU1: n=202, ZJU2: n=179, ZJU3: n=738, TCGA: n=361). We trained 7 convolutional neural network (CNN) nets to select the top one in learning HCC image. Firstly, lesion detector and lesion decomposer net (classifying lesion into five different classes) were developed in ZJU1 and validated in ZJU2. Second, a prognosis classifier using the classes derived from decomposer net was constructed by LASSO Cox in ZJU3. Lastly, the two nets and the prognosis classifier were validated in external TCGA. Findings: Of the 7 CNNs, VGG19 achieved the top performer for detecting lesion with an accuracy of 96.4%, and classifying lesion with test accuracy of 99% in ZJU2. In ZJU3, two classes derived from the decomposer net were significantly associated with RFS (p<0.001): the neuron status of lymphocytes (HR: 0.69, 95%CI: 0.57-0.84) and stroma (HR: 1.39, 95%CI: 1.14–1.70). Lastly, the detector and decomposer nets were used to automatically detect lesion and extract prognosticators in TCGA. The category-free, event and non-event NRI of the supplementing stage_AJCC with lymphocytes and stroma neuron status for predicting 2-year RFS were 31.2%, 12.8% and 18.4%, respectively. Moreover, the prognostic classifier was confirmed in TCGA cohorts. Interpretation: The two clinically applicable models can precisely detect lesion and extract the prognostic factors from histology images and holds great potential for prognosis prediction and decision-making. Funding: National Major Scientific and Technological Special Project (No.2017ZX10203205), and National Natural Science Foundation of China (81802889). Declaration of Interest: The authors declare no any ethical/legal conflicts involved in the article. Ethical Approval: The study was supported by National Major Scientific and Technological Special Project (No.2017ZX10203205), Science Foundation of Zhejaing province (LQ18H160006). The results in this study are in part based upon data from the TCGA.
What problem does this paper attempt to address?