Abstract:Histopathological images contain rich phenotypic descriptions of the molecular processes underlying disease progression. Convolutional neural networks, state-of-the-art image analysis techniques in computer vision, automatically learn representative features from such images which can be useful for disease diagnosis, prognosis, and subtyping. Hepatocellular carcinoma (HCC) is the sixth most common type of primary liver malignancy. Despite the high mortality rate of HCC, little previous work has made use of CNN models to explore the use of histopathological images for prognosis and clinical survival prediction of HCC. We applied three pre-trained CNN models-VGG 16, Inception V3 and ResNet 50-to extract features from HCC histopathological images. Sample visualization and classification analyses based on these features showed a very clear separation between cancer and normal samples. In a univariate Cox regression analysis, 21.4% and 16% of image features on average were significantly associated with overall survival (OS) and disease-free survival (DFS), respectively. We also observed significant correlations between these features and integrated biological pathways derived from gene expression and copy number variation. Using an elastic net regularized Cox Proportional Hazards model of OS constructed from Inception image features, we obtained a concordance index (C-index) of 0.789 and a significant log-rank test (p = 7.6E-18). We also performed unsupervised classification to identify HCC subgroups from image features. The optimal two subgroups discovered using Inception model image features showed significant differences in both overall (C-index = 0.628 and p = 7.39E-07) and DFS (C-index = 0.558 and p = 0.012). Our work demonstrates the utility of extracting image features using pre-trained models by using them to build accurate prognostic models of HCC as well as highlight significant correlations between these features, clinical survival, and relevant biological pathways. Image features extracted from HCC histopathological images using the pre-trained CNN models VGG 16, Inception V3 and ResNet 50 can accurately distinguish normal and cancer samples. Furthermore, these image features are significantly correlated with survival and relevant biological pathways.

Classification and Prognosis Prediction from Histopathological Images of Hepatocellular Carcinoma by a Fully Automated Pipeline Based on Machine Learning

Clinically Applicable Deep Learning for Predicting Prognosis of Hepatocellular Carcinoma Directly From Histology Images

Deep learning-based Spatial Feature Extraction for Prognostic Prediction of Hepatocellular Carcinoma from Pathological Images

Applying Image Features of Proximal Paracancerous Tissues in Predicting Prognosis of Patients with Hepatocellular Carcinoma

Prognostic analysis of histopathological images using pre-trained convolutional neural networks: application to hepatocellular carcinoma

Classification and Mutation Prediction Based on Histopathology H&E Images in Liver Cancer Using Deep Learning.

Data-Driven Assisted Decision Making for Surgical Procedure of Hepatocellular Carcinoma Resection and Prognostic Prediction: Development and Validation of Machine Learning Models

Single-Cell Spatial Analysis of Tumor and Immune Microenvironment on Whole-Slide Image Reveals Hepatocellular Carcinoma Subtypes

Novel immune classification based on machine learning of pathological images predicts early recurrence of hepatocellular carcinoma

Histopathological Image and Gene Expression Pattern Analysis for Predicting Molecular Features and Prognosis of Head and Neck Squamous Cell Carcinoma

Exploring prognostic indicators in the pathological images of hepatocellular carcinoma based on deep learning

Development of a Deep Learning Model to Assist with Diagnosis of Hepatocellular Carcinoma

Clinical and Morpho-Molecular Classifiers for Prediction of Hepatocellular Carcinoma Prognosis and Recurrence after Surgical Resection.

Evaluation and Prediction of Hepatocellular Carcinoma Prognosis Based on Molecular Classification

Early Diagnosis of Hepatocellular Carcinoma Using Machine Learning Method

A Systems Biology-Based Classifier for Hepatocellular Carcinoma Diagnosis

Deep learning for prediction of hepatocellular carcinoma recurrence after resection or liver transplantation: a discovery and validation study

Hybrid deep learning-based strategy for the hepatocellular carcinoma cancer grade classification of H&E stained liver histopathology images

Abstract 6175: Deep learning-based survival prediction for hepatocellular carcinoma using whole slide images

A novel risk scoring system predicts overall survival of hepatocellular carcinoma using Cox proportional hazards machine learning method

Deep Learning-Based Classification of Hepatocellular Nodular Lesions on Whole-Slide Histopathologic Images