Abstract:3581 Background: Histopathological images of colorectal liver metastasis (CRLM) contain rich morphometric information that may predict patient outcomes, but current indicators depend on labor-intensive and subjective visual estimation. Herein, we aimed to develop an automated framework for tissue classification of routine H&E stained whole-slide images and establish a risk-scoring model for better prognosis prediction in patients with CRLM. Methods: Using 161,371 hand-delineated image patches, we trained a robust deep convolutional neural network- CRLM-SPA for accurate classification of CRLM into seven tissue types. With the tissue classification results on two independent in-house cohorts (SYSUCC: n = 433, BJCH: n = 404), we systematically quantified spatial organization features (SOFs), involving whole-slide, tumor-infiltrating and tumor-distal SOFs for different tissue types as well as the interactions between tumor and non-tumor tissues. Subsequently, univariate Cox proportional hazards regression analysis was performed to investigate the association between various SOFs and patient outcomes. Nonredundant SOFs that are clinically relevant were selected to build a risk-scoring model for prognosis using multivariate Cox regression analysis in the SYSUCC cohort, followed by validation in the BJCH cohort. Results: CRLM-SPA achieved an overall classification accuracy of > 93% in an independent set of 17,653 image patches. With the classification result, we calculated various SOFs and built a four-SOF risk-scoring model that significantly predicted overall survival (OS) in the discovery cohort, SYSUCC ( P = 1.40 10 -5 ; HR = 2.26; 95%CI: 1.55 - 3.29) and the independent validation cohort, BJCH ( P = 4.59 × 10 -4 ; HR = 2.00; 95%CI: 1.35 - 2.97). The prognostic performance of our SOF risk-scoring model is independent of the clinical risk score (CRS) system. Further stratification analyses in patients without preoperative chemotherapy (CTx) indicated that adjuvant CTx consistently improved OS in the SOF high-risk subgroups in both cohorts ( P = 0.018 and 0.049), but not in the SOF low-risk subgroups. Furthermore, a combined scoring system incorporating SOF and CRS considerably improved the prognostic performance in both cohorts over the individual SOF and CRS systems. Conclusions: CRLM-SPA showed a high accuracy in tissue classification and robustness in extracting prognostic information from H&E images. The SOF risk-scoring system demonstrated a strong and robust prognostic value that is independent of CRS, and could therefore provide a time- and cost-efficient tool to assist clinical decision making for patients with CRLM.

Deep learning-based Spatial Feature Extraction for Prognostic Prediction of Hepatocellular Carcinoma from Pathological Images

Classification and Prognosis Prediction from Histopathological Images of Hepatocellular Carcinoma by a Fully Automated Pipeline Based on Machine Learning

Deep Learning-Based Radiomics Models for Early Recurrence Prediction of Hepatocellular Carcinoma with Multi-phase CT Images and Clinical Data.

Deep Fusion Models of Multi-Phase CT and Selected Clinical Data for Preoperative Prediction of Early Recurrence in Hepatocellular Carcinoma.

Exploring prognostic indicators in the pathological images of hepatocellular carcinoma based on deep learning

Applying Image Features of Proximal Paracancerous Tissues in Predicting Prognosis of Patients with Hepatocellular Carcinoma

Prognostic analysis of histopathological images using pre-trained convolutional neural networks: application to hepatocellular carcinoma

Single-Cell Spatial Analysis of Tumor and Immune Microenvironment on Whole-Slide Image Reveals Hepatocellular Carcinoma Subtypes

Exploring pathological signatures for predicting the recurrence of early-stage hepatocellular carcinoma based on deep learning

Clinically Applicable Deep Learning for Predicting Prognosis of Hepatocellular Carcinoma Directly From Histology Images

Computational staining of pathology images to study tumor microenvironment in lung cancer

Deep learning-derived spatial organization features on histology images predicts prognosis in colorectal liver metastasis patients after hepatectomy

Identifying Immune Infiltration by Deep Learning to Assess the Prognosis of Patients with Hepatocellular Carcinoma.

Integrated Machine Learning and Bioinformatic Analyses Constructed a Novel Stemness-Related Classifier to Predict Prognosis and Immunotherapy Responses for Hepatocellular Carcinoma Patients

Deep learning-derived spatial organization features on histopathology images to predict prognosis in patients with colorectal liver metastasis, after hepatectomy.

Diagnosis and Survival Prediction of Colorectal Cancer Using Deep Learning from the Histopathological HE Images

A Deep Learning Approach for Tissue Spatial Quantification and Genomic Correlations of Histopathological Images

Novel immune classification based on machine learning of pathological images predicts early recurrence of hepatocellular carcinoma

Histopathological Image and Gene Expression Pattern Analysis for Predicting Molecular Features and Prognosis of Head and Neck Squamous Cell Carcinoma

Computational Staining of Pathology Images to Study the Tumor Microenvironment in Lung Cancer