Abstract:Local spatial arrangement of nuclei in histopathology images of different cancer subtypes has been shown to have prognostic value. In order to capture localized nuclear architectural information, local cell cluster graph-based measurements have been proposed. However, conventional ways of cell graph construction only utilize nuclear spatial proximity, and do not differentiate between different cell types while constructing the graph. In this paper, we present feature-driven local cell cluster graph (FLocK), a new approach to constructing local cell graphs by simultaneously considering spatial proximity and attributes of the individual nuclei (e.g. shape, size, texture). In addition, we have designed a new set of quantitative graph-derived metrics to be extracted from FLocKs, in turn capturing the interplay between different proximally located clusters of nuclei. We have evaluated the efficacy of FLocK features extracted from H&E stained tissue images in two clinical applications: to classify short-term vs. long-term survival among patients of early stage non-small cell lung cancer (ES-NSCLC), and also to predict Human Papillomavirus (HPV) status of Oropharyngeal Squamous Cell Carcinoma (OP-SCCs).In the classification of long-term vs. short-term survival among patients of ES-NSCLC (training cohort, n=434), the top 10 discriminative FLocK features related to the variation of FLocK sizes and intersected FLocK distance were identified, via the Minimum Redundancy and Maximum Relevance (MRMR), under 100 runs of 10-fold cross-validation, in conjunction with a linear discriminant classifier yielded a mean of AUC=0.68 for predicting survival in training cohort. This is better than when compared to other state-of-art histomorphometric and deep learning classifiers (cell cluster graphs (AUC=0.62), global cell graph (AUC=0.56), nuclear shape (AUC=0.54), nuclear orientation (AUC=0.61), AlexNet (AUC=0.55), ResNet (AUC=0.56)). The FLocK-based classifier yielded an AUC of 0.70 in an independent testing cohort (n=150). The patients identified as "high-risk" had significantly poorer overall survival in the independent testing cohort, with Hazard Ratio (95% Confident Interval) = 2.24 (1.24-4.05), p = 0.01144).In the classification of HPV status of OP-SCC, the top three FLocK features pertaining to the portion of intersected FLocKs were identified to construct a classifier, which yielded an AUC of 0.80 in the training cohort (n=50), and an accuracy of 0.78 in an independent testing cohort (n=35). The combination of FLocK measurements with cell cluster graphs, nuclear orientation, and nuclear shape improved the training AUC to 0.87, 0.91 and 0.85, respectively. Deep learning approaches yield marginally better performance compared to the FLocK-based classifier in this application, with AUC=0.78 for AlexNet, AUC=0.81 for ResNet, and AUC=0.76 for FLocK-based classifier in the independent testing cohort. However, the combination of two hand-crafted features: FLocK and nuclear orientation yielded a better performance (with an AUC=0.84).FLocK provides a unique and quantitative way to analyze histology image of solid tumor and interrogates tumor morphology from a different aspect compared to the existing histomorphometrics. The source code can be accessed at <a href="https://github.com/hacylu/FLocK">https://github.com/hacylu/FLocK</a>.

Feature Driven Local Cell Graph (fedeg): Predicting Overall Survival in Early Stage Lung Cancer.

Feature-driven local cell graph (FLocK): New computational pathology-based descriptors for prognosis of lung cancer and HPV status of oropharyngeal cancers

DeepCG: A cell graph model for predicting prognosis in lung adenocarcinoma

Deep learning-based Spatial Feature Extraction for Prognostic Prediction of Hepatocellular Carcinoma from Pathological Images

Abstract 6189: Deep-learning model trained on multiplex immunofluorescence-stained tissue samples predicts the survival of patients with non-small cell lung cancer better than PD-L1 TPS alone

Functional-structural Sub-region Graph Convolutional Network (FSGCN): Application to the Prognosis of Head and Neck Cancer with PET/CT imaging

Computational staining of pathology images to study tumor microenvironment in lung cancer

Prognostic Gene Signatures for Lung Adenocarcinoma Using Digital Multiplexed Gene Expression in Formalin-Fixed Paraffin Embedded Tissue.

A prognostic model for overall survival of patients with early-stage non-small cell lung cancer: a multicentre, retrospective study

The potential of high-order features of routine blood test in predicting the prognosis of non-small cell lung cancer

Unsupervised Deep Learning Features for Lung Cancer Overall Survival Analysis.

Survival Prediction Across Diverse Cancer Types Using Neural Networks

Prediction of Overall Survival for Early-stage Non-small Cell Lung Cancer via a Novel 7-gene Prognostic Signature and Allele Frequency Deviation (AFD)

Predicting Gene Spatial Expression and Cancer Prognosis: An Integrated Graph and Image Deep Learning Approach Based on HE Slides

Single-Cell Spatial Analysis of Histopathology Images for Survival Prediction Via Graph Attention Network

Prediction of lung malignancy progression and survival with machine learning based on pre-treatment FDG-PET/CT

Survival Prediction for Non-Small Cell Lung Cancer Based on Multimodal Fusion and Deep Learning

Graph deep learning for the characterization of tumour microenvironments from spatial protein profiles in tissue specimens

A novel deep learning-based algorithm combining histopathological features with tissue areas to predict colorectal cancer survival from whole-slide images

A Novel Deep Learning Method to Predict Lung Cancer Long-Term Survival With Biological Knowledge Incorporated Gene Expression Images and Clinical Data

A Neoteric Feature Extraction Technique to Predict the Survival of Gastric Cancer Patients