Abstract:Despite advancements in deep learning for histopathology, integrating these insights with multi-omics data to uncover clinically relevant omics pathway-level signatures remains a challenge. Our study addresses this gap by applying unsupervised learning techniques on pan-cancer multi-omics data, leveraging 3,080 Hematoxylin and Eosin (H&E) images from 1,010 patients in Clinical Proteomic Tumor Analysis Consortium (CPTAC) to uncover omics pathway-level signatures that drive discernable morphology phenotypes at the tissue level. First, imaging models were trained to predict clinical and mutation outcomes, and thereafter, integrated with transcriptomic and proteomic expression data using sparse canonical correlation analysis. Our findings reveal that images of TP53 mutated samples exhibited increased nuclear size and dense lymphoplasmacytic infiltration. These morphological changes correlated with neutrophil and macrophage signaling at the proteomic level, and IL-1 mediated signaling at the transcriptomic level, highlighting the complementary perspectives different omics can provide. To further elucidate immune interactions, we applied multi-omics deconvolution to identify 7 immune subtypes, characterizing each with gene set enrichment, germline DNA variations, and kinase activations. We show that imaging models trained to predict these subtypes differentiate tissue morphologies corresponding to immune enrichment (AUROC: 0.84). To further confirm the robustness of our approach, we trained models to predict co-regulated proteomic modules clustered by independent component analysis. We demonstrate a signature in pan-squamous tumors, consisting of T cell markers and interferon-gamma response proteins like CD4, CD48, and GBP5, which imaging models can successfully predict from histopathology. Manual review from pathologists confirmed lymphocytic T-cell density as a differentiator in samples with the highest and lowest T-cell signaling. Together, these approaches demonstrate that genomic characteristics discovered via unbiased mining of pan-cancer multi-omics data manifest as quantitative imaging phenotypes. These results underscore the potential of multi-omics and digital pathology to integratively uncover and confirm new cancer biology. Our ongoing work will explore predicting drug response and survival from morphology patterns related to multi-omics signatures. Citation Format: Joshua Wang, Runyu Hong, Jimin Tan, Wenke Liu, David Fenyȯ. Uncovering clinically relevant omics signatures from pan-cancer imaging and multi-omics data integration [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular s); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl) nr 888.

Characterizing the Survival-Associated Interactions between Tumor-infiltrating Lymphocytes and Tumors from Pathological Images and Multi-omics Data

Deep-Learning-Based Characterization of Tumor-Infiltrating Lymphocytes in Breast Cancers From Histopathology Images and Multiomics Data

Integrative analysis of pathological images and multi-dimensional genomic data for early-stage cancer prognosis.

AI-Powered Interpretable Imaging Phenotypes Noninvasively Characterize Tumor Microenvironment Associated with Diverse Molecular Signatures and Survival in Breast Cancer

Harnessing TME depicted by histological images to improve cancer prognosis through a deep learning system

Multimodal Survival Ensemble Network: Integrating Genomic and Histopathological Insights for Enhanced Cancer Prognosis.

Multimodal Cross-Task Interaction for Survival Analysis in Whole Slide Pathological Images

MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Features

Predicting Gene Spatial Expression and Cancer Prognosis: An Integrated Graph and Image Deep Learning Approach Based on HE Slides

Multi-instance Multi-task Learning for Joint Clinical Outcome and Genomic Profile Predictions from the Histopathological Images

Deep learning based feature-level integration of multi-omics data for breast cancer patients survival analysis

Abstract 888: Uncovering clinically relevant omics signatures from pan-cancer imaging and multi-omics data integration

Multimodal Data Integration Using Deep Learning Predicts Overall Survival of Patients with Glioma

DeepOmix: A scalable and interpretable multi-omics deep learning framework and application in cancer survival analysis

Application of radiomics-based multiomics combinations in the tumor microenvironment and cancer prognosis

Deep Biological Pathway Informed Pathology-Genomic Multimodal Survival Prediction

ImmunoAIzer: A Deep Learning-Based Computational Framework to Characterize Cell Distribution and Gene Mutation in Tumor Microenvironment.

Dual-stream multi-dependency graph neural network enables precise cancer survival analysis

A Novel Pathological Images and Genomic Data Fusion Framework for Breast Cancer Survival Prediction.

Pancancer survival prediction using a deep learning architecture with multimodal representation and integration

Integrating multi-omics data by learning modality invariant representations for improved prediction of overall survival of cancer