Abstract:The application of deep learning to spatial transcriptomics (ST) can reveal relationships between gene expression and tissue architecture. Prior work has demonstrated that inferring gene expression from tissue histomorphology can discern these spatial molecular markers to enable population scale studies, reducing the fiscal barriers associated with large–scale spatial profiling. However, while most improvements in algorithmic performance have focused on improving model architectures, little is known about how the quality of tissue preparation and imaging can affect deep learning model training for spatial inference from morphology and its potential for widespread clinical adoption. Prior studies for ST inference from histology typically utilize manually stained frozen sections with imaging on non-clinical grade scanners. Training such models on ST cohorts is also costly. We hypothesize that adopting tissue processing and imaging practices that mirror standards for clinical implementation (permanent sections, automated tissue staining, and clinical grade scanning) can significantly improve model performance. An enhanced specimen processing and imaging protocol was developed for deep learning-based ST inference from morphology. This protocol featured the Visium CytAssist assay to permit automated hematoxylin and eosin staining (e.g. Leica Bond), 40×-resolution imaging, and joining of multiple patients' tissue sections per capture area prior to ST profiling. Using a cohort of 13 pathologic T Stage-III stage colorectal cancer patients, we compared the performance of models trained on slide prepared using enhanced versus traditional (i.e. manual staining and low-resolution imaging) protocols. Leveraging Inceptionv3 neural networks, we predicted gene expression across serial, histologically-matched tissue sections using whole slide images (WSI) from both protocols. The data Shapley was used to quantify and compare marginal performance gains on a patient-by-patient basis attributed to using the enhanced protocol versus the actual costs of spatial profiling. Findings indicate that training and validating on WSI acquired through the enhanced protocol as opposed to the traditional method resulted in improved performance at lower fiscal cost. In the realm of ST, the enhancement of deep learning architectures frequently captures the spotlight; however, the significance of specimen processing and imaging is often understated. This research, informed through a game-theoretic lens, underscores the substantial impact that specimen preparation/imaging can have on spatial transcriptomic inference from morphology. It is essential to integrate such optimized processing protocols to facilitate the identification of prognostic markers at a larger scale.

From Whole-slide Image to Biomarker Prediction: A Protocol for End-to-End Deep Learning in Computational Pathology

From whole-slide image to biomarker prediction: end-to-end weakly supervised deep learning in computational pathology

Machine learning enabled prediction of digital biomarkers from whole slide histopathology images

Weakly supervised annotation-free cancer detection and prediction of genotype in routine histopathology

A systematic pan-cancer study on deep learning-based prediction of multi-omic biomarkers from routine pathology images

End-to-end Learning for Image-based Detection of Molecular Alterations in Digital Pathology

Deep learning in cancer pathology: a new generation of clinical biomarkers

Developing image analysis pipelines of whole-slide images: Pre- and post-processing

Predicting Tumor-related Indicators Based on Deep Learning and H&E Stained Pathological Images :A Survey

Deep Learning-Based Prediction of Molecular Tumor Biomarkers from H&E: A Practical Review

Exploit Spatially Resolved Transcriptomic Data to Infer Cellular Features from Pathology Imaging Data}

Development of Prognostic Biomarkers by TMB-Guided WSI Analysis: A Two-Step Approach

PathML: A unified framework for whole-slide image analysis with deep learning

Code-Free Development and Deployment of Deep Segmentation Models for Digital Pathology

An initial game-theoretic assessment of enhanced tissue preparation and imaging protocols for improved deep learning inference of spatial transcriptomics from tissue morphology

Screen Them All: High-Throughput Pan-Cancer Genetic and Phenotypic Biomarker Screening from H&E Whole Slide Images

Colorectal Cancer Outcome Prediction from H&E Whole Slide Images using Machine Learning and Automatically Inferred Phenotype Profiles

Determining breast cancer biomarker status and associated morphological features using deep learning

Deep Learning Models for Digital Pathology

Clinical-grade computational pathology using weakly supervised deep learning on whole slide images

Multi-stain modelling of histopathology slides for breast cancer prognosis prediction