Mixed-function oxygenase enzymes as tools for pollution monitoring: field studies on the French coast of the Mediterranean Sea.

J. Narbonne,Philippe Garrigues,D. Ribera,C. Raoux,Anne Mathieu,Philippe Lemaire,J. Salaün,M. Lafaurie

DOI: https://doi.org/10.1016/0742-8413(91)90118-D

Abstract:

What problem does this paper attempt to address?

Contrastive learning-based histopathological features infer molecular subtypes and clinical outcomes of breast cancer from unannotated whole slide images

Hui Liu,Yang Zhang,Judong Luo

DOI: https://doi.org/10.1016/j.compbiomed.2024.107997

IF: 7.7

2024-01-26

Computers in Biology and Medicine

Abstract:The artificial intelligence-powered computational pathology has led to significant improvements in the speed and precision of tumor diagnosis, while also exhibiting substantial potential to infer genetic mutations and gene expression levels. However, current studies remain limited in predicting molecular subtypes and clinical outcomes in breast cancer. In this paper, we proposed a weakly supervised contrastive learning framework to address this challenge. Our framework first performed contrastive learning pretraining on a large number of unlabeled patches tiled from whole slide images (WSIs) to extract patch-level features. The gated attention mechanism was leveraged to aggregate patch-level features to produce slide feature that was then applied to various downstream tasks. To confirm the effectiveness of the proposed method, three public cohorts and one external independent cohort of breast cancer have been used to conducted evaluation experiments. The predictive powers of our model to infer gene expression, molecular subtypes, recurrence events and drug responses were validated across cohorts. In addition, the learned patch-level attention scores enabled us to generate heatmaps that were highly consistent with pathologist annotations and spatial transcriptomic data. These findings demonstrated that our model effectively established the high-order genotype-phenotype associations, thereby potentially extend the application of digital pathology in clinical practice.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
Deep learning infers clinically relevant protein levels and drug response in breast cancer from unannotated pathology images

Hui Liu,Xiaodong Xie,Bin Wang

DOI: https://doi.org/10.1038/s41523-024-00620-y

2024-02-28

npj Breast Cancer

Abstract:The computational pathology has been demonstrated to effectively uncover tumor-related genomic alterations and transcriptomic patterns. Although proteomics has indeed shown great potential in the field of precision medicine, few studies have focused on the computational prediction of protein levels from pathology images. In this paper, we assume that deep learning-based pathological features imply the protein levels of tumor biomarkers that are indicative of prognosis and drug response. For this purpose, we propose wsi2rppa, a weakly supervised contrastive learning framework to infer the protein levels of tumor biomarkers from whole slide images (WSIs) in breast cancer. We first conducted contrastive learning-based pre-training on tessellated tiles to extract pathological features, which are then aggregated by attention pooling and adapted to downstream tasks. We conducted extensive evaluation experiments on the TCGA-BRCA cohort (1978 WSIs of 1093 patients with protein levels of 223 biomarkers) and the CPTAC-BRCA cohort (642 WSIs of 134 patients). The results showed that our method achieved state-of-the-art performance in tumor diagnostic tasks, and also performed well in predicting clinically relevant protein levels and drug response. To show the model interpretability, we spatially visualized the WSIs colored the tiles by their attention scores, and found that the regions with high scores were highly consistent with the tumor and necrotic regions annotated by a 10-year experienced pathologist. Moreover, spatial transcriptomic data further verified that the heatmap generated by attention scores agrees greatly with the spatial expression landscape of two typical tumor biomarker genes. In predicting the response to drug trastuzumab treatment, our method achieved a 0.79 AUC value which is much higher than the previous study reported 0.68. These findings showed the remarkable potential of computational pathology in the prediction of clinically relevant protein levels, drug response, and clinical outcomes.

oncology
Contrastive learning-based computational histopathology predict differential expression of cancer driver genes

Haojie Huang,Gongming Zhou,Xuejun Liu,Lei Deng,Chen Wu,Dachuan Zhang,Hui Liu

DOI: https://doi.org/10.1093/bib/bbac294

IF: 9.5

2022-07-30

Briefings in Bioinformatics

Abstract:Digital pathological analysis is run as the main examination used for cancer diagnosis. Recently, deep learning-driven feature extraction from pathology images is able to detect genetic variations and tumor environment, but few studies focus on differential gene expression in tumor cells. In this paper, we propose a self-supervised contrastive learning framework, HistCode, to infer differential gene expression from whole slide images (WSIs). We leveraged contrastive learning on large-scale unannotated WSIs to derive slide-level histopathological features in latent space, and then transfer it to tumor diagnosis and prediction of differentially expressed cancer driver genes. Our experiments showed that our method outperformed other state-of-the-art models in tumor diagnosis tasks, and also effectively predicted differential gene expression. Interestingly, we found the genes with higher fold change can be more precisely predicted. To intuitively illustrate the ability to extract informative features from pathological images, we spatially visualized the WSIs colored by the attention scores of image tiles. We found that the tumor and necrosis areas were highly consistent with the annotations of experienced pathologists. Moreover, the spatial heatmap generated by lymphocyte-specific gene expression patterns was also consistent with the manually labeled WSIs.

biochemical research methods,mathematical & computational biology
Spatial transcriptomics inferred from pathology whole-slide images links tumor heterogeneity to survival in breast and lung cancer

Alona Levy-Jurgenson,Xavier Tekpli,Vessela N. Kristensen,Zohar Yakhini

DOI: https://doi.org/10.1038/s41598-020-75708-z

IF: 4.6

2020-11-02

Scientific Reports

Abstract:Abstract Digital analysis of pathology whole-slide images is fast becoming a game changer in cancer diagnosis and treatment. Specifically, deep learning methods have shown great potential to support pathology analysis, with recent studies identifying molecular traits that were not previously recognized in pathology H&E whole-slide images. Simultaneous to these developments, it is becoming increasingly evident that tumor heterogeneity is an important determinant of cancer prognosis and susceptibility to treatment, and should therefore play a role in the evolving practices of matching treatment protocols to patients. State of the art diagnostic procedures, however, do not provide automated methods for characterizing and/or quantifying tumor heterogeneity, certainly not in a spatial context. Further, existing methods for analyzing pathology whole-slide images from bulk measurements require many training samples and complex pipelines. Our work addresses these two challenges. First, we train deep learning models to spatially resolve bulk mRNA and miRNA expression levels on pathology whole-slide images (WSIs). Our models reach up to 0.95 AUC on held-out test sets from two cancer cohorts using a simple training pipeline and a small number of training samples. Using the inferred gene expression levels, we further develop a method to spatially characterize tumor heterogeneity. Specifically, we produce tumor molecular cartographies and heterogeneity maps of WSIs and formulate a heterogeneity index (HTI) that quantifies the level of heterogeneity within these maps. Applying our methods to breast and lung cancer slides, we show a significant statistical link between heterogeneity and survival. Our methods potentially open a new and accessible approach to investigating tumor heterogeneity and other spatial molecular properties and their link to clinical characteristics, including treatment susceptibility and survival.

multidisciplinary sciences
Predicting the Tumor Microenvironment Composition and Immunotherapy Response in Non-Small Cell Lung Cancer from Digital Histopathology Images

Sushant Patkar,Alex H Chen,Alina Basnet,Amber Bixby,Rahul Rajendran,Rachel Chernet,Susan Faso,Prashanth Ashok Kumar,Devashish Desai,Ola El-Zammar,Christopher Curtiss,Saverio J Carello,Michael Nasr,Peter Choyke,Stephanie Harmon,Baris Turkbey,Tamara Jamaspishvili

DOI: https://doi.org/10.1101/2024.06.11.24308696

2024-06-12

Abstract:Immune checkpoint inhibitors (ICI) have become integral to treatment of non-small cell lung cancer (NSCLC). However, reliable biomarkers predictive of immunotherapy efficacy are limited. Here, we introduce HistoTME, a novel weakly supervised deep learning approach to infer the tumor microenvironment (TME) composition directly from histopathology images of NSCLC patients. We show that HistoTME accurately predicts the expression of 30 distinct cell type-specific molecular signatures directly from whole slide images, achieving an average Pearson correlation of 0.5 with the ground truth on independent tumor cohorts. Furthermore, we find that HistoTME-predicted microenvironment signatures and their underlying interactions improve prognostication of lung cancer patients receiving immunotherapy, achieving an AUROC of 0.75[95% CI: 0.61-0.88] for predicting treatment responses following first-line ICI treatment, utilizing an external clinical cohort of 652 patients. Collectively, HistoTME presents an effective approach for interrogating the TME and predicting ICI response, complementing PD-L1 expression, and bringing us closer to personalized immuno-oncology.

Pathology
Synthesis of isoleucine-5-tyrosine-8-angiotensin II and isoleucine-5-hydroxyproline-7-angiotensin II.

K. Sivanandaiah,R. Smeby,F. Bumpus

IF: 3.321

Biochemistry

Abstract:
Prediction of HER2-positive breast cancer recurrence and metastasis risk from histopathological images and clinical information via multimodal deep learning

Jialiang Yang,Jie Ju,Lei Guo,Binbin Ji,Shufang Shi,Zixuan Yang,Songlin Gao,Xu Yuan,Geng Tian,Yuebin Liang,Peng Yuan

DOI: https://doi.org/10.1016/j.csbj.2021.12.028

IF: 6.155

2022-01-01

Computational and Structural Biotechnology Journal

Abstract:HER2-positive breast cancer is a highly heterogeneous tumor, and about 30% of patients still suffer from recurrence and metastasis after trastuzumab targeted therapy. Predicting individual prognosis is of great significance for the further development of precise therapy. With the continuous development of computer technology, more and more attention has been paid to computer-aided diagnosis and prognosis prediction based on Hematoxylin and Eosin (H&E) pathological images, which are available for all breast cancer patients undergone surgical treatment. In this study, we first enrolled 127 HER2-positive breast cancer patients with known recurrence and metastasis status from Cancer Hospital of the Chinese Academy of Medical Sciences. We then proposed a novel multimodal deep learning method integrating whole slide H&E images (WSIs) and clinical information to accurately assess the risk of relapse and metastasis in patients with HER2-positive breast cancer. Specifically, we obtained the whole H&E staining images from the surgical specimens of breast cancer patients, and these images were adjusted to size 512 × 512 pixels. The deep convolutional neural network (CNN) was applied to these images to retrieve image features, which were combined with the clinical data. Based on the combined features. After that, a novel multimodal model was constructed for predicting the prognosis of each patient. The model achieved an area under curve (AUC) of 0.76 in the two-fold cross-validation (CV). To further evaluate the performance of our model, we downloaded the data of all 123 HER2-positive breast cancer patients with available H&E image and known recurrence and metastasis status in The Cancer Genome Atlas (TCGA), which was severed as an independent testing data. Despite the huge differences in race and experimental strategies, our model achieved an AUC of 0.72 in the TCGA samples. As a conclusion, H&E images, in conjunction with clinical information and advanced deep learning models, could be used to evaluate the risk of relapse and metastasis in patients with HER2-positive breast cancer.

biochemistry & molecular biology
MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Features

Mingxin Liu,Yunzan Liu,Hui Cui,Chunquan Li,Jiquan Ma

2023-11-20

Abstract:The rapidly emerging field of deep learning-based computational pathology has shown promising results in utilizing whole slide images (WSIs) to objectively prognosticate cancer patients. However, most prognostic methods are currently limited to either histopathology or genomics alone, which inevitably reduces their potential to accurately predict patient prognosis. Whereas integrating WSIs and genomic features presents three main challenges: (1) the enormous heterogeneity of gigapixel WSIs which can reach sizes as large as 150,000x150,000 pixels; (2) the absence of a spatially corresponding relationship between histopathology images and genomic molecular data; and (3) the existing early, late, and intermediate multimodal feature fusion strategies struggle to capture the explicit interactions between WSIs and genomics. To ameliorate these issues, we propose the Mutual-Guided Cross-Modality Transformer (MGCT), a weakly-supervised, attention-based multimodal learning framework that can combine histology features and genomic features to model the genotype-phenotype interactions within the tumor microenvironment. To validate the effectiveness of MGCT, we conduct experiments using nearly 3,600 gigapixel WSIs across five different cancer types sourced from The Cancer Genome Atlas (TCGA). Extensive experimental results consistently emphasize that MGCT outperforms the state-of-the-art (SOTA) methods.

Computer Vision and Pattern Recognition,Artificial Intelligence
Prediction of Tumor Mutation Load in Colorectal Cancer Histopathological Images Based on Deep Learning

Yongguang Liu,Kaimei Huang,Yachao Yang,Yan Wu,Wei Gao

DOI: https://doi.org/10.3389/fonc.2022.906888

IF: 4.7

2022-05-25

Frontiers in Oncology

Abstract:Colorectal cancer (CRC) is one of the most prevalent malignancies, and immunotherapy can be applied to CRC patients of all ages, while its efficacy is uncertain. Tumor mutational burden (TMB) is important for predicting the effect of immunotherapy. Currently, whole-exome sequencing (WES) is a standard method to measure TMB, but it is costly and inefficient. Therefore, it is urgent to explore a method to assess TMB without WES to improve immunotherapy outcomes. In this study, we propose a deep learning method, DeepHE, based on the Residual Network (ResNet) model. On images of tissue, DeepHE can efficiently identify and analyze characteristics of tumor cells in CRC to predict the TMB. In our study, we used ×40 magnification images and grouped them by patients followed by thresholding at the 10th and 20th quantiles, which significantly improves the performance. Also, our model is superior compared with multiple models. In summary, deep learning methods can explore the association between histopathological images and genetic mutations, which will contribute to the precise treatment of CRC patients.

oncology
Computational Staining of Pathology Images to Study the Tumor Microenvironment in Lung Cancer

Shidan Wang,Ruichen Rong,Donghan M Yang,Junya Fujimoto,Shirley Yan,Ling Cai,Lin Yang,Danni Luo,Carmen Behrens,Edwin R Parra,Bo Yao,Lin Xu,Tao Wang,Xiaowei Zhan,Ignacio I Wistuba,John Minna,Yang Xie,Guanghua Xiao,Donghan M. Yang,Edwin R. Parra,Ignacio I. Wistuba

DOI: https://doi.org/10.1158/0008-5472.CAN-19-1629

IF: 11.2

2020-05-16

Cancer Research

Abstract:The spatial organization of different types of cells in tumor tissues reveals important information about the tumor microenvironment (TME). To facilitate the study of cellular spatial organization and interactions, we developed Histology-based Digital-Staining, a deep learning-based computation model, to segment the nuclei of tumor, stroma, lymphocyte, macrophage, karyorrhexis, and red blood cells from standard hematoxylin and eosin–stained pathology images in lung adenocarcinoma. Using this tool, we identified and classified cell nuclei and extracted 48 cell spatial organization-related features that characterize the TME. Using these features, we developed a prognostic model from the National Lung Screening Trial dataset, and independently validated the model in The Cancer Genome Atlas lung adenocarcinoma dataset, in which the predicted high-risk group showed significantly worse survival than the low-risk group (P = 0.001), with a HR of 2.23 (1.37–3.65) after adjusting for clinical variables. Furthermore, the image-derived TME features significantly correlated with the gene expression of biological pathways. For example, transcriptional activation of both the T-cell receptor and programmed cell death protein 1 pathways positively correlated with the density of detected lymphocytes in tumor tissues, while expression of the extracellular matrix organization pathway positively correlated with the density of stromal cells. In summary, we demonstrate that the spatial organization of different cell types is predictive of patient survival and associated with the gene expression of biological pathways.Significance:These findings present a deep learning-based analysis tool to study the TME in pathology images and demonstrate that the cell spatial organization is predictive of patient survival and is associated with gene expression.See related commentary by Rodriguez-Antolin, p. 1912

oncology
Development of Prognostic Biomarkers by TMB-Guided WSI Analysis: A Two-Step Approach

Xiangyu Liu,Zhenyu Liu,Ye Yan,Kai Wang,Aodi Wang,Xiongjun Ye,Liwei Wang,Wei Wei,Bao Li,Caixia Sun,Wei He,Xuehua Zhu,Zenan Liu,Jiangang Liu,Jian Lu,Jie Tian

DOI: https://doi.org/10.1109/jbhi.2023.3249354

IF: 7.7

2023-04-01

IEEE Journal of Biomedical and Health Informatics

Abstract:The rapid development of computational pathology has brought new opportunities for prognosis prediction using histopathological images. However, the existing deep learning frameworks lack exploration of the relationship between images and other prognostic information, resulting in poor interpretability. Tumor mutation burden (TMB) is a promising biomarker for predicting the survival outcomes of cancer patients, but its measurement is costly. Its heterogeneity may be reflected in histopathological images. Here, we report a two-step framework for prognostic prediction using whole-slide images (WSIs). First, the framework adopts a deep residual network to encode the phenotype of WSIs and classifies patient-level TMB by the deep features after aggregation and dimensionality reduction. Then, the patients' prognosis is stratified by the TMB-related information obtained during the classification model development. Deep learning feature extraction and TMB classification model construction are performed on an in-house dataset of 295 Haematoxylin & Eosin stained WSIs of clear cell renal cell carcinoma (ccRCC). The development and evaluation of prognostic biomarkers are performed on The Cancer Genome Atlas-Kidney ccRCC (TCGA-KIRC) project with 304 WSIs. Our framework achieves good performance for TMB classification with an area under the receiver operating characteristic curve (AUC) of 0.813 on the validation set. Through survival analysis, our proposed prognostic biomarkers can achieve significant stratification of patients' overall survival (P 0.05) and outperform the original TMB signature in risk stratification of patients with advanced disease. The results indicate the feasibility of mining TMB-related information from WSI to achieve stepwise prognosis prediction.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
Ensemble transformer-based multiple instance learning to predict pathological subtypes and tumor mutational burden from histopathological whole slide images of endometrial and colorectal cancer

Ching-Wei Wang,Tzu-Chien Liu,Po-Jen Lai,Hikam Muzakky,Yu-Chi Wang,Mu-Hsien Yu,Chia-Hua Wu,Tai-Kuang Chao

DOI: https://doi.org/10.1016/j.media.2024.103372

Abstract:In endometrial cancer (EC) and colorectal cancer (CRC), in addition to microsatellite instability, tumor mutational burden (TMB) has gradually gained attention as a genomic biomarker that can be used clinically to determine which patients may benefit from immune checkpoint inhibitors. High TMB is characterized by a large number of mutated genes, which encode aberrant tumor neoantigens, and implies a better response to immunotherapy. Hence, a part of EC and CRC patients associated with high TMB may have higher chances to receive immunotherapy. TMB measurement was mainly evaluated by whole-exome sequencing or next-generation sequencing, which was costly and difficult to be widely applied in all clinical cases. Therefore, an effective, efficient, low-cost and easily accessible tool is urgently needed to distinguish the TMB status of EC and CRC patients. In this study, we present a deep learning framework, namely Ensemble Transformer-based Multiple Instance Learning with Self-Supervised Learning Vision Transformer feature encoder (ETMIL-SSLViT), to predict pathological subtype and TMB status directly from the H&E stained whole slide images (WSIs) in EC and CRC patients, which is helpful for both pathological classification and cancer treatment planning. Our framework was evaluated on two different cancer cohorts, including an EC cohort with 918 histopathology WSIs from 529 patients and a CRC cohort with 1495 WSIs from 594 patients from The Cancer Genome Atlas. The experimental results show that the proposed methods achieved excellent performance and outperforming seven state-of-the-art (SOTA) methods in cancer subtype classification and TMB prediction on both cancer datasets. Fisher's exact test further validated that the associations between the predictions of the proposed models and the actual cancer subtype or TMB status are both extremely strong (p<0.001). These promising findings show the potential of our proposed methods to guide personalized treatment decisions by accurately predicting the EC and CRC subtype and the TMB status for effective immunotherapy planning for EC and CRC patients.
Abstract 6191: Simultaneous prediction of tumor microenvironment biomarkers from pathology slides using multi-task deep regression

Omar S. El Nahhas,Marta Ligero,Jakob N. Kather

DOI: https://doi.org/10.1158/1538-7445.am2024-6191

IF: 11.2

2024-03-22

Cancer Research

Abstract:Abstract Understanding the Tumor Microenvironment (TME) is crucial for tailoring personalized cancer treatments and improving patient outcomes. Using deep learning, we can predict properties of the TME from standard Hematoxylin and Eosin (H&E) stained slides, including specific gene expression signatures. While past models were limited to single signature predictions, we explore the potential of multi-task deep learning to identify multiple biomarkers at once, allowing more complex relationships and interactions to be modeled simultaneously. Our study focuses on the prediction of expression patterns of tumor, stromal, and immune cells in breast cancer (BC). We developed a multi-task transformer-based deep regression model, trained in a weakly-supervised setting, to predict biomarkers in the TME from routine H&E-stained pathology slides of a BC cohort (n=876). The performance was evaluated using Pearson’s correlation coefficient (r) and spatial heatmaps generated via gradient-weighted class activation mapping. Our model achieved a significant correlation coefficient above 0.40 (p<0.0001) for all predicted TME biomarkers in the holdout test set (n=176). This includes the biomarkers lymphocyte infiltrating signature score (r=0.46, p<0.0001), tumor infiltrating lymphocyte regional fraction (r=0.48, p<0.0001), leukocyte fraction (r=0.43, p<0.0001), stromal fraction (r=0.42, p<0.0001), and tumor cell proliferation (r=0.47, p<0.0001). Notably, the model's heatmaps highlighted the pertinent cells and histological characteristics for its predictions. These data show that our deep learning model accurately predicts multiple TME biomarkers concurrently from routine pathology slides. This approach offers a promising avenue for cost-effective and efficient biomarker quantification in the TME, with potential applicability across various cancer types. Citation Format: Omar S. El Nahhas, Marta Ligero, Jakob N. Kather. Simultaneous prediction of tumor microenvironment biomarkers from pathology slides using multi-task deep regression [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 6191.

oncology
Predicting cancer outcomes from whole slide images via hybrid supervision learning

Xianying He,Jiahui Li,Fang Yan,Linlin Wang,Wen Chen,Xiaodi Huang,Zhiqiang Hu,Qi Duan,Hongsheng Li,Shaoting Zhang,Jie Zhao

DOI: https://doi.org/10.1016/j.neucom.2023.126736

IF: 6

2023-08-26

Neurocomputing

Abstract:Collaboratively leveraging limited pixel-level segmentation annotations and large-scale slide-level classification labels in hybrid supervision learning can significantly enhance model performance. However, the direct application of this approach within computational pathology presents challenges as end-to-end classification models grapple with processing high-resolution whole slide images (WSIs). An alternative approach is to use patch-based models with pixel-level pseudo-labels, but these models can be susceptible to the cumulative effects of noisy labels, leading to convergence and drift problems during iterative training. To surmount these hurdles, we propose a hybrid supervision learning framework tailored for pathological image classification. Our method employs coarse classification labels to optimize pixel-level pseudo-labels and incorporates a comprehensive strategy to diminish false negatives and positives throughout the segmentation process. This framework holistically integrates the supervised information derived from segmentation and classification procedures, and is applicable to the general classification of high-resolution images, thereby boosting both specificity and sensitivity. We assess our proposed method's effectiveness using one publicly accessible dataset and two proprietary datasets, collectively constituting over 10,000 pathological images of various disease types such as gastric, cervical, and breast cancer. Our experimental results reveal a 100% sensitivity rate in slide-level classification tasks, simultaneously reducing the false-positive rate to a mere third of the state-of-the-art. In conclusion, this paper presents a potent instrument for the precise and efficient classification of high-resolution pathological images, with promising results showcased across a wide array of datasets and disease types. Code is available at https://github.com/JarveeLee/HybridSupervisionLearning_Pathology .

computer science, artificial intelligence
Complementation and recombination with temperature-sensitive mutants of adenovirus type 5.

J. Williams,Ş. Ustaçelebi

DOI: https://doi.org/10.1099/0022-1317-13-2-345

1971-11-01

Journal of General Virology

Abstract:Recently, we described the isolation of temperature-sensitive (ts) mutants of adenovirus type 5, and presented evidence that some of these mutants complemented each other (Williams et al. 1971). In this communication we present additional data concerning complementation, as well as evidence of recombination between ts mutants of adenovirus type 5. The mutants have been previously described (Williams et al. 1971), as have methods for growth and assay of virus stocks (Williams, 1970). Complementation tests were carried out as follows. Cells were either doubly infected with mutants each at input m.o.i. of 5 (a combined multiplicity of 10), or singly infected at an m.o.i. of 10. Virus was adsorbed for 1 hr at 38°, after which time the monolayers were washed with Eagle's medium, and treated with 1 ml. of a 1/200 dilution of antiserum to adenovirus type 5 (neutralizing titre 1/10,000) for 15 min.
Spatial Attention-Based Deep Learning System for Breast Cancer Pathological Complete Response Prediction with Serial Histopathology Images in Multiple Stains

Hongyi Duanmu,Shristi Bhattarai,Hongxiao Li,Chia Cheng Cheng,Fusheng Wang,George Teodoro,Emiel A. M. Janssen,Keerthi Gogineni,Preeti Subhedar,Ritu Aneja,Jun Kong

DOI: https://doi.org/10.1007/978-3-030-87237-3_53

2021-01-01

Abstract:In triple negative breast cancer (TNBC) treatment, early prediction of pathological complete response (PCR) from chemotherapy before surgical operations is crucial for optimal treatment planning. We propose a novel deep learning-based system to predict PCR to neoadjuvant chemotherapy for TNBC patients with multi-stained histopathology images of serial tissue sections. By first performing tumor cell detection and recognition in a cell detection module, we produce a set of feature maps that capture cell type, shape, and location information. Next, a newly designed spatial attention module integrates such feature maps with original pathology images in multiple stains for enhanced PCR prediction in a dedicated prediction module. We compare it with baseline models that either use a single-stained slide or have no spatial attention module in place. Our proposed system yields 78.3% and 87.5% of accuracy for patch-, and patient-level PCR prediction, respectively, outperforming all other baseline models. Additionally, the heatmaps generated from the spatial attention module can help pathologists in targeting tissue regions important for disease assessment. Our system presents high efficiency and effectiveness and improves interpretability, making it highly promising for immediate clinical and translational impact.
A foundation model for generalizable cancer diagnosis and survival prediction from histopathological images

Zhangsheng Yu,Zhaochang Yang,Ting Wei,Ying Liang,Xin Yuan,Ruitian Gao,Yujia Xia,Jie Zhou,Yue Zhang

DOI: https://doi.org/10.1101/2024.05.16.594499

2024-07-19

Abstract:Computational pathology, utilizing whole slide image (WSI) for pathological diagnosis, has advanced the development of intelligent healthcare. However, the scarcity of annotated data and histological differences hinder the general application of existing methods. Extensive histopathological data and the robustness of self-supervised models in small-scale data demonstrate promising prospects for developing foundation pathology models. In this work, we propose the BEPH (BEiT-based model Pre-training on Histopathological image), a general method that leverages self-supervised learning to learn meaningful representations from 11 million unlabeled histopathological images. These representations are then efficiently adapted to various tasks, including patch-level cancer recognition, WSI-level cancer classification, and survival prediction for multiple cancer subtypes. Experimental results demonstrate that our model consistently outperformsseveral comparative models, even with limited training data reduced to 50%. Especially when the downstream structure is the same, the model can improve ResNet and DINO by up to a maximum increase of 8.8% and 7.2% (WSI level classification), and 6.44% and 3.28% on average (survival prediction), respectively. Therefore, BEPH offers a universal solution to enhance model performance, reduce the burden of expert annotations, and enable widespread clinical applications of artificial intelligence. The code and models can be obtained at https://github.com/Zhcyoung/BEPH. And currently, online fine-tuning of WSI classification tasks is available for use on http://yulab-sjtu.natapp1.cc/BEPH.

Pathology
Transcriptional regulation of neuronal differentiation in the developing CNS

Vilma Rraklli

2017-02-02

Abstract:The central nervous system (CNS) is responsible for our intellectual and cognitive functions and it comprises the brain and spinal cord. Generation of the CNS occurs during embryonic development from the neural tube that initially consist of a pool of immature progenitors that will give rise to all the neurons in the brain and spinal cord. CNS development is a highly coordinated process and any defect has a high risk of generating malformations and/or sensory, motor and cognitive impairments. ! The large number and variety of neurons that form the CNS mirrors the complexity and multitude of functions of the system itself. Despite that they are all generated from the same pool of immature progenitors, neurons greatly differ from each other in morphology, function and in gene expression. During development, generation of newborn neurons requires immature progenitor cells to undergo sequential fate restriction from a pluripotent stem cell to neural progenitor and finally to a differentiated neuron. The journey from a progenitor cell to a mature neuron with specific functions occurs in different developmental stages that involve interpretation of environmental cues, cell cycle exit, downregulation of progenitor markers, migration, expression of neuronal genes and repression of genes of other lineages. During these processes, the morphological metamorphosis of a cell is matched by changes in gene expression. Consequently, neuronal differentiation of a cell leads to a final epigenetic and transcriptional landscape quite distinct from the one of the cell of origin. ! During neuronal differentiation transcriptional regulation plays fundamental role in each step of the process from neural fate determination to neuronal specification. At a molecular level, neuronal differentiation is coordinated by transcription factors involved in all steps, such as cell cycle exit, loss of progenitor properties, restriction of other lineages, migration and acquisition of neuronal features. Despite the progress made in the field, a lot remains to be clarified about regulation of gene expression and regulation of transcriptional activity. The papers presented in this thesis aim to shed some light regarding the role of specific transcriptional factors at different stages of neuronal differentiation. ! Paper I investigates the role of chromatin remodeler CHD5 during neurogenesis, focusing on two specific aspects of terminal neuronal differentiation: induction of neuronal features and repression of other lineages determinants. Our data, in vitro and in vivo, suggest that CHD5 has a dual role during neuronal differentiation: it facilitates the activation of neuronal genes and it synergizes with Polycomb group proteins to facilitate repression of alternative lineages determinant. ! Paper II focuses on the role of ZAC1 transcription factor during neurogenesis and the importance of controlling its expression levels. Our data shows that elevated levels of ZAC1 transcription factor promote cell cycle exit, block neuronal specification and induce non-neuronal lineage determinants. ! Paper III investigates how changes in the surrounding environment, such as heat shock induced stress, affect transcriptional regulation, through the NOTCH pathway. Our in vitro and in vivo data show that stress induces sumoylation of NOTCH and its accumulation in the nucleus which results in repression of Notch target gene (Hes1, Hes5). !
Pan-cancer computational histopathology reveals mutations, tumor composition and prognosis

Yu Fu,Alexander W. Jung,Ramon Viñas Torne,Santiago Gonzalez,Harald Vöhringer,Artem Shmatko,Lucy R. Yates,Mercedes Jimenez-Linan,Luiza Moore,Moritz Gerstung

DOI: https://doi.org/10.1038/s43018-020-0085-8

IF: 22.7

2020-07-27

Nature Cancer

Abstract:We use deep transfer learning to quantify histopathological patterns across 17,355 hematoxylin and eosin-stained histopathology slide images from 28 cancer types and correlate these with matched genomic, transcriptomic and survival data. This approach accurately classifies cancer types and provides spatially resolved tumor and normal tissue distinction. Automatically learned computational histopathological features correlate with a large range of recurrent genetic aberrations across cancer types. This includes whole-genome duplications, which display universal features across cancer types, individual chromosomal aneuploidies, focal amplifications and deletions, as well as driver gene mutations. There are widespread associations between bulk gene expression levels and histopathology, which reflect tumor composition and enable the localization of transcriptomically defined tumor-infiltrating lymphocytes. Computational histopathology augments prognosis based on histopathological subtyping and grading, and highlights prognostically relevant areas such as necrosis or lymphocytic aggregates. These findings show the remarkable potential of computer vision in characterizing the molecular basis of tumor histopathology.

Mixed-function oxygenase enzymes as tools for pollution monitoring: field studies on the French coast of the Mediterranean Sea.

Contrastive learning-based histopathological features infer molecular subtypes and clinical outcomes of breast cancer from unannotated whole slide images

Deep learning infers clinically relevant protein levels and drug response in breast cancer from unannotated pathology images

Contrastive learning-based computational histopathology predict differential expression of cancer driver genes

Spatial transcriptomics inferred from pathology whole-slide images links tumor heterogeneity to survival in breast and lung cancer

Predicting the Tumor Microenvironment Composition and Immunotherapy Response in Non-Small Cell Lung Cancer from Digital Histopathology Images

Synthesis of isoleucine-5-tyrosine-8-angiotensin II and isoleucine-5-hydroxyproline-7-angiotensin II.

Prediction of HER2-positive breast cancer recurrence and metastasis risk from histopathological images and clinical information via multimodal deep learning

MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Features

Prediction of Tumor Mutation Load in Colorectal Cancer Histopathological Images Based on Deep Learning

Computational Staining of Pathology Images to Study the Tumor Microenvironment in Lung Cancer

Development of Prognostic Biomarkers by TMB-Guided WSI Analysis: A Two-Step Approach

Ensemble transformer-based multiple instance learning to predict pathological subtypes and tumor mutational burden from histopathological whole slide images of endometrial and colorectal cancer

Abstract 6191: Simultaneous prediction of tumor microenvironment biomarkers from pathology slides using multi-task deep regression

Predicting cancer outcomes from whole slide images via hybrid supervision learning

Complementation and recombination with temperature-sensitive mutants of adenovirus type 5.

Spatial Attention-Based Deep Learning System for Breast Cancer Pathological Complete Response Prediction with Serial Histopathology Images in Multiple Stains

A foundation model for generalizable cancer diagnosis and survival prediction from histopathological images

Transcriptional regulation of neuronal differentiation in the developing CNS

Pan-cancer computational histopathology reveals mutations, tumor composition and prognosis