Abstract:Abstract Background Interleukin23 (IL-23) is a cytokine that plays a crucial role in the pathogenesis of inflammatory bowel disease (IBD), making it a highly validated therapeutic target. Understanding the role of IL-23 in IBD at the histopathological level is crucial for determining effective treatment strategies, providing insights into IBD patients who fail to respond to targeted therapies, or predicting those who are likely to lose response. In this context, there is a surge in utilizing artificial intelligence (AI) for histopathological data in IBD and other disease indications. Here, we present an automated computer vision approach to predict IL-23 signalling activity directly from routinely stained Hematoxylin and Eosin (H&E) images Methods A total of 1502 samples with matched clinical data and H&E biopsy images were included from 991 Crohn’s disease (CD) and 511 ulcerative colitis (UC) samples. IL-23 signalling activity was calculated using gene set variation analysis on RNA-seq data collected from the same tissue biopsies. The data were obtained from the IBD Plexus program of the Crohn’s & Colitis Foundation. The proposed approach is based on vision transformers (ViTs) which is a type of deep learning model. ViTs divide the input image into fixed-size patches, transform it into linear embedding, and analyze it with the self-attention mechanism. This enables ViTs to incorporate relationships between different patches of the input image to identify regions predictive of IL-23. Our approach was trained in a weakly supervised manner to automatically identify tissue regions that correlate with IL-23 signaling activity. The model produces interpretable heatmaps to interrogate model predictions and allow clinicians to visualize and interpret the significance of different tissue regions predictive of IL-23 Results We performed 5-fold cross-validation on the splits obtained at the patient level, retaining the data distribution of IL-23 signaling activity, biopsy location, and diagnosis. We separately validated the performance of the proposed model on both disease categories, including CD and UC. The proposed approach achieved an area under the curve (AUC) of 0.82 ± 0.04 on unseen data from CD and an AUC of 0.80 ± 0.02 for UC. The 5-fold results for both disease categories are shown below Conclusion The presented results highlight the significance of computational pathology algorithms to identify IL-23 signalling activity from H&E images. Pathological interpretation from the heatmaps may help understand disease pathomechanism and optimize the treatment options for IBD patients by timely identification of IL-23 status. We are further validating the clinical utility of such heatmaps and expanding the use of H&E to predict other patient-centric endpoints

A machine learning approach toward automating spatial identification of LAG3+/CD3+ cells in ulcerative colitis

Automated spatial omics landscape analysis approach reveals novel tissue architectures in ulcerative colitis

Proof of Concept for a Deep Learning Algorithm for Identification and Quantification of Key Microscopic Features in the Murine Model of DSS-Induced Colitis

Deep learning-based approach to the characterization and quantification of histopathology in mouse models of colitis

Automated Neutrophil Quantification and Histological Score Estimation in Ulcerative Colitis

P777 Deployment of an artificial intelligence tool for precision medicine in ulcerative colitis: Preliminary data from 8 globally distributed clinical sites

P153 Artificial Intelligence to predict interleukin-23 signalling activity from H&E stained whole slide images of Inflammatory Bowel Disease

Using Deep Learning to Automate Eosinophil Counting in Pediatric Ulcerative Colitis Histopathological Images

Artificial Intelligence Analysis of Ulcerative Colitis Using an Autoimmune Discovery Transcriptomic Panel

Instance segmentation of immune cells in human lupus nephritis using deep learning: comparing performance on sample preparation and staining panels

P357 Automated assessment of histological disease activity in Ulcerative Colitis using a deep learning algorithm

Automated Analysis of Lymphocytic Infiltration, Tumor Budding, and Their Spatial Relationship Improves Prognostic Accuracy in Colorectal Cancer

Artificial Intelligence for Histology-Based Detection of Microsatellite Instability and Prediction of Response to Immunotherapy in Colorectal Cancer

Exploration and verification a 13-gene diagnostic framework for ulcerative colitis across multiple platforms via machine learning algorithms

Artificial intelligence and machine learning technologies in ulcerative colitis

A Machine Learning Algorithm Improves the Diagnostic Accuracy of the Histologic Component of Antibody Mediated Rejection (AMR-H) in Cardiac Transplant Endomyocardial Biopsies.

Artificial intelligence-based analysis of tumor-infiltrating lymphocyte spatial distribution for colorectal cancer prognosis

AI drives the assessment of lung cancer microenvironment composition

A Means of Assessing Deep Learning-Based Detection of ICOS Protein Expression in Colon Cancer

Abstract 7399: Development of a reproducible AI-based spatial biomarker of the tumor immune infiltrate on H&E slides

Identification of Colon Immune Cell Marker Genes Using Machine Learning Methods.