Abstract:Abstract BACKGROUND AND AIMS Nephropathology is essential for the diagnosis of kidney diseases. Deep learning-based image analyses, including segmentation of kidney histology, open new possibilities for reproducible quantitative precision pathology. Current segmentation approaches in kidney histology focused on specific use cases. Here, we developed a framework for automated segmentation and quantification of a wide spectrum of non-neoplastic kidney diseases. METHOD We trained U-Net Convolutional Neural Networks (CNNs) for two streamlined tasks: (i) detection of kidney tissue and (ii) instance segmentation of relevant histological structures, i.e. glomeruli, tubules and arteries. These were used to segment 1103 Whole-Slide-Images (WSIs) from four cohorts, including two external datasets for multi-center validation. In total, 35 features from 51 445 glomeruli, 4016 792 tubules and 362 471 arteries were extracted, generating 30 million morphometric data points. Morphometry data were associated with clinical and pathology data. RESULTS Kidney tissue was precisely outlined by the tissue segmentation CNN. The structure segmentation CNN for histology provided accurate results on WSI-level despite difficult histopathological morphologies such as crescents, segmental sclerosis, tubular casts or arteriosclerosis. Quantitative analyses of morphological alterations of glomeruli revealed, for example, an increased glomerular area in membranous glomerulonephritis and all cases characterized with nephrotic range proteinuria independent of the underlying disease, and decrease in glomerular tuft circularity in pauci-immune glomerulonephritis, especially in cases with severe loss of kidney function. Principal component analysis of multiple glomerular, tubular and interstitial features stratified based on estimated glomerular filtration rate identified CKD-relevant morphological alterations of glomeruli and the tubulointerstitium. Image extraction of morphometric outliers enabled fast-track visual assessment of severe lesions. CONCLUSION Segmentation and large-scale quantitative feature extraction enable reproducible quantitative analysis of kidney morphology, opening new possibilities for digital precision nephropathology.

Iterative annotation to ease neural network training: Specialized machine learning in medical image analysis

AI-human interactive pipeline with feedback to accelerate medical image annotation

Efficient human-in-loop deep learning model training with iterative refinement and statistical result validation

Catalyzing Clinical Diagnostic Pipelines Through Volumetric Medical Image Segmentation Using Deep Neural Networks: Past, Present, & Future

Visual Prompting Based Incremental Learning for Semantic Segmentation of Multiplex Immuno-Flourescence Microscopy Imagery

Mask-Free Neuron Concept Annotation for Interpreting Neural Networks in Medical Domain

Development and evaluation of intraoperative ultrasound segmentation with negative image frames and multiple observer labels

A user-friendly tool for cloud-based whole slide image segmentation, with examples from renal histopathology

DeepEdit: Deep Editable Learning for Interactive Segmentation of 3D Medical Images

Adaptive Multi-Region Network for Medical Image Analysis

Enhancing Medical Image Segmentation with Recurrent Neural Network Architectures

A survey on active learning and human-in-the-loop deep learning for medical image analysis

Fast interactive medical image segmentation with weakly supervised deep learning method

Democratizing Pathological Image Segmentation with Lay Annotators via Molecular-empowered Learning

Progressive Medical Image Annotation with Convolutional Neural Network-Based Interactive Segmentation Method

Interactive segmentation of medical images using deep learning

Annotation-efficient deep learning for automatic medical image segmentation

AnNoBrainer, an Automated Annotation of Mouse Brain Images using Deep Learning

MO062: Pan-Disease Segmentation and Feature Extraction for Large-Scale Digital Nephropathology

Interactive Surgical Training in Neuroendoscopy: Real-Time Anatomical Feature Localization Using Natural Language Expressions