Abstract:BACKGROUND AND OBJECTIVE:As an advanced technique, immunofluorescence (IF) is one of the most widely-used medical image for nephropathy diagnosis, due to its ease of acquisition with low cost. In practice, the clinically collected IF images are commonly corrupted by blurs at different degrees, mainly because of the inaccurate focus at the acquisition stage. Although deep neural network (DNN) methods achieve the great success in nephropathy diagnosis, their performance dramatically drops over the blurred IF images. This significantly limits the potential of leveraging the advanced DNN techniques in real-world nephropathy diagnosis scenarios.METHODS:This paper first establishes two IF databases with synthetic blurs (IFVB) and real-world blurs (Real-IF) for nephropathy diagnosis, respectively, including 1,659 patients and 6,521 IF images with various degrees of blurs. According to the analysis on these two databases, we propose a deep hierarchical multi-task learning based nephropathy diagnosis (DeepMT-ND) method to bridge the gap between the low-level vision and high-level medical tasks. Specifically, DeepMT-ND simultaneously handles the main task of automatic nephropathy diagnosis, as well as the auxiliary tasks of image quality assessment (IQA) and de-blurring.RESULTS:Extensive experiments show the superiority of our DeepMT-ND in terms of diagnosis accuracy and generalization ability. For instance, our method performs better than nephrologists with at least 15.4% and 6.5% accuracy improvements in IFVB and Real-IF, respectively. Meanwhile, our method also achieves comparable performance in two auxiliary tasks of IQA and de-blurring on blurred IF images.CONCLUSIONS:In this paper, we propose a new DeepMT-ND method for nephropathy diagnosis on blurred IF images. The proposed hierarchical multi-task learning framework provides the new scope to narrow the gap between the low-level vision and high-level medical tasks, and will contribute to nephropathy diagnosis in clinical scenarios. The diagnosis accuracy and generalization ability of DeepMT-ND are experimentally verified to be effective over both synthetic and real-world databases.

Blind deblurring for microscopic pathology images using deep learning networks

A New Deep Learning Method for Image Deblurring in Optical Microscopic Systems

Digital Pathology Image Deblurring Via Local Focus Quality Assessment

Deep Deblurring in Teledermatology: Deep Learning Models Restore the Accuracy of Blurry Images' Classification

Deep Learning-Based Single-Shot Autofocus Method for Digital Microscopy

Deep Learning for Cornea Microscopy Blind Deblurring

Endoscopic Image Deblurring and Super-Resolution Reconstruction Based on Deep Learning

Deep Blur Multi-Model (DeepBlurMM) -- a strategy to mitigate the impact of image blur on deep learning model performance in histopathology image analysis

Nonblind Image Deblurring Via Deep Learning in Complex Field

Deep Learning in Digital Pathology Analysis

Non-blind Image Deconvolution Using Deep Dual-Pathway Rectifier Neural Network

Image Deblurring With Image Blurring

Deep Multi-Task Learning for Nephropathy Diagnosis on Immunofluorescence Images.

Learning to Deblur using Light Field Generated and Real Defocus Images

Deblurring microscopic image by integrated convolutional neural network

Application of Deep Learning in Blind Motion Deblurring: Current Status and Future Prospects

Research Progress of Deep Learning in Bladder Cancer Pathology

Blind Deblurring for Dermoscopy Images with Spatially-Varying Defocus Blur

Deep Learning Based Cystoscopy Image Enhancement

A deep-learning pipeline for the diagnosis and grading of common blinding ophthalmic diseases based on lesion-focused classification model

Towards machine learned quality control: A benchmark for sharpness quantification in digital pathology