Abstract:Magnetic Resonance Imaging (MRI) is considered the gold standard of medical imaging because of the excellent soft-tissue contrast exhibited in the images reconstructed by the MRI pipeline, which in-turn enables the human radiologist to discern many pathologies easily. More recently, Deep Learning (DL) models have also achieved state-of-the-art performance in diagnosing multiple diseases using these reconstructed images as input. However, the image reconstruction process within the MRI pipeline, which requires the use of complex hardware and adjustment of a large number of scanner parameters, is highly susceptible to noise of various forms, resulting in arbitrary artifacts within the images. Furthermore, the noise distribution is not stationary and varies within a machine, across machines, and patients, leading to varying artifacts within the images. Unfortunately, DL models are quite sensitive to these varying artifacts as it leads to changes in the input data distribution between the training and testing phases. The lack of robustness of these models against varying artifacts impedes their use in medical applications where safety is critical. In this work, we focus on improving the generalization performance of these models in the presence of multiple varying artifacts that manifest due to the complexity of the MR data acquisition. In our experiments, we observe that Batch Normalization, a widely used technique during the training of DL models for medical image analysis, is a significant cause of performance degradation in these changing environments. As a solution, we propose to use other normalization techniques, such as Group Normalization and Layer Normalization (LN), to inject robustness into model performance against varying image artifacts. Through a systematic set of experiments, we show that GN and LN provide better accuracy for various MR artifacts and distribution shifts.

A Simple Normalization Technique Using Window Statistics to Improve the Out-of-distribution Generalization on Medical Images.

Mix-and-Interpolate: A Training Strategy to Deal with Source-Biased Medical Data

AC-Norm: Effective Tuning for Medical Image Analysis via Affine Collaborative Normalization

Window Normalization: Enhancing Point Cloud Understanding by Unifying Inconsistent Point Densities

Stochastic tissue window normalization of deep learning on computed tomography

Practical Window Setting Optimization for Medical Image Deep Learning

Affine Collaborative Normalization: A shortcut for adaptation in medical image analysis

Iterative Normalization: Beyond Standardization towards Efficient Whitening

Exploring Simple, High Quality Out-of-Distribution Detection with L2 Normalization

Deep Convolutional Neural Network Based Medical Concept Normalization

SS-Norm: Spectral-spatial Normalization for Single-Domain Generalization with Application to Retinal Vessel Segmentation.

NormAUG: Normalization-Guided Augmentation for Domain Generalization

Improving the generalization of glaucoma detection on fundus images via feature alignment between augmented views

Multi-Task Medical Concept Normalization Using Multi-View Convolutional Neural Network

On Sensitivity and Robustness of Normalization Schemes to Input Distribution Shifts in Automatic MR Image Diagnosis

Simple Data Augmentation Techniques for Chinese Disease Normalization

Normalization in Training Deep Convolutional Neural Networks for 2D Bio-medical Semantic Segmentation.

Out-of-distribution Detection in Medical Image Analysis: A survey

Stochastic Normalization.

StableNormal: Reducing Diffusion Variance for Stable and Sharp Normal