Abstract:Due to the cross-domain distribution shift aroused from diverse medical imaging systems, many deep learning segmentation methods fail to perform well on unseen data, which limits their real-world applicability. Recent works have shown the benefits of extracting domain-invariant representations on domain generalization. However, the interpretability of domain-invariant features remains a great challenge. To address this problem, we propose an interpretable Bayesian framework (BayeSeg) through Bayesian modeling of image and label statistics to enhance model generalizability for medical image segmentation. Specifically, we first decompose an image into a spatial-correlated variable and a spatial-variant variable, assigning hierarchical Bayesian priors to explicitly force them to model the domain-stable shape and domain-specific appearance information respectively. Then, we model the segmentation as a locally smooth variable only related to the shape. Finally, we develop a variational Bayesian framework to infer the posterior distributions of these explainable variables. The framework is implemented with neural networks, and thus is referred to as deep Bayesian segmentation. Quantitative and qualitative experimental results on prostate segmentation and cardiac segmentation tasks have shown the effectiveness of our proposed method. Moreover, we investigated the interpretability of BayeSeg by explaining the posteriors and analyzed certain factors that affect the generalization ability through further ablation studies. Our code will be released via <a class="link-external link-https" href="https://zmiclab.github.io/projects.html" rel="external noopener nofollow">this https URL</a>, once the manuscript is accepted for publication.

InDeed: Interpretable image deep decomposition with guaranteed generalizability

Revisiting Deep Intrinsic Image Decompositions.

Revisiting Deep Image Smoothing and Intrinsic Image Decomposition.

Depth-wise Decomposition for Accelerating Separable Convolutions in Efficient Convolutional Neural Networks

LLM-based Hierarchical Concept Decomposition for Interpretable Fine-Grained Image Classification

Deep Intrinsic Image Decomposition Using Joint Parallel Learning.

Unrolled Optimization with Deep Priors for Intrinsic Image Decomposition

Discovering interpretable models of scientific image data with deep learning

Representation Decomposition for Image Manipulation and Beyond

Towards Interpretable Face Recognition

Deeper Interpretability of Deep Networks

Interpretable Neural Network Decoupling.

Interpretable deep learning: interpretation, interpretability, trustworthiness, and beyond

Interpretable deep learning for deconvolutional analysis of neural signals

This Looks Like That: Deep Learning for Interpretable Image Recognition

Sparsing Deep Neural Network Using Semi-Discrete Matrix Decomposition

CHIP: Channel-wise Disentangled Interpretation of Deep Convolutional Neural Networks

Decompose the model: Mechanistic interpretability in image models with Generalized Integrated Gradients (GIG)

Deep Decomposition Network for Image Processing: A Case Study for Visible and Infrared Image Fusion

BayeSeg: Bayesian Modeling for Medical Image Segmentation with Interpretable Generalizability

Bi-ICE: An Inner Interpretable Framework for Image Classification via Bi-directional Interactions between Concept and Input Embeddings