Abstract:Trained generative models have shown remarkable performance as priors for inverse problems in imaging -- for example, Generative Adversarial Network priors permit recovery of test images from 5-10x fewer measurements than sparsity priors. Unfortunately, these models may be unable to represent any particular image because of architectural choices, mode collapse, and bias in the training dataset. In this paper, we demonstrate that invertible neural networks, which have zero representation error by design, can be effective natural signal priors at inverse problems such as denoising, compressive sensing, and inpainting. Given a trained generative model, we study the empirical risk formulation of the desired inverse problem under a regularization that promotes high likelihood images, either directly by penalization or algorithmically by initialization. For compressive sensing, invertible priors can yield higher accuracy than sparsity priors across almost all undersampling ratios, and due to their lack of representation error, invertible priors can yield better reconstructions than GAN priors for images that have rare features of variation within the biased training set, including out-of-distribution natural images. We additionally compare performance for compressive sensing to unlearned methods, such as the deep decoder, and we establish theoretical bounds on expected recovery error in the case of a linear invertible model.

Regularising Inverse Problems with Generative Machine Learning Models

MBD-GAN: Model-based Image Deblurring with a Generative Adversarial Network.

Neural-network-based regularization methods for inverse problems in imaging

Invertible generative models for inverse problems: mitigating representation error and dataset bias

Bayesian Inference and Deep Learning for Inverse Problems

Linear Inverse Problems Using a Generative Compound Gaussian Prior

Learned convex regularizers for inverse problems

Guided Deep Generative Model-based Spatial Regularization for Multiband Imaging Inverse Problems

Differentiable Gaussianization Layers for Inverse Problems Regularized by Deep Generative Models

A Neural-Network-Based Convex Regularizer for Inverse Problems

How Good Are Deep Generative Models for Solving Inverse Problems?

Big in Japan: Regularizing networks for solving inverse problems

Regularization of Inverse Problems by Neural Networks

Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overview

Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisation

Compressed Sensing MRI Reconstruction Regularized by VAEs with Structured Image Covariance

Deep Regularized Compound Gaussian Network for Solving Linear Inverse Problems

DRIP: Deep Regularizers for Inverse Problems

Inverse problem regularization with hierarchical variational autoencoders

Convergence Properties of Score-Based Models for Linear Inverse Problems Using Graduated Optimisation