Yanqi Cheng,Lipei Zhang,Zhenda Shen,Shujun Wang,Lequan Yu,Raymond H. Chan,Carola-Bibiane Schönlieb,Angelica I Aviles-Rivero
Abstract:The utilisation of Plug-and-Play (PnP) priors in inverse problems has become increasingly prominent in recent years. This preference is based on the mathematical equivalence between the general proximal operator and the regularised denoiser, facilitating the adaptation of various off-the-shelf denoiser priors to a wide range of inverse problems. However, existing PnP models predominantly rely on pre-trained denoisers using large datasets. In this work, we introduce Single-Shot PnP methods (SS-PnP), shifting the focus to solving inverse problems with minimal data. First, we integrate Single-Shot proximal denoisers into iterative methods, enabling training with single instances. Second, we propose implicit neural priors based on a novel function that preserves relevant frequencies to capture fine details while avoiding the issue of vanishing gradients. We demonstrate, through extensive numerical and visual experiments, that our method leads to better approximations.
What problem does this paper attempt to address?
### Problems the paper attempts to solve
This paper aims to solve the problem of relying on a large amount of training data when using the Plug - and - Play (PnP) method in inverse problems. Specifically, existing PnP methods usually require pre - trained denoisers, which rely on large - scale data sets. However, in practical applications, especially when data is limited or lacks diversity, this dependence becomes a significant bottleneck.
To solve this problem, the paper introduces the Single - Shot Plug - and - Play (SS - PnP) method, which can solve inverse problems with only a single instance or a small number of instances. The main contributions of the paper include:
1. **Single - shot proximal denoiser**:
- Integrate the single - shot proximal denoiser into the iterative method, enabling training with only a single instance.
- This method eliminates the need for pre - trained models, thus being suitable for data - limited situations.
2. **Implicit neural prior**:
- Introduce an implicit neural prior based on a new function that can preserve relevant frequencies, capture fine details, and avoid the vanishing gradient problem.
- Provide theoretical proof, emphasizing the crucial role of its continuity and differentiability in alleviating the vanishing gradient problem during training and preserving detail points.
3. **Experimental verification**:
- Through extensive numerical and visual experiments, demonstrate the superior performance of this method in various inverse problems, including super - resolution, image deconvolution, and joint demosaicing and deconvolution tasks.
- Experimental results show that this method performs better in capturing detail points, smoothing edge features, and better color representation.
### Mathematical formulas
- **Forward model of inverse problems**:
\[
y = A(x)+\epsilon
\]
where \(y\in\mathbb{R}^M\) is the known observation, \(x\in\mathbb{R}^N\) is the unknown target, \(\epsilon\in\mathbb{R}^M\) is the measurement noise, and \(A:\mathbb{R}^N\rightarrow\mathbb{R}^M\) is the forward measurement operator.
- **Regularized minimization problem**:
\[
\min_{x\in\mathbb{R}^N}D(x)+\gamma R(x)
\]
where \(D(x)\) is the data fidelity term, usually in the form of \(D(x)=\frac{1}{2}\|A(x) - y\|^2\), \(R(x)\) is the regularization term, encoding prior knowledge about \(x\), and \(\gamma\) is the regularization weight.
- **Proximal operator**:
\[
\text{Prox}_{\delta F}(v)=\arg\min_{u}\left\{\frac{1}{2}\|u - v\|^2+\alpha F(u)\right\}
\]
- **PnP - ADMM algorithm**:
\[
e_{k + 1}=\text{Prox}_{\sigma_k^2R}(z_k - x_k)=H_{\sigma_k}(z_k - x_k)
\]
\[
z_{k + 1}=\text{Prox}_{\frac{1}{\mu_k}D}(e_{k + 1}+x_k)
\]
\[
x_{k + 1}=x_k+e_{k + 1}-z_{k + 1}
\]
- **Single - shot denoiser training**:
\[
\hat{\theta}=\arg\min_{\theta}L(f_{\theta},y+\epsilon)
\]
- **Implicit neural representation activation function**:
\[
\Phi(x)=\exp\{-(a_1x)