Abstract:We consider denoising and deblurring problems for tensors. While images can be discretized as matrices, the analogous procedure for color images or videos leads to a tensor formulation. We extend the classical ROF functional for variational denoising and deblurring to the tensor case by employing multi-dimensional total variation regularization. Furthermore, the resulting minimization problem is calculated by the FISTA method generalized to the tensor case. We provide some numerical experiments by applying the scheme to the denoising, the deblurring, and the recoloring of color images as well as to the deblurring of videos.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the denoising and deblurring of tensors (such as color images or videos). Specifically, the authors extended the classical ROF (Rudin - Osher - Fatemi) model, applied it to tensor data, and used multi - dimensional total variation regularization to deal with these problems.
### Detailed Explanation
1. **Background and Motivation**:
- Digital image restoration is an important task and has wide applications in medical imaging, astronomical imaging, movie restoration, and image and video coding.
- Most of the existing methods are based on matrix representation, while color images or videos require tensor representation. Therefore, it is necessary to extend the classical methods to tensor form.
2. **Specific Problems**:
- **Denoising**: Recover the original signal or image from noise.
- **Deblurring**: Recover the original clear image or video from a blurry observation.
3. **Methods**:
- **ROF Model Extension**: The classical ROF model is used for denoising two - dimensional images and is achieved by minimizing the following optimization problem:
\[
\min_{u \in BV(\Omega)} \|\nabla u\|_{TV(\Omega)}+\frac{\lambda}{2}\|f - u\|^2_{L^2}
\]
where \(BV(\Omega)\) is the set of bounded variation functions defined on the domain \(\Omega\), \(\|\nabla u\|_{TV(\Omega)}\) is the total variation, and \(\lambda\) is a penalty parameter.
- **Tensor Extension**: Extend the above model to tensor form, considering higher - dimensional data (such as color images or videos). For a third - order tensor \(T\in\mathbb{R}^{m\times n\times o}\), the optimization problem becomes:
\[
\min_{T\in C}\|T - S\|^2_F + 2\lambda TV(T)
\]
where \(S\) is the observed data, \(C\) is a closed convex set, \(\|\cdot\|_F\) is the Frobenius norm, and \(TV(T)\) is the discrete total variation seminorm, which can be isotropic or anisotropic.
4. **Algorithm**:
- Use FISTA (Fast Iterative Shrinkage - Thresholding Algorithm) to solve the above optimization problem. FISTA combines the gradient projection method and can effectively handle non - smooth terms (such as the total variation regularization term).
5. **Numerical Experiments**:
- The paper provides the denoising and deblurring experimental results of color images and videos, demonstrating the effectiveness of the proposed method.
### Summary
The main goal of this paper is to extend the classical ROF model to tensor form to solve the denoising and deblurring problems of color images and videos. By introducing multi - dimensional total variation regularization and using the FISTA algorithm, the authors proposed an effective solution and verified its effectiveness through numerical experiments.