Iterative Singular Tube Hard Thresholding Algorithms for Tensor Recovery

Rachel Grotheer,Shuang Li,Anna Ma,Deanna Needell,Jing Qin

2023-12-27

Abstract:Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be further used to define the best low-rank approximation of a tensor to significantly reduce the dimensionality for signal compression and recovery. In this paper, we consider the low-rank tensor recovery problem when the tubal rank of the underlying tensor is given or estimated a priori. We propose a novel class of iterative singular tube hard thresholding algorithms for tensor recovery based on the low-tubal-rank tensor approximation, including basic, accelerated deterministic and stochastic versions. Convergence guarantees are provided along with the special case when the measurements are linear. Numerical experiments on tensor compressive sensing and color image inpainting are conducted to demonstrate convergence and computational efficiency in practice.

Optimization and Control

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to effectively recover a low - rank tensor given or with a pre - estimated tubal rank of the underlying tensor. Specifically, the authors propose a class of Iterative Singular Tube Hard Thresholding (ISTHT) algorithms based on low - tubal - rank tensor approximation, including the basic version, the accelerated deterministic version, and the stochastic version. These problems are particularly important in high - dimensional data compression and recovery, such as tensor compressed sensing and color image inpainting.

The main contributions of the paper are as follows:

1. **Algorithm innovation**: A new ISTHT algorithm is proposed to achieve tensor recovery through alternating gradient descent and singular tube hard thresholding.
2. **Theoretical guarantee**: The convergence of the algorithm is guaranteed, and the special case when the measurement is linear is discussed.
3. **Application verification**: The effectiveness and computational efficiency of the algorithm in tensor compressed sensing and color image inpainting are verified through numerical experiments.

These methods are of great significance for processing large - scale multi - dimensional data sets, especially in fields such as video processing, signal processing, machine learning, and neuroscience.