Multi-Mode Tensor Factorization for Image and Video Inpainting

Hongyan Li,Yongyong Chen,Yinping Zhao,Zhen Wang,Xuelong Li
DOI: https://doi.org/10.2139/ssrn.4377007
2023-01-01
Abstract:For the tensor completion problem, tensor nuclear norm (TNN) has become the popular technique for low-rank tensor approximation and been successfully applied to image and video inpainting tasks. However, there still exist two limitations: (1) TNN requires a massive amount of complex computation of tensor singular value decomposition in exchange for improved performance. (2) TNN is defined on the third mode of the third-order tensor only, unfortunately ignoring the benefits from the other two modes. To overcome the above issues, in this paper, we propose the multi-mode tensor factorization (MMTF) method for low-rank tensor completion with applications to image and video inpainting. Specifically, for a third-order tensor, MMTF takes the low-rankness of three modes into consideration by factorizing each mode into two lower-dimensional tensor multiplications.Furthermore, we only need to update two small-scale tensors alternately for each iteration, which avoids the computation of tensor singular value decomposition. An iterative algorithm with the convergence guarantee is proposed by the alternating direction multiplier method. Extensive experiments on synthetic and real datasets have demonstrated the superiority of our method by comparing with several state-of-the-art tensor completion methods.
What problem does this paper attempt to address?