Abstract:Multi-dimensional image recovery from incomplete data is a fundamental problem in data processing. Due to its advantage of capturing the correlations between any modes of the multi-dimensional image, i.e., the target tensor, the fully-connected tensor network (FCTN) decomposition has recently shown promising performance on multi-dimensional image recovery. However, FCTN decomposition suffers from computational deficiency, especially for large-scale multi-dimensional images. To address this deficiency, we propose a learnable transform-based FCTN model (termed as T-FCTN), which enjoys the remarkable advantage of FCTN decomposition with cheap computational cost. More concretely, we learn the semi-orthogonal transforms along each mode of the target tensor to project the large-scale tensor $${\mathcal {X}}$$ $$\in $$ $${\mathbb {R}}^{I\times {I}\times {\cdots }\times {I}}$$ into a small-scale essential tensor $${\mathcal {E}}$$ $$\in $$ $${\mathbb {R}}^{r\times {r}\times {\cdots }\times {r}}$$ , and then apply FCTN decomposition on the small-scale essential tensor. To tackle the proposed model, we develop an efficient proximal alternating minimization (PAM)-based algorithm with theoretical convergence guarantee. Moreover, the computational complexity of PAM for T-FCTN is $${\mathcal {O}}{(N\sum _{k=2}^N{r^k}{R^{k(N-k)+k-1}}}+{N{r^{N-1}}R^{2(N-1)}+N{R}^{3(N-1)}+N{\sum _{k=1}^N{{r^k}{I}^{N-k+1}}})}$$ at each iteration, which is significantly lower than $${\mathcal {O}}{(N\sum _{k=2}^N{I^k}{R^{k(N-k)+k-1}}}+N{I^{N-1}}R^{2(N-1)}+{N{R}^{3(N-1)})}$$ of PAM for FCTN when $$r\ll I$$ . Extensive numerical experiments on color videos and light field images illustrate the superiority of the proposed method over other state-of-the-art methods in terms of quality metrics, visual quality, and running time.

Nonlocal Patch-Based Fully Connected Tensor Network Decomposition for Multispectral Image Inpainting

Non-Local Image Inpainting Using Low-Rank Matrix Completion: Non-Local Image Inpainting Using Low-Rank Matrix Completion

Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising

Nested Fully-Connected Tensor Network Decomposition for Multi-Dimensional Visual Data Recovery

Multi-Dimensional Image Recovery Via Fully-Connected Tensor Network Decomposition under the Learnable Transforms

Image inpainting by low-rank tensor decomposition and multidirectional search

Image Inpainting Algorithm Based on Tensor Decomposition and Weighted Nuclear Norm

Nonlocal Coupled Tensor CP Decomposition for Hyperspectral and Multispectral Image Fusion.

Interactive Separation Network for Image Inpainting

Multi-Dimensional Data Recovery Via Feature-Based Fully-Connected Tensor Network Decomposition

Non-local tensor completion for multitemporal remotely sensed images inpainting

Multiple Sclerosis Lesion Inpainting Using Non-Local Partial Convolutions

Image Inpainting Using Non-Convex Low Rank Decomposition and Multidirectional Search

Multispectral Images Denoising by Intrinsic Tensor Sparsity Regularization

CTNet: hybrid architecture based on CNN and transformer for image inpainting detection

Multispectral Image Denoising Via Nonlocal Multitask Sparse Learning.

High-Order Coupled Fully-Connected Tensor Network Decomposition for Hyperspectral Image Super-Resolution

Nonlocal Patch Tensor Sparse Representation for Hyperspectral Image Super-Resolution

Method of Multispectral Image Denoising Based on Whole and Sub-Sparsity.

Nonlocal Tensor Completion for Multitemporal Remotely Sensed Images’ Inpainting

Full-Mode-Augmentation Tensor-Train Rank Minimization for Hyperspectral Image Inpainting