Abstract:CANDECOMP/PARAFAC (CP) tensor factorization of incomplete data is a powerful technique for tensor completion through explicitly capturing the multilinear latent factors. The existing CP algorithms require the tensor rank to be manually specified, however, the determination of tensor rank remains a challenging problem especially for CP rank. In addition, existing approaches do not take into account uncertainty information of latent factors, as well as missing entries. To address these issues, we formulate CP factorization using a hierarchical probabilistic model and employ a fully Bayesian treatment by incorporating a sparsity-inducing prior over multiple latent factors and the appropriate hyperpriors over all hyperparameters, resulting in automatic rank determination. To learn the model, we develop an efficient deterministic Bayesian inference algorithm, which scales linearly with data size. Our method is characterized as a tuning parameter-free approach, which can effectively infer underlying multilinear factors with a low-rank constraint, while also providing predictive distributions over missing entries. Extensive simulations on synthetic data illustrate the intrinsic capability of our method to recover the ground-truth of CP rank and prevent the overfitting problem, even when a large amount of entries are missing. Moreover, the results from real-world applications, including image inpainting and facial image synthesis, demonstrate that our method outperforms state-of-the-art approaches for both tensor factorization and tensor completion in terms of predictive performance.

A block-randomized stochastic method with importance sampling for CP tensor decomposition

A momentum block-randomized stochastic algorithm for low-rank tensor cp decomposition

Randomized Online CP Decomposition

Inertial Accelerated SGD Algorithms for Solving Large-Scale Lower-Rank Tensor CP Decomposition Problems

SPALS: Fast Alternating Least Squares via Implicit Leverage Scores Sampling

Accelerated Doubly Stochastic Gradient Descent for Tensor CP Decomposition.

Distributed-Memory Randomized Algorithms for Sparse Tensor CP Decomposition

Sparse Nonnegative CANDECOMP/PARAFAC Decomposition in Block Coordinate Descent Framework: A Comparison Study

A Randomized Block Krylov Method for Tensor Train Approximation

A random sampling algorithm for fully-connected tensor network decomposition with applications

Efficient Nonnegative Tensor Decomposition Using Alternating Direction Proximal Method of Multipliers

EA-ADMM: Noisy Tensor PARAFAC Decomposition Based on Element-Wise Average ADMM

Randomized Sampling Techniques Based Low-Tubal-rank Plus Sparse Tensor Recovery.

Tensor Decompositions for Count Data that Leverage Stochastic and Deterministic Optimization

A Coupled Random Projection Approach to Large-Scale Canonical Polyadic Decomposition

Fast Learnings of Coupled Nonnegative Tensor Decomposition Using Optimal Gradient and Low-rank Approximation

Tensor Deli: Tensor Completion for Low CP-Rank Tensors via Random Sampling

Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination

Faster TKD: Towards Lightweight Decomposition for Large-Scale Tensors with Randomized Block Sampling

Practical sketching‐based randomized tensor ring decomposition