Abstract:Tensor rank learning for canonical polyadic decomposition (CPD) has long been deemed as an essential yet challenging problem. In particular, since the tensor rank controls the complexity of the CPD model, its inaccurate learning would cause overfitting to noise or underfitting to the signal sources, and even destroy the interpretability of model parameters. However, the optimal determination of a tensor rank is known to be a non-deterministic polynomial-time hard (NP-hard) task. Rather than exhaustively searching for the best tensor rank via trial-and-error experiments, Bayesian inference under the Gaussian-gamma prior was introduced in the context of probabilistic CPD modeling, and it was shown to be an effective strategy for automatic tensor rank determination. This triggered flourishing research on other structured tensor CPDs with automatic tensor rank learning. On the other side of the coin, these research works also reveal that the Gaussian-gamma model does not perform well for high-rank tensors and/or low signal-to-noise ratios (SNRs). To overcome these drawbacks, in this paper, we introduce a more advanced generalized hyperbolic (GH) prior to the probabilistic CPD model, which not only includes the Gaussian-gamma model as a special case, but also is more flexible to adapt to different levels of sparsity. Based on this novel probabilistic model, an algorithm is developed under the framework of variational inference, where each update is obtained in a closed-form. Extensive numerical results, using synthetic data and real-world datasets, demonstrate the significantly improved performance of the proposed method in learning both low as well as high tensor ranks even for low SNR cases.

Tuning Free Rank-Sparse Bayesian Matrix and Tensor Completion with Global-Local Priors

Beyond Low Rank: A Data-Adaptive Tensor Completion Method

Bayesian Low-rank Matrix Completion with Dual-graph Embedding: Prior Analysis and Tuning-free Inference

Estimation of high-dimensional low-rank matrices

Bayesian Estimation and Tuning-Free Rank Detection for Probability Mass Function Tensors

Online high rank matrix completion

Bayesian Learning for Low-Rank matrix reconstruction

Bayesian matrix completion: prior specification

Fast Low-Rank Bayesian Matrix Completion with Hierarchical Gaussian Prior Models

Low rank tensor completion with sparse regularization in a transformed domain

Low-rank Bayesian matrix completion via geodesic Hamiltonian Monte Carlo on Stiefel manifolds

Towards Flexible Sparsity-Aware Modeling: Automatic Tensor Rank Learning Using The Generalized Hyperbolic Prior

Accurate Tensor Completion via Adaptive Low-Rank Representation

Adaptive Rank-One Matrix Completion using Sum of Outer Products

Bayesian Matrix Completion Via Adaptive Relaxed Spectral Regularization

Automatic Hyperparameter Tuning in Sparse Matrix Factorization

Rank-one matrix estimation: analysis of algorithmic and information theoretic limits by the spatial coupling method

Can Learning Be Explained By Local Optimality In Low-rank Matrix Recovery?

Bayesian Sparse Tucker Models for Dimension Reduction and Tensor Completion

Tensor Completion via Complementary Global, Local, and Nonlocal Priors

General-Purpose Bayesian Tensor Learning With Automatic Rank Determination and Uncertainty Quantification