Abstract:Tensor decomposition methods are popular tools for analysis of multi-way datasets from social media, healthcare, spatio-temporal domains, and others. Widely adopted models such as Tucker and canonical polyadic decomposition (CPD) follow a data-driven philosophy: they decompose a tensor into factors that approximate the observed data well. In some cases side information is available about the tensor modes. For example, in a temporal user-item purchases tensor a user influence graph, an item similarity graph, and knowledge about seasonality or trends in the temporal mode may be available. Such side information may enable more succinct and interpretable tensor decomposition models and improved quality in downstream tasks. We propose a framework for Multi-Dictionary Tensor Decomposition (MDTD) which takes advantage of prior structural information about tensor modes in the form of coding dictionaries to obtain sparsely encoded tensor factors. We derive a general optimization algorithm for MDTD that handles both complete input and input with missing values. Our framework handles large sparse tensors typical to many real-world application domains. We demonstrate MDTD's utility via experiments with both synthetic and real-world datasets. It learns more concise models than dictionary-free counterparts and improves (i) reconstruction quality ($60\%$ fewer non-zero coefficients coupled with smaller error); (ii) missing values imputation quality (two-fold MSE reduction with up to orders of magnitude time savings) and (iii) the estimation of the tensor rank. MDTD's quality improvements do not come with a running time premium: it can decompose $19GB$ datasets in less than a minute. It can also impute missing values in sparse billion-entry tensors more accurately and scalably than state-of-the-art competitors.

K-CPD: Learning of Overcomplete Dictionaries for Tensor Sparse Coding.

Gradient-based Dictionary Optimization for Compressive Spectral Imaging

Denoising and Completion of 3D Data via Multidimensional Dictionary Learning

Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis

Correlation Preserving Sparse Coding over Multi-level Dictionaries for Image Denoising.

Online Convolutional Sparse Coding with Sample-Dependent Dictionary

Laplacian Sparse Coding Dictionary for Image Set Based Collaborative Representation

Kernel Regularized Nonlinear Dictionary Learning for Sparse Coding

Efficient Sum of Outer Products Dictionary Learning (SOUP-DIL) and Its Application to Inverse Problems

Dictionary Learning with Convolutional Structure for Seismic Data Denoising and Interpolation

Multiview Hessian Discriminative Sparse Coding for Image Annotation.

3D seismic data denoising using two-dimensional sparse coding scheme

Tensor Completion via Complementary Global, Local, and Nonlocal Priors

Robust Dictionary Learning and Sparse Coding with Riemannian Geometry Preserving Method in Symmetric Matrices Inner Product Space.

Tensor Based Analysis Dictionary Learning for Color Video Denoising

Blockwise Coordinate Descent Schemes for Efficient and Effective Dictionary Learning.

A image denoising algorithm based on sparse dictionary

Dictionary-based Tensor Canonical Polyadic Decomposition

Integrating Convolution and Sparse Coding for Learning Low-Dimensional Discriminative Image Representations

Sparse Coding and Dictionary Learning for Symmetric Positive Definite Matrices: A Kernel Approach

Multi-Dictionary Tensor Decomposition