Abstract:Tensor decomposition methods are popular tools for analysis of multi-way datasets from social media, healthcare, spatio-temporal domains, and others. Widely adopted models such as Tucker and canonical polyadic decomposition (CPD) follow a data-driven philosophy: they decompose a tensor into factors that approximate the observed data well. In some cases side information is available about the tensor modes. For example, in a temporal user-item purchases tensor a user influence graph, an item similarity graph, and knowledge about seasonality or trends in the temporal mode may be available. Such side information may enable more succinct and interpretable tensor decomposition models and improved quality in downstream tasks. We propose a framework for Multi-Dictionary Tensor Decomposition (MDTD) which takes advantage of prior structural information about tensor modes in the form of coding dictionaries to obtain sparsely encoded tensor factors. We derive a general optimization algorithm for MDTD that handles both complete input and input with missing values. Our framework handles large sparse tensors typical to many real-world application domains. We demonstrate MDTD's utility via experiments with both synthetic and real-world datasets. It learns more concise models than dictionary-free counterparts and improves (i) reconstruction quality ($60\%$ fewer non-zero coefficients coupled with smaller error); (ii) missing values imputation quality (two-fold MSE reduction with up to orders of magnitude time savings) and (iii) the estimation of the tensor rank. MDTD's quality improvements do not come with a running time premium: it can decompose $19GB$ datasets in less than a minute. It can also impute missing values in sparse billion-entry tensors more accurately and scalably than state-of-the-art competitors.

Efficient Multi-Dimensional Tensor Sparse Coding Using t-Linear Combination.

Directional Tensor Product Complex Tight Framelets for Compressed Sensing MRI Reconstruction

Image Classification Method by Combining Multi-features and Sparse Coding

K-CPD: Learning of Overcomplete Dictionaries for Tensor Sparse Coding.

Tensor-based Sparse Representations of Multi-Phase Medical Images for Classification of Focal Liver Lesions

A Novel Multiple Description Coding Frame Based on Reordered DCT Coefficients and SPIHT Algorithm

Multi-Dictionary Tensor Decomposition

Tensr: Multi-Dimensional Tensor Sparse Representation

Tensor LISTA: Differentiable sparse representation learning for multi-dimensional tensor

Sparse approximation using M-term pursuit and application in image and video coding

Input-aware Sparse Tensor Storage Format Selection for Optimizing MTTKRP

3D seismic data denoising using two-dimensional sparse coding scheme

A Novel Parallel Algorithm for Sparse Tensor Matrix Chain Multiplication via TCU-Acceleration

SpTFS: Sparse Tensor Format Selection for MTTKRP Via Deep Learning

Video Dimension Reduction and Coding Using Multiple Tensor Rank-R Decomposition

Transfer Sparse Coding for Robust Image Representation

Tensor Based Analysis Dictionary Learning for Color Video Denoising

Tensor LRR and Sparse Coding-Based Subspace Clustering.

Local Hybrid Coding for Image Classification

Coded Sparse Matrix Multiplication

Enhanced Multiple Transform for Video Coding