Abstract:The widespread use of multisensor technology and the emergence of big datasets have created the need to develop tools to reduce, approximate, and classify large and multimodal data such as higher-order tensors. While early approaches focused on matrix and vector based methods to represent these higher-order data, more recently it has been shown that tensor decomposition methods are better equipped to capture couplings across their different modes. For these reasons, tensor decomposition methods have found applications in many different signal processing problems including dimensionality reduction, signal separation, linear regression, feature extraction, and classification. However, most of the existing tensor decomposition methods are based on the principle of finding a low-rank approximation in a linear subspace structure, where the definition of the rank may change depending on the particular decomposition. Since many datasets are not necessarily low-rank in a linear subspace, this often results in high approximation errors or low compression rates. In this paper, we introduce a new adaptive, multi-scale tensor decomposition method for higher order data inspired by hybrid linear modeling and subspace clustering techniques. In particular, we develop a multi-scale higher-order singular value decomposition (MS-HoSVD) approach where a given tensor is first permuted and then partitioned into several sub-tensors each of which can be represented as a low-rank tensor with increased representational efficiency. The proposed approach is evaluated for dimensionality reduction and classification for several different real-life tensor signals with promising results.

Multidimensional Data Processing With Bayesian Inference via Structural Block Decomposition

Bayesian Nonparametric Models for Multiway Data Analysis

Probabilistic Block Term Decomposition for the Modelling of Higher-Order Arrays

Scalable Bayesian Tensor Ring Factorization for Multiway Data Analysis

Kernelization of Tensor-Based Models for Multiway Data Analysis: Processing of Multidimensional Structured Data.

A Fast Algorithm for Rank-(L, M, N) Block Term Decomposition of Multi-Dimensional Data

Decomposition of Big Tensors With Low Multilinear Rank

A Biased Deep Tensor Factorization Network For Tensor Completion

Bayesian Sparse Tucker Models for Dimension Reduction and Tensor Completion

Bayesian Tensor Analysis

Era of Big Data Processing: A New Approach via Tensor Networks and Tensor Decompositions

Distributed Bayesian Matrix Decomposition for Big Data Mining and Clustering

Bayesian tensor-on-tensor regression with efficient computation

Scalable Nonparametric Multiway Data Analysis.

Extension of PCA to Higher Order Data Structures: An Introduction to Tensors, Tensor Decompositions, and Tensor PCA

Multiplex Transformed Tensor Decomposition for Multidimensional Image Recovery.

Multi-Dimensional Visual Data Completion via Low-Rank Tensor Representation Under Coupled Transform

Infinite Tucker Decomposition: Nonparametric Bayesian Models for Multiway Data Analysis

Tensor Decompositions: A New Concept in Brain Data Analysis?

NeuLFT: A Novel Approach to Nonlinear Canonical Polyadic Decomposition on High-Dimensional Incomplete Tensors

Multiscale Analysis for Higher-order Tensors