On Block Term Tensor Decompositions and Its Applications in Blind Signal Separation

Ming Yang,Zhao Kang,Chong Peng,Wen Liu,Qiang Cheng

2016-01-01

Abstract:We give proofs, phrased in geometric language, of the uniqueness of expressions for block term tensor decompositions introduced by De Lathauwer. And we try to demonstrate our results with some numerical experiments in blind signal separation.

What problem does this paper attempt to address?

On partial and generic uniqueness of block term tensor decompositions

Ming Yang

DOI: https://doi.org/10.48550/arXiv.1301.0920

2013-01-06

Abstract:We present several conditions for generic uniqueness of tensor decompositions of multilinear rank (1,L_{1}, L_{1}),..., (1, L_{R}, L_{R}) terms. In geometric language, we prove that the joins of relevant subspace varieties are not tangentially weakly defective. We also give conditions for partial uniqueness of block term tensor decompositions by proving that the joins of relevant subspace varieties are not defective.

Algebraic Geometry
Tensor Decompositions in Wireless Communications and MIMO Radar

Hongyang Chen,Fauzia Ahmad,Sergiy Vorobyov,Fatih Porikli

DOI: https://doi.org/10.1109/jstsp.2021.3061937

IF: 7.695

2021-04-01

IEEE Journal of Selected Topics in Signal Processing

Abstract:The emergence of big data and the multidimensional nature of wireless communication signals present significant opportunities for exploiting the versatility of tensor decompositions in associated data analysis and signal processing. The uniqueness of tensor decompositions, unlike matrix-based methods, can be guaranteed under very mild and natural conditions. Harnessing the power of multilinear algebra through tensor analysis in wireless signal processing, channel modeling, and parametric channel estimation provides greater flexibility in the choice of constraints on data properties and permits extraction of more general latent data components than matrix-based methods. Tensor analysis has also found applications in Multiple-Input Multiple-Output (MIMO) radar because of its ability to exploit the inherent higher-dimensional signal structures therein. In this paper, we provide a broad overview of tensor analysis in wireless communications and MIMO radar. More specifically, we cover topics including basic tensor operations, common tensor decompositions via canonical polyadic and Tucker factorization models, wireless communications applications ranging from blind symbol recovery to channel parameter estimation, and transmit beamspace design and target parameter estimation in MIMO radar.

engineering, electrical & electronic
A System of Tensor Equations over the Dual Split Quaternion Algebra with an Application

Liuqing Yang,Qing-Wen Wang,Zuliang Kou

DOI: https://doi.org/10.3390/math12223571

IF: 2.4

2024-11-21

Mathematics

Abstract:In this paper, we propose a definition of block tensors and the real representation of tensors. Equipped with the simplification method, i.e., the real representation along with the M-P inverse, we demonstrate the conditions that are necessary and sufficient for the system of dual split quaternion tensor equations (A∗NX,X∗SC)=(B,D), when its solution exists. Furthermore, the general expression of the solution is also provided when the solution of the system exists, and we use a numerical example to validate it in the last section. To the best of our knowledge, this is the first time that the aforementioned tensor system has been examined on dual split quaternion algebra. Additionally, we provide its equivalent conditions when its Hermitian solution X=X∗ and η-Hermitian solutions X=Xη∗ exist. Subsequently, we discuss two special dual split quaternion tensor equations. Last but not least, we propose an application for encrypting and decrypting two color videos, and we validate this algorithm through a specific example.

mathematics
Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis

Andrzej Cichocki,Danilo Mandic,Lieven De Lathauwer,Guoxu Zhou,Qibin Zhao,Cesar Caiafa,Huy Anh Phan,HUY ANH PHAN

DOI: https://doi.org/10.1109/msp.2013.2297439

IF: 15.204

2015-03-01

IEEE Signal Processing Magazine

Abstract:The widespread use of multisensor technology and the emergence of big data sets have highlighted the limitations of standard flat-view matrix models and the necessity to move toward more versatile data analysis tools. We show that higher-order tensors (i.e., multiway arrays) enable such a fundamental paradigm shift toward models that are essentially polynomial, the uniqueness of which, unlike the matrix methods, is guaranteed under very mild and natural conditions. Benefiting from the power of multilinear algebra as their mathematical backbone, data analysis techniques using tensor decompositions are shown to have great flexibility in the choice of constraints which match data properties and extract more general latent components in the data than matrix-based methods.

engineering, electrical & electronic
Tensor Decomposition for Signal Processing and Machine Learning

Nicholas D. Sidiropoulos,Lieven De Lathauwer,Xiao Fu,Kejun Huang,Evangelos E. Papalexakis,Christos Faloutsos

DOI: https://doi.org/10.1109/TSP.2017.2690524

IF: 4.875

2022-03-15

IEEE Transactions on Signal Processing

Abstract:Tensors or multiway arrays are functions of three or more indices (i, j, k, . . . )-similar to matrices (two-way arrays), which are functions of two indices (r, c) for (row, column). Tensors have a rich history, stretching over almost a century, and touching upon numerous disciplines; but they have only recently become ubiquitous in signal and data analytics at the confluence of signal processing, statistics, data mining, and machine learning. This overview article aims to provide a good starting point for researchers and practitioners interested in learning about and working with tensors. As such, it focuses on fundamentals and motivation (using various application examples), aiming to strike an appropriate balance of breadth and depth that will enable someone having taken first graduate courses in matrix algebra and probability to get started doing research and/or developing tensor algorithms and software. Some background in applied optimization is useful but not strictly required. The material covered includes tensor rank and rank decomposition; basic tensor factorization models and their relationships and properties (including fairly good coverage of identifiability); broad coverage of algorithms ranging from alternating optimization to stochastic gradient; statistical performance analysis; and applications ranging from source separation to collaborative filtering, mixture and topic modeling, classification, and multilinear subspace learning.

engineering, electrical & electronic
The Flexible Tensor Singular Value Decomposition and Its Applications in Multisensor Signal Fusion Processing

Jinfeng Huang,Feibin Zhang,Babak Safaei,Zhaoye Qin,Fulei Chu

DOI: https://doi.org/10.1016/j.ymssp.2024.111662

IF: 8.4

2024-01-01

Mechanical Systems and Signal Processing

Abstract:A tensor, represented as a multidimensional array, has crucial applications in various fields such as image processing and high-dimensional data mining. This study defines a novel concept of tensor-tensor multiplication, the 'o-order < p, q >-mode product', laying a foundational framework for advanced tensor operations. Building on this, a novel extension of matrix SVD to tensors, termed the flexible tensor SVD (FTSVD), is also proposed. The FTSVD overcomes the inherent limitations of the popular tensor SVD that operates on the n-mode product, notably non-unique optimization results, and non-pseudo-diagonal core tensors. Building upon the foundations of the FTSVD and iterative decomposition principles, this study presents an adaptive signal decomposition technique named the second-kind tensor singular spectrum decomposition(2KFTSSD). This technique is well-suited for multisensor information fusion processing. The effectiveness of the presented technique has been thoroughly evaluated through both dynamic simulation and experimental signal analyses. Comparative analyses suggest that the proposed method outperforms traditional approaches in multisensor signal fusion processing, feature extraction, early fault detection, and the preservation of intrinsic interrelationships among multisensor signal attributes.
Tensor Networks for Latent Variable Analysis. Part I: Algorithms for Tensor Train Decomposition

Anh-Huy Phan,Andrzej Cichocki,Andre Uschmajew,Petr Tichavsky,George Luta,Danilo Mandic

DOI: https://doi.org/10.48550/arXiv.1609.09230

2016-09-29

Abstract:Decompositions of tensors into factor matrices, which interact through a core tensor, have found numerous applications in signal processing and machine learning. A more general tensor model which represents data as an ordered network of sub-tensors of order-2 or order-3 has, so far, not been widely considered in these fields, although this so-called tensor network decomposition has been long studied in quantum physics and scientific computing. In this study, we present novel algorithms and applications of tensor network decompositions, with a particular focus on the tensor train decomposition and its variants. The novel algorithms developed for the tensor train decomposition update, in an alternating way, one or several core tensors at each iteration, and exhibit enhanced mathematical tractability and scalability to exceedingly large-scale data tensors. The proposed algorithms are tested in classic paradigms of blind source separation from a single mixture, denoising, and feature extraction, and achieve superior performance over the widely used truncated algorithms for tensor train decomposition.

Numerical Analysis,Optimization and Control
Restricted Singular Value Decomposition for a Tensor Triplet under T-Product and Its Applications

Chong-Quan Zhang,Qing-Wen Wang,Xiang-Xiang Wang,Zhuo-Heng He

DOI: https://doi.org/10.3390/math12070982

IF: 2.4

2024-03-27

Mathematics

Abstract:We investigate and discuss in detail the structure of the restricted singular value decomposition for a tensor triplet under t-product (T-RSVD). The algorithm is provided with a numerical example illustrating the main result. For applications, we consider color image watermarking processing with T-RSVD.

mathematics
Iterative Block Tensor Singular Value Thresholding for Extraction of Low Rank Component of Image Data

Longxi Chen,Yipeng Liu,Ce Zhu

DOI: https://doi.org/10.48550/arXiv.1701.04043

2017-01-15

Abstract:Tensor principal component analysis (TPCA) is a multi-linear extension of principal component analysis which converts a set of correlated measurements into several principal components. In this paper, we propose a new robust TPCA method to extract the princi- pal components of the multi-way data based on tensor singular value decomposition. The tensor is split into a number of blocks of the same size. The low rank component of each block tensor is extracted using iterative tensor singular value thresholding method. The prin- cipal components of the multi-way data are the concatenation of all the low rank components of all the block tensors. We give the block tensor incoherence conditions to guarantee the successful decom- position. This factorization has similar optimality properties to that of low rank matrix derived from singular value decomposition. Ex- perimentally, we demonstrate its effectiveness in two applications, including motion separation for surveillance videos and illumination normalization for face images.

Computer Vision and Pattern Recognition
A Novel Approach to Eliminating the Permutation and Scaling Indeterminacies of Block BSS

WEI ZHAO,YUEHONG SHEN,XU PENGCHENG,ZHIGANG YUAN,YIMIN WEI,WEI JIAN

2015-01-01

Abstract:This paper considers the permutation and scaling indeterminacy problem of blind source separation (BSS) in the case that the continuously mixing signals are split in time and processed block by block. When tying the separated signals in each time block, the recovered whole signals differ from the original sources up to permutation and scaling indeterminacies. Inspired by previous Permutation Method of reconstructing source signals in time domain, a novel approach is proposed to eliminate the inherent permutation and scaling indeterminacies when the block BSS is considered. This new method reformulates the mixing signals by overlapping adjacent signal blocks partially and utilizes the dependent correlation of the overlapping signals in each adjacent block to adjust the permutation and scaling parameters. Compared with the Permutation Method, this new method is more efficient in terms of separation quality and is much quicker in terms of execution speed. The performance of this novel approach is confirmed by computer simulations and realistic experiments performed on wireless communication system. Key-Words: blind source separation; independent component analysis; permutation and scaling indeterminacies; adjacent time blocks; overlapping signals; permutation method
Multidimensional Data Analysis Based on Block Convolutional Tensor Decomposition

Mahdi Molavi,Mansoor Rezghi,Tayyebeh Saeedi

2023-08-12

Abstract:Tensor decompositions are powerful tools for analyzing multi-dimensional data in their original format. Besides tensor decompositions like Tucker and CP, Tensor SVD (t-SVD) which is based on the t-product of tensors is another extension of SVD to tensors that recently developed and has found numerous applications in analyzing high dimensional data. This paper offers a new insight into the t-Product and shows that this product is a block convolution of two tensors with periodic boundary conditions. Based on this viewpoint, we propose a new tensor-tensor product called the $\star_c{}\text{-Product}$ based on Block convolution with reflective boundary conditions. Using a tensor framework, this product can be easily extended to tensors of arbitrary order. Additionally, we introduce a tensor decomposition based on our $\star_c{}\text{-Product}$ for arbitrary order tensors. Compared to t-SVD, our new decomposition has lower complexity, and experiments show that it yields higher-quality results in applications such as classification and compression.

Computer Vision and Pattern Recognition
An Extended and Efficient Approach for Block BSS in Time Domain

Wei Zhao,Yimin Wei,Yuehong Shen,Pengcheng Xu,Zhigang Yuan,Wei Jian

DOI: https://doi.org/10.1109/icist.2015.7289004

2015-01-01

Abstract:This paper considers eliminating ambiguities of blind source separation (BSS) when continuous mixtures of source signals are split in time and processed block by block. Due to the inherent permutation and scaling ambiguities of BSS, the original sources can not be recovered successfully when the separated components in each block are concatenated together. For this block BSS case, a new approach is proposed by overlapping adjacent mixture block partially and utilizing the correlation between overlapping signals in time domain. On the one hand, this approach is the extension of previous separation and reconstruction method, in which case the length of overlapping signals is generalized from half the length of signal block to any ratio. On the other hand, this new method is much more efficient than the previously original one in terms of computational speed by simplifying the correlation computation of overlapping signals, which is significantly striking when the sample size of overlapping signals and the number of sources and blcoks are large. Simulations are presented to validate the effectiveness and performance of this new method.
Perturbations of Tensor-Schur Decomposition and Its Applications to Multilinear Control Systems and Facial Recognitions

Juefei Chen,Wanli Ma,Yun Miao,Yimin Wei

DOI: https://doi.org/10.1016/j.neucom.2023.126359

IF: 6

2023-01-01

Neurocomputing

Abstract:Perturbation analysis has been primarily considered to be one of the main issues in many fields. The Schur decomposition can factor a square matrix as the product of a unitary matrix and an upper triangular matrix, which contains eigenvalues of the square matrix. In view of the importance of T-eigenvalue problems, this paper discusses a tensor Schur decomposition (T-Schur), the T-Schur decomposition =U∗T∗U∗, which is based on T-product multiplication of third-order tensors. We present the normwise and componentwise perturbation analysis for the unitary tensor U, the upper triangular tensor T and T-eigenvalues of the tensor A. We explore some applications of the T-Schur decomposition and perform the T-Schur form to solve the tensor pole assignment. We give an algorithm to solve the tensor based T-Sylvester equation and present its perturbation bound and the backward error. The T-Sylvester equation can also be used to estimate the condition of the T-sign function. We apply the T-Schur decomposition to facial recognation and compare it with other types of tensor decompositions.
Introduction to Tensor Decompositions and their Applications in Machine Learning

Stephan Rabanser,Oleksandr Shchur,Stephan Günnemann

DOI: https://doi.org/10.48550/arXiv.1711.10781

2017-11-29

Abstract:Tensors are multidimensional arrays of numerical values and therefore generalize matrices to multiple dimensions. While tensors first emerged in the psychometrics community in the $20^{\text{th}}$ century, they have since then spread to numerous other disciplines, including machine learning. Tensors and their decompositions are especially beneficial in unsupervised learning settings, but are gaining popularity in other sub-disciplines like temporal and multi-relational data analysis, too. The scope of this paper is to give a broad overview of tensors, their decompositions, and how they are used in machine learning. As part of this, we are going to introduce basic tensor concepts, discuss why tensors can be considered more rigid than matrices with respect to the uniqueness of their decomposition, explain the most important factorization algorithms and their properties, provide concrete examples of tensor decomposition applications in machine learning, conduct a case study on tensor-based estimation of mixture models, talk about the current state of research, and provide references to available software libraries.

Machine Learning
Tensor Decompositions: A New Concept in Brain Data Analysis?

Andrzej Cichocki

DOI: https://doi.org/10.48550/arXiv.1305.0395

2013-05-02

Abstract:Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component Analysis (ICA), NonnegativeMatrix and Tensor Factorization (NMF/NTF), Smooth Component Analysis (SmoCA) and Sparse Component Analysis (SCA). Moreover, tensor decompositions have many other potential applications beyond multilinear BSS, especially feature extraction, classification, dimensionality reduction and multiway clustering. In this paper, we briefly overview new and emerging models and approaches for tensor decompositions in applications to group and linked multiway BSS/ICA, feature extraction, classification andMultiway Partial Least Squares (MPLS) regression problems. Keywords: Multilinear BSS, linked multiway BSS/ICA, tensor factorizations and decompositions, constrained Tucker and CP models, Penalized Tensor Decompositions (PTD), feature extraction, classification, multiway PLS and CCA.

Numerical Analysis,Machine Learning,Neurons and Cognition
Subspace-based coupled tensor decomposition for hyperspectral blind fusion

Kunjing Yang,Minru Bai,Renwei Dian,Ting Lu

DOI: https://doi.org/10.3934/ipi.2024045

2024-11-27

Inverse Problems and Imaging

Abstract:Fusing hyperspectral images (HSIs) and multispectral images (MSIs) is a widely employed technique for obtaining high spatial resolution HSIs (HR-HSIs). Many Tucker decomposition-based methods have been proposed and achieved commendable performance. However, the spatial-spectral correlation of HSIs may not be fully leveraged. To address this issue, we initially divide the HR-HSI into a coefficient tensor and a dictionary by utilizing its spectral correlation. Then, the coefficient tensor is further decomposed into three factor tensors through triple decomposition, which not only fully explores the spatial structure of the image, but also reduces the dimensionality of the problem. Meanwhile, a triple rank dynamic update scheme is proposed for avoiding cumbersome parameter tuning processes. Additionally, the degradation operators can be updated as dictionaries within the framework of triple decomposition, rendering our approach applicable in blind fusion scenarios. Furthermore, nonlocal self-similarity is utilized to cluster similar cubes together, reinforcing the low-rank prior of the data, then we minimize tensor average rank by developing an equivalent surrogate function with a difference of convex (DC) structure. An effective Gauss-Seidel difference of convex algorithm (GS-DCA) is presented to solve the proposed model. Finally, we provide a detailed convergence analysis of each algorithm based on Kurdyka-Lojasiewicz (KL) property. Extensive numerical experiments on hyperspectral datasets verify the effectiveness of our method.

mathematics, applied,physics, mathematical
Blind source separation and its development

Shun-ming LI,Tao YANG

DOI: https://doi.org/10.13873/j.1000-97872005.04.001

2005-01-01

Abstract:Blind source separation has common considerable attention from the signal processing community and the neural network community.It is becoming a hot topic.The mathematical principle,basic model and the solution steps of blind source separation are introduced.The mathematical theories and the characteristics of typical algorithms based on the higher-order cumulants and information theoretic criterion are analyzed.Meanwhile,the latest progress and the future further development on the blind source separation are pointed out.
Sparsity-Enhanced Convolutional Decomposition: A Novel Tensor-Based Paradigm for Blind Hyperspectral Unmixing

Jing Yao,Danfeng Hong,Lin Xu,Deyu Meng,Jocelyn Chanussot,Zongben Xu

DOI: https://doi.org/10.1109/tgrs.2021.3069845

IF: 8.2

2022-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Blind hyperspectral unmixing (HU) has long been recognized as a crucial component in analyzing the hyperspectral imagery (HSI) collected by airborne and spaceborne sensors. Due to the highly ill-posed problems of such a blind source separation scheme and the effects of spectral variability in hyperspectral imaging, the ability to accurately and effectively unmixing the complex HSI still remains limited. To this end, this article presents a novel blind HU model, called sparsity-enhanced convolutional decomposition (SeCoDe), by jointly capturing spatial–spectral information of HSI in a tensor-based fashion. SeCoDe benefits from two perspectives. On the one hand, the convolutional operation is employed in SeCoDe to locally model the spatial relation between the targeted pixel and its neighbors, which can be well explained by spectral bundles that are capable of addressing spectral variabilities effectively. It maintains, on the other hand, physically continuous spectral components by decomposing the HSI along with the spectral domain. With sparsity-enhanced regularization, an alternative optimization strategy with alternating direction method of multipliers (ADMM)-based optimization algorithm is devised for efficient model inference. Extensive experiments conducted on three different data sets demonstrate the superiority of the proposed SeCoDe compared to previous state-of-the-art methods. We will also release the code at https://github.com/danfenghong/IEEE_TGRS_SeCoDe to encourage the reproduction of the given results.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Block term tensor decomposition multispectral and hyperspectral fusion algorithm based on sparse regularization

Chunhui Mo,Hao Guo,Meng Cao,Lei Yang

DOI: https://doi.org/10.1117/1.jrs.18.048503

IF: 1.568

2024-11-08

Journal of Applied Remote Sensing

Abstract:The multispectral and hyperspectral image fusion (MHF) technique is designed to address the challenge of integrating the spatiotemporal characteristics of multispectral images with those of hyperspectral images. In the initial stages, the image to be fused is primarily decomposed into endmembers and abundances using a matrix decomposition method. This approach, however, may disrupt the correlation of spectral data. Subsequently, tensor decomposition-based methods emerged, with the most representative being canonical polyadic decomposition and Tucker decomposition. These methods are widely applied to the MHF problem due to their good recoverability. However, they lack the ability to introduce the physical interpretation of potential factors into the framework, and it is difficult to improve the quality of the fused image by utilizing the physical properties of the endmembers. Consequently, we employ a block term tensor decomposition algorithm based on sparse regularization to estimate the optimal high spatial resolution hyperspectral image. First, the abundance information is reconstructed into a chunk matrix, and its sparsity is characterized by introducing the l2,1 norm to eliminate the scaling effect present in the model. Second, the endmembers' matrix sparsity is facilitated by the introduction of the row sparsity of the l2,1 norm regularization, which eliminates the inverse scaling effect present in the model. Finally, the model is solved using the conjugate alternating iteration algorithm. Experiments on three standard datasets and two local datasets demonstrate that this method outperforms state-of-the-art methods.

environmental sciences,imaging science & photographic technology,remote sensing
Probabilistic Block Term Decomposition for the Modelling of Higher-Order Arrays

Jesper Løve Hinrich,Morten Mørup

2023-10-04

Abstract:Tensors are ubiquitous in science and engineering and tensor factorization approaches have become important tools for the characterization of higher order structure. Factorizations includes the outer-product rank Canonical Polyadic Decomposition (CPD) as well as the multi-linear rank Tucker decomposition in which the Block-Term Decomposition (BTD) is a structured intermediate interpolating between these two representations. Whereas CPD, Tucker, and BTD have traditionally relied on maximum-likelihood estimation, Bayesian inference has been use to form probabilistic CPD and Tucker. We propose, an efficient variational Bayesian probabilistic BTD, which uses the von-Mises Fisher matrix distribution to impose orthogonality in the multi-linear Tucker parts forming the BTD. On synthetic and two real datasets, we highlight the Bayesian inference procedure and demonstrate using the proposed pBTD on noisy data and for model order quantification. We find that the probabilistic BTD can quantify suitable multi-linear structures providing a means for robust inference of patterns in multi-linear data.

Machine Learning,Applications

On Block Term Tensor Decompositions and Its Applications in Blind Signal Separation

On partial and generic uniqueness of block term tensor decompositions

Tensor Decompositions in Wireless Communications and MIMO Radar

A System of Tensor Equations over the Dual Split Quaternion Algebra with an Application

Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis

Tensor Decomposition for Signal Processing and Machine Learning

The Flexible Tensor Singular Value Decomposition and Its Applications in Multisensor Signal Fusion Processing

Tensor Networks for Latent Variable Analysis. Part I: Algorithms for Tensor Train Decomposition

Restricted Singular Value Decomposition for a Tensor Triplet under T-Product and Its Applications

Iterative Block Tensor Singular Value Thresholding for Extraction of Low Rank Component of Image Data

A Novel Approach to Eliminating the Permutation and Scaling Indeterminacies of Block BSS

Multidimensional Data Analysis Based on Block Convolutional Tensor Decomposition

An Extended and Efficient Approach for Block BSS in Time Domain

Perturbations of Tensor-Schur Decomposition and Its Applications to Multilinear Control Systems and Facial Recognitions

Introduction to Tensor Decompositions and their Applications in Machine Learning

Tensor Decompositions: A New Concept in Brain Data Analysis?

Subspace-based coupled tensor decomposition for hyperspectral blind fusion

Blind source separation and its development

Sparsity-Enhanced Convolutional Decomposition: A Novel Tensor-Based Paradigm for Blind Hyperspectral Unmixing

Block term tensor decomposition multispectral and hyperspectral fusion algorithm based on sparse regularization

Probabilistic Block Term Decomposition for the Modelling of Higher-Order Arrays