Differential Invariants for Higher-Rank Tensors. A Progress Report

Victor Tapia

DOI: https://doi.org/10.48550/arXiv.gr-qc/0408007

2004-08-03

General Relativity and Quantum Cosmology

Abstract:We outline the construction of differential invariants for higher--rank tensors.

What problem does this paper attempt to address?

More on Tensors with Different Rank and Symmetric Rank

Yaroslav Shitov

DOI: https://doi.org/10.1137/23m1547159

IF: 1.908

2024-02-07

SIAM Journal on Matrix Analysis and Applications

Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 1, Page 419-428, March 2024. This is a further discussion of a previous work of the author on tensors with different rank and symmetric rank. We point out several obstructions towards extending a complex number example to the real number setting and discuss several further questions raised in the literature.

mathematics, applied
Higher order differential analysis with vectorized derivatives

José E. Chacón,Tarn Duong

DOI: https://doi.org/10.48550/arXiv.2011.01833

2021-11-30

Abstract:Higher order derivatives of functions are structured high dimensional objects which lend themselves to many alternative representations, with the most popular being multi-index, matrix and tensor representations. The choice between them depends on the desired analysis since each presents its own advantages and disadvantages. In this paper, we highlight a vectorized representation, in which higher order derivatives are expressed as vectors. This allows us to construct an elegant and rigorous algebra of vector-valued functions of vector variables, which would be unwieldy, if not impossible, to do so using the other representations. The fundamental results that we establish for this algebra of differentials are the identification theorems, with concise existence and uniqueness properties, between differentials and derivatives of an arbitrary order. From these fundamental identifications, we develop further analytic tools, including a Leibniz rule for the product of functions, and a chain rule (Faà di Bruno's formula) for the composition of functions. To complete our exposition, we illustrate how existing tools (such as Taylor's theorem) can be incorporated into and generalized within our framework of higher order differential calculus.

Classical Analysis and ODEs
A Gap in the Subrank of Tensors

Matthias Christandl,Fulvio Gesmundo,Jeroen Zuiddam

DOI: https://doi.org/10.1137/22M1543276

2023-11-24

Abstract:The subrank of tensors is a measure of how much a tensor can be ''diagonalized''. This parameter was introduced by Strassen to study fast matrix multiplication algorithms in algebraic complexity theory and is closely related to many central tensor parameters (e.g. slice rank, partition rank, analytic rank, geometric rank, G-stable rank) and problems in combinatorics, computer science and quantum information theory. Strassen (J. Reine Angew. Math., 1988) proved that there is a gap in the subrank when taking large powers under the tensor product: either the subrank of all powers is at most one, or it grows as a power of a constant strictly larger than one. In this paper, we precisely determine this constant for tensors of any order. Additionally, for tensors of order three, we prove that there is a second gap in the possible rates of growth. Our results strengthen the recent work of Costa and Dalai (J. Comb. Theory, Ser. A, 2021), who proved a similar gap for the slice rank. Our theorem on the subrank has wider applications by implying such gaps not only for the slice rank, but for any ``normalized monotone''. In order to prove the main result, we characterize when a tensor has a very structured tensor (the W-tensor) in its orbit closure. Our methods include degenerations in Grassmanians, which may be of independent interest.

Algebraic Geometry,Computational Complexity,Combinatorics,Quantum Physics
First-order invariants of differential 2-forms

Jaime Muñoz Masqué,Luis Miguel Pozo Coronado

DOI: https://doi.org/10.2989/16073606.2021.1929537

2024-12-04

Abstract:Let $M$ be a smooth manifold of dimension $2n$, and let $O_{M}$ be the dense open subbundle in $\wedge^{2}T^{\ast}M$ of $2$-covectors of maximal rank. The algebra of $\operatorname*{Diff}M$-invariant smooth functions of first order on $O_{M}$ is proved to be isomorphic to the algebra of smooth $Sp(\Omega_{x})$-invariant functions on $\wedge^{3}T_{x}^{\ast}M$, $x$ being a fixed point in $M$, and $\Omega_{x}$ a fixed element in $(O_{M})_{x}$. The maximum number of functionally independent invariants is computed.

Differential Geometry
$p$-order Tensor Products with Invertible Linear Transforms

Jun Han

DOI: https://doi.org/10.48550/arXiv.2005.11477

2020-05-23

Abstract:This paper studies the issues about tensors. Three typical kinds of tensor decomposition are mentioned. Among these decompositions, the t-SVD is proposed in this decade. Different definitions of rank derive from tensor decompositions. Based on the research about higher order tensor t-product and tensor products with invertible transform, this paper introduces a product performing higher order tensor products with invertible transform, which is the most generalized case so far. Also, a few properties are proven. Because the optimization model of low-rank recovery often uses the nuclear norm, the paper tries to generalize the nuclear norm and proves its relation to multi-rank of tensors. The theorem paves the way for low-rank recovery of higher order tensors in the future.

Numerical Analysis
Notions of Tensor Rank

Mandar Juvekar,Arian Nadjimzadah

2023-06-15

Abstract:Tensors, or multi-linear forms, are important objects in a variety of areas from analytics, to combinatorics, to computational complexity theory. Notions of tensor rank aim to quantify the "complexity" of these forms, and are thus also important. While there is one single definition of rank that completely captures the complexity of matrices (and thus linear transformations), there is no definitive analog for tensors. Rather, many notions of tensor rank have been defined over the years, each with their own set of uses. In this paper we survey the popular notions of tensor rank. We give a brief history of their introduction, motivating their existence, and discuss some of their applications in computer science. We also give proof sketches of recent results by Lovett, and Cohen and Moshkovitz, which prove asymptotic equivalence between three key notions of tensor rank over finite fields with at least three elements.

Computational Complexity
The Inverse, Rank and Product of Tensors

Changjiang Bu,Xu Zhang,Jiang Zhou,Wenzhe Wang,Yimin Wei

DOI: https://doi.org/10.1016/j.laa.2013.12.015

IF: 1.307

2014-01-01

Linear Algebra and its Applications

Abstract:In this paper, we give some basic properties for the left (right) inverse, rank and product of tensors. The existence of order 2 left (right) inverses of tensors is characterized. We obtain some equalities and inequalities on the tensor rank. We also show that the rank of a uniform hypergraph is independent of the ordering of its vertices, and the Laplacian tensor and the signless Laplacian tensor have the same rank for odd-bipartite even uniform hypergraphs.
Higher rho invariant and delocalized eta invariant at infinity

Xiaoman Chen,Hongzhi Liu,Hang Wang,Guoliang Yu

DOI: https://doi.org/10.4310/ajm.2022.v26.n2.a5

2020-01-01

Abstract:In this paper, we introduce several new secondary invariants for Dirac operators on a complete Riemannian manifold with a uniform positive scalar curvature metric outside a compact set and use these secondary invariants to establish a higher index theorem for the Dirac operators. We apply our theory to study the secondary invariants for a manifold with corner with positive scalar curvature metric on each boundary face.
Partial Degeneration of Tensors

Matthias Christandl,Fulvio Gesmundo,Vladimir Lysikov,Vincent Steffan

DOI: https://doi.org/10.1137/23m1554898

IF: 1.908

2024-03-12

SIAM Journal on Matrix Analysis and Applications

Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 1, Page 771-800, March 2024. Tensors are often studied by introducing preorders such as restriction and degeneration. The former describes transformations of the tensors by local linear maps on its tensor factors; the latter describes transformations where the local linear maps may vary along a curve, and the resulting tensor is expressed as a limit along this curve. In this work, we introduce and study partial degeneration, a special version of degeneration where one of the local linear maps is constant while the others vary along a curve. Motivated by algebraic complexity, quantum entanglement, and tensor networks, we present constructions based on matrix multiplication tensors and find examples by making a connection to the theory of prehomogeneous tensor spaces. We highlight the subtleties of this new notion by showing obstruction and classification results for the unit tensor. To this end, we study the notion of aided rank, a natural generalization of tensor rank. The existence of partial degenerations gives strong upper bounds on the aided rank of a tensor, which allows one to turn degenerations into restrictions. In particular, we present several examples, based on the W-tensor and the Coppersmith–Winograd tensors, where lower bounds on aided rank provide obstructions to the existence of certain partial degenerations.

mathematics, applied
T product Tensors Part I: Inequalities

Shih Yu Chang,Yimin Wei

DOI: https://doi.org/10.48550/arXiv.2107.06285

2021-08-10

Abstract:The T product operation between two three order tensors was invented around 2011 and it arises from many applications, such as signal processing, image feature extraction, machine learning, computer vision, and the multiview clustering problem. Although there are many pioneer works about T product tensors, there are no works dedicated to inequalities associated with T product tensors. In this work, we first attempt to build inequalities at the following aspects: (1) trace function nondecreasing and convexity; (2) Golden Thompson inequality for T product tensors; (3) Jensen T product inequality; (4) Klein T product inequality. All these inequalities are related to generalize celebrated Lieb concavity theorem from matrices to T product tensors. This new version of Lieb concavity theorem under T product tensor will be used to determine the tail bound for the maximum eigenvalue induced by independent sums of random Hermitian T product, which is the key tool to derive various new tail bounds for random T product tensors. Besides, Qi et. al introduces a new concept, named eigentuple, about T product tensors and they apply this concept to study nonnegative (positive) definite properties of T product tensors. The final main contribution of this work is to develop the Courant Fischer Theorem with respect to eigentuples, and this theorem helps us to understand the relationship between the minimum eigentuple and the maximum eigentuple. The main content of this paper is Part I of a serious task about T product tensors. The Part II of this work will utilize these new inequalities and Courant Fischer Theorem under T product tensors to derive tail bounds of the extreme eigenvalue and the maximum eigentuple for sums of random T product tensors, e.g., T product tensor Chernoff and T product tensor Bernstein bounds.

Functional Analysis,Probability
Invariant tensors related with natural connections for a class Riemannian product manifolds

Dobrinka Gribacheva

DOI: https://doi.org/10.48550/arXiv.1206.1692

2012-06-08

Differential Geometry

Abstract:Some invariant tensors in two Naveira classes of Riemannian product manifolds are considered. These tensors are related with natural connections, i.e. linear connections preserving the Riemannian metric and the product structure.
Perron-Frobenius Theorem for Nonnegative Tensors

K. C. Chang,Kelly Pearson,Tan Zhang

DOI: https://doi.org/10.4310/cms.2008.v6.n2.a12

2008-01-01

Communications in Mathematical Sciences

Abstract:We generalize the Perron Frobenius Theorem for nonnegative matrices to the class of nonnegative tensors.
Differential Calculus, Tensor Products and the Importance of Notation

Jonathan H. Manton

DOI: https://doi.org/10.48550/arXiv.1208.0197

2013-10-02

Abstract:An efficient coordinate-free notation is elucidated for differentiating matrix expressions and other functions between higher-dimensional vector spaces. This method of differentiation is known, but not explained well, in the literature. Teaching it early in the curriculum would avoid the tedium of element-wise differentiation and provide a better footing for understanding more advanced applications of calculus. Additionally, it is shown to lead naturally to tensor products, a topic previously considered too difficult to motivate quickly in elementary ways.

History and Overview
Border Ranks of Positive and Invariant Tensor Decompositions: Applications to Correlations

Andreas Klingler,Tim Netzer,Gemma De les Coves

2023-04-26

Abstract:The matrix rank and its positive versions are robust for small approximations, i.e. they do not decrease under small perturbations. In contrast, the multipartite tensor rank can collapse for arbitrarily small errors, i.e. there may be a gap between rank and border rank, leading to instabilities in the optimization over sets with fixed tensor rank. Can multipartite positive ranks also collapse for small perturbations? In this work, we prove that multipartite positive and invariant tensor decompositions exhibit gaps between rank and border rank, including tensor rank purifications and cyclic separable decompositions. We also prove a correspondence between positive decompositions and membership in certain sets of multipartite probability distributions, and leverage the gaps between rank and border rank to prove that these correlation sets are not closed. It follows that testing membership of probability distributions arising from resources like translational invariant Matrix Product States is impossible in finite time. Overall, this work sheds light on the instability of ranks and the unique behavior of bipartite systems.

Quantum Physics,Mathematical Physics,Algebraic Geometry
Invariant Differential Operators for Non-Compact Lie Groups: the $Sp(n,1)$ Case

N. Aizawa,V. K. Dobrev

DOI: https://doi.org/10.1142/S0217751X24500222

2024-05-05

Abstract:In the present paper we continue the project of systematic construction of invariant differential operators on the example of the non-compact algebras $sp(n,1)$. Our choice of these algebras is motivated by the fact that they belong to a narrow class of algebras, which are of split rank one, of which class the other cases were studied, some long time ago. We concentrate on the case $n=2$. We give the main multiplets and the main reduced multiplets of indecomposable elementary representations for, including the necessary data for all relevant invariant differential operators. We also present explicit expressions for the singular vectors and for the intertwining differential operators.

Representation Theory,Mathematical Physics
Invertibility of local geodesic transverse and mixed ray transforms II: higher order tensors

Gunther Uhlmann,Jian Zhai

2024-02-20

Abstract:Consider a compact Riemannian manifold in dimension $n$ with strictly convex boundary. We show the local invertibility near a boundary point of the transverse ray transform of $2$ tensors for $n\geq 3$ and the mixed ray transform of $2+2$ tensors for $n=3$. When the manifold admits a strictly convex function, this local invertibility result leads to global invertibility.

Differential Geometry
ℋ-tensors and Nonsingular ℋ-tensors

Xuezhong Wang,Yimin Wei

DOI: https://doi.org/10.1007/s11464-015-0495-6

2015-01-01

Frontiers of Mathematics in China

Abstract:The H-matrices are an important class in the matrix theory, and have many applications. Recently, this concept has been extended to higher order ?-tensors. In this paper, we establish important properties of diagonally dominant tensors and ?-tensors. Distributions of eigenvalues of nonsingular symmetric ?-tensors are given. An ?+-tensor is semi-positive, which enlarges the area of semi-positive tensor from ?-tensor to ?+-tensor. The spectral radius of Jacobi tensor of a nonsingular (resp. singular) ?-tensor is less than (resp. equal to) one. In particular, we show that a quasi-diagonally dominant tensor is a nonsingular ?-tensor if and only if all of its principal sub-tensors are nonsingular ?-tensors. An irreducible tensor Ais an ?-tensor if and only if it is quasi-diagonally dominant.
Time integration of rank-constrained Tucker tensors

Christian Lubich,Bart Vandereycken,Hanna Walach

DOI: https://doi.org/10.48550/arXiv.1709.02594

2017-09-08

Abstract:Dynamical low-rank approximation in the Tucker tensor format of given large time-dependent tensors and of tensor differential equations is the subject of this paper. In particular, a discrete time integration method for rank-constrained Tucker tensors is presented and analyzed. It extends the known projector-splitting integrator for dynamical low-rank approximation of matrices to Tucker tensors and is shown to inherit the same favorable properties. The integrator is based on iteratively applying the matrix projector-splitting integrator to tensor unfoldings but with inexact solution in a substep. It has the property that it reconstructs time-dependent Tucker tensors of the given rank exactly. The integrator is also shown to be robust to the presence of small singular values in the tensor unfoldings. Numerical examples with problems from quantum dynamics and tensor optimization methods illustrate our theoretical results.

Numerical Analysis
Countably many asymptotic tensor ranks

Andreas Blatter,Jan Draisma,Filip Rupniewski

DOI: https://doi.org/10.1080/03081087.2024.2317906

2024-03-14

Linear and Multilinear Algebra

Abstract:In connection with recent work on gaps in the asymptotic subranks of complex tensors the question arose whether the number of nonnegative real numbers that arise as the asymptotic subrank of some complex tensor is countable. In this short note we settle this question in the affirmative, for all tensor invariants that are algebraic in the sense that they are invariant under field automorphisms of the complex numbers.

mathematics

Differential Invariants for Higher-Rank Tensors. A Progress Report

More on Tensors with Different Rank and Symmetric Rank

Higher order differential analysis with vectorized derivatives

A Gap in the Subrank of Tensors

First-order invariants of differential 2-forms

$p$-order Tensor Products with Invertible Linear Transforms

Notions of Tensor Rank

The Inverse, Rank and Product of Tensors

Higher rho invariant and delocalized eta invariant at infinity

Partial Degeneration of Tensors

T product Tensors Part I: Inequalities

Invariant tensors related with natural connections for a class Riemannian product manifolds

Perron-Frobenius Theorem for Nonnegative Tensors

Differential Calculus, Tensor Products and the Importance of Notation

Border Ranks of Positive and Invariant Tensor Decompositions: Applications to Correlations

Invariant Differential Operators for Non-Compact Lie Groups: the $Sp(n,1)$ Case

Invertibility of local geodesic transverse and mixed ray transforms II: higher order tensors

ℋ-tensors and Nonsingular ℋ-tensors

Time integration of rank-constrained Tucker tensors

Countably many asymptotic tensor ranks