Abstract:There is a significant expansion in both volume and range of applications along with the concomitant increase in the variety of data sources. These ever-expanding trends have highlighted the necessity for more versatile analysis tools that offer greater opportunities for algorithmic developments and computationally faster operations than the standard flat-view matrix approach. Tensors, or multi-way arrays, provide such an algebraic framework which is naturally suited to data of such large volume, diversity, and veracity. Indeed, the associated tensor decompositions have demonstrated their potential in breaking the Curse of Dimensionality associated with traditional matrix methods, where a necessary exponential increase in data volume leads to adverse or even intractable consequences on computational complexity. A key tool underpinning multi-linear manipulation of tensors and tensor networks is the standard Tensor Contraction Product (TCP). However, depending on the dimensionality of the underlying tensors, the TCP also comes at the price of high computational complexity in tensor manipulation. In this work, we resort to diagrammatic tensor network manipulation to calculate such products in an efficient and computationally tractable manner, by making use of Tensor Train decomposition (TTD). This has rendered the underlying concepts easy to perceive, thereby enhancing intuition of the associated underlying operations, while preserving mathematical rigour. In addition to bypassing the cumbersome mathematical multi-linear expressions, the proposed Tensor Train Contraction Product model is shown to accelerate significantly the underlying computational operations, as it is independent of tensor order and linear in the tensor dimension, as opposed to performing the full computations through the standard approach (exponential in tensor order).

Redberry: a computer algebra system designed for tensor manipulation

Tensor computations in computer algebra systems

DBCSR: A Blocked Sparse Tensor Algebra Library

The tensor algebra compiler

New Features in the Second Version of the Cadabra Computer Algebra System

dxo: A System for Relational Algebra and Differentiation

A field-theory motivated approach to symbolic computer algebra

Modified Affine Arithmetic in Tensor Form ⋆

Automatic transformation of irreducible representations for efficient contraction of tensors with cyclic group symmetry

Modified Affine Arithmetic in Tensor Form for Trivariate Polynomial Evaluation and Algebraic Surface Plotting

TLib: A Flexible C++ Tensor Framework for Numerical Tensor Calculus

ReACT: Redundancy-Aware Code Generation for Tensor Expressions.

SySTeC: A Symmetric Sparse Tensor Compiler

On the algebraic proof complexity of Tensor Isomorphism

Methods, algorithms and programs of computer algebra in problems of registration and analysis of random point structures

Tensor Methods for Solving Symmetric ℳ -tensor Systems

Ricci-Notation Tensor Framework for Model-based Approaches to Imaging

Software for Sparse Tensor Decomposition on Emerging Computing Architectures

TAMM: Tensor Algebra for Many-body Methods

Randomized sketched TT-GMRES for linear systems with tensor structure

Reducing Computational Complexity of Tensor Contractions via Tensor-Train Networks