Abstract:There is a significant expansion in both volume and range of applications along with the concomitant increase in the variety of data sources. These ever-expanding trends have highlighted the necessity for more versatile analysis tools that offer greater opportunities for algorithmic developments and computationally faster operations than the standard flat-view matrix approach. Tensors, or multi-way arrays, provide such an algebraic framework which is naturally suited to data of such large volume, diversity, and veracity. Indeed, the associated tensor decompositions have demonstrated their potential in breaking the Curse of Dimensionality associated with traditional matrix methods, where a necessary exponential increase in data volume leads to adverse or even intractable consequences on computational complexity. A key tool underpinning multi-linear manipulation of tensors and tensor networks is the standard Tensor Contraction Product (TCP). However, depending on the dimensionality of the underlying tensors, the TCP also comes at the price of high computational complexity in tensor manipulation. In this work, we resort to diagrammatic tensor network manipulation to calculate such products in an efficient and computationally tractable manner, by making use of Tensor Train decomposition (TTD). This has rendered the underlying concepts easy to perceive, thereby enhancing intuition of the associated underlying operations, while preserving mathematical rigour. In addition to bypassing the cumbersome mathematical multi-linear expressions, the proposed Tensor Train Contraction Product model is shown to accelerate significantly the underlying computational operations, as it is independent of tensor order and linear in the tensor dimension, as opposed to performing the full computations through the standard approach (exponential in tensor order).

NCON: A tensor network contractor for MATLAB

TensorTrace: an application to contract tensor networks

CoNST: Code Generator for Sparse Tensor Networks

Reducing Computational Complexity of Tensor Contractions via Tensor-Train Networks

Fast Search of the Optimal Contraction Sequence in Tensor Networks

Approximate Contraction of Arbitrary Tensor Networks with a Flexible and Efficient Density Matrix Algorithm

Automatic transformation of irreducible representations for efficient contraction of tensors with cyclic group symmetry

Efficient Contraction of Large Tensor Networks for Weighted Model Counting through Graph Decompositions

Hyperoptimized Approximate Contraction of Tensor Networks with Arbitrary Geometry

Fast counting with tensor networks

Cons-training tensor networks

BLAS-like Interface for Binary Tensor Contractions

High-Performance Tensor Contraction without Transposition

EinExprs: Contraction Paths of Tensor Networks as Symbolic Expressions

Contracting Arbitrary Tensor Networks: General Approximate Algorithm and Applications in Graphical Models and Quantum Circuit Simulations

A framework for load balancing of tensor contraction expressions via dynamic task partitioning

Minimum Cost Loop Nests for Contraction of a Sparse Tensor with a Tensor Network

Convolutions and More as Einsum: A Tensor Network Perspective with Advances for Second-Order Methods

TNSPackage: A Fortran2003 Library Designed for Tensor Network State Methods

conv_einsum: A Framework for Representation and Fast Evaluation of Multilinear Operations in Convolutional Tensorial Neural Networks

Towards a Polynomial Algorithm for Optimal Contraction Sequence of Tensor Networks from Trees.