Abstract:Tensor network methods are powerful tools for studying quantum many-body systems. In this paper, we investigate the emergent statistical properties of random high-dimensional tensor-network states and the trainability of variational tensor networks. We utilize diagrammatic methods and map our problems to the calculations of different partition functions for high-dimensional Ising models with special structures. To address the notorious difficulty in cracking these models, we develop a combinatorial method based on solving the ``puzzle of polyominoes". With this method, we are able to rigorously study statistical properties of the high dimensional random tensor networks. We prove: (a) the entanglement entropy approaches the maximal volume law, except for a small probability that is bounded by an inverse polynomial of the bond dimension; (b) the typicality occurs for the expectation value of a local observable when the bond dimension increases. In addition, we investigate the barren plateaus (i.e., exponentially vanishing gradients) for the high-dimensional tensor network models. We prove that such variational models suffer from barren plateaus for global loss functions, rendering their training processes inefficient in general. Whereas, for local loss functions, we prove that the gradient is independent of the system size (thus no barren plateau occurs), but decays exponentially with the distance between the region where the local observable acts and the site that hosts the derivative parameter. Our results uncover in a rigorous fashion some fundamental properties for variational high-dimensional tensor networks, which paves a way for their future theoretical studies and practical applications.

Virasoro generators in the Fibonacci model tensor network: Tackling finite-size effects

Virasoro and Kac-Moody Algebra in Generic Tensor Network Representations of Two-Dimensional Critical Lattice Partition Functions

Virasoro Constraints and Hurwitz Numbers Through Asymptotic Analysis

Efficient simulation of infinite tree tensor network states on the Bethe lattice

Tensor Network Finite-Size Scaling for Two-Dimensional 3-state Clock Model

Augmenting Finite Temperature Tensor Network with Clifford Circuits

General Tensor Network Theory for Frustrated Classical Spin Models in Two Dimensions

Solving Fermi-Hubbard-type Models by Tensor Representations of Backflow Corrections

Real-time evolution of Anderson impurity models via tensor network influence functionals

Theory on variational high-dimensional tensor networks

Virasoro blocks and the reparametrization formalism

Tensor network simulation of the ( 1 + 1 )-dimensional O ( 3 ) nonlinear σ -model with θ = π term

Unified tensor network theory for frustrated classical spin models in two dimensions

Efficient Tensor Network Algorithms for Spin Foam Models

Tensor-network-assisted variational quantum algorithm

Finite-size and finite bond dimension effects of tensor network renormalization

Tensor Network Computations That Capture Strict Variationality, Volume Law Behavior, and the Efficient Representation of Neural Network States

Tensor networks for $p$-spin models

Simulating matrix models with tensor networks

Holographic Tensor Networks with Bulk Gauge Symmetries

Robustness of Turing models and gene regulatory networks with a sweet spot