Abstract:Machine learning, one of today's most rapidly growing interdisciplinary fields, promises an unprecedented perspective for solving intricate quantum many-body problems. Understanding the physical aspects of the representative artificial neural-network states has recently become highly desirable in the applications of machine-learning techniques to quantum many-body physics. In this paper, we explore the data structures that encode the physical features in the network states by studying the quantum entanglement properties, with a focus on the restricted-Boltzmann-machine (RBM) architecture. We prove that the entanglement entropy of all short-range RBM states satisfies an area law for arbitrary dimensions and bipartition geometry. For long-range RBM states, we show by using an exact construction that such states could exhibit volume-law entanglement, implying a notable capability of RBM in representing quantum states with massive entanglement. Strikingly, the neural-network representation for these states is remarkably efficient, in the sense that the number of nonzero parameters scales only linearly with the system size. We further examine the entanglement properties of generic RBM states by randomly sampling the weight parameters of the RBM. We find that their averaged entanglement entropy obeys volume-law scaling, and the meantime strongly deviates from the Page entropy of the completely random pure states. We show that their entanglement spectrum has no universal part associated with random matrix theory and bears a Poisson-type level statistics. Using reinforcement learning, we demonstrate that RBM is capable of finding the ground state (with power-law entanglement) of a model Hamiltonian with a long-range interaction. In addition, we show, through a concrete example of the one-dimensional symmetry-protected topological cluster states, that the RBM representation may also be used as a tool to analytically compute the entanglement spectrum. Our results uncover the unparalleled power of artificial neural networks in representing quantum many-body states regardless of how much entanglement they possess, which paves a novel way to bridge computer-science-based machine-learning techniques to outstanding quantum condensed-matter physics problems.

Equivalence of restricted Boltzmann machines and tensor network states

Boltzmann machines as two-dimensional tensor networks

Quantum Machine Learning Tensor Network States

Tensor networks for unsupervised machine learning

Neural network representation of tensor network and chiral states

Neural tensor contractions and the expressive power of deep neural quantum states

Restricted Boltzmann Machines: Introduction and Review

Constructing exact representations of quantum many-body systems with deep neural networks

Quantum Entanglement in Neural Network States

Entanglement transition in deep neural quantum states

Boltzmann machines and quantum many-body problems

Tensor Network States with Low-Rank Tensors

Tensor Networks Meet Neural Networks: A Survey.

No-Free-Lunch Theories for Tensor-Network Machine Learning Models

Machine Learning by Unitary Tensor Network of Hierarchical Tree Structure

One-dimensional many-body entangled open quantum systems with tensor network methods

Quantum-Train with Tensor Network Mapping Model and Distributed Circuit Ansatz

Efficient Representation Of Topologically Ordered States With Restricted Boltzmann Machines

Monotone deep Boltzmann machines

Purifying Deep Boltzmann Machines for Thermal Quantum States

Tensor Network Computations That Capture Strict Variationality, Volume Law Behavior, and the Efficient Representation of Neural Network States