Abstract:We study the approximation by tensor networks (TNs) of functions from classical smoothness classes. The considered approximation tool combines a tensorization of functions in $L^p([0,1))$, which allows to identify a univariate function with a multivariate function (or tensor), and the use of tree tensor networks (the tensor train format) for exploiting low-rank structures of multivariate functions. The resulting tool can be interpreted as a feed-forward neural network, with first layers implementing the tensorization, interpreted as a particular featuring step, followed by a sum-product network with sparse architecture. In part I of this work, we presented several approximation classes associated with different measures of complexity of tensor networks and studied their properties. In this work (part II), we show how classical approximation tools, such as polynomials or splines (with fixed or free knots), can be encoded as a tensor network with controlled complexity. We use this to derive direct (Jackson) inequalities for the approximation spaces of tensor networks. This is then utilized to show that Besov spaces are continuously embedded into these approximation spaces. In other words, we show that arbitrary Besov functions can be approximated with optimal or near to optimal rate. We also show that an arbitrary function in the approximation class possesses no Besov smoothness, unless one limits the depth of the tensor network.

Approximation by $T$ means with respect to Vilenkin system in Lebesgue spaces and Lipschitz classes

Approximation by Nörlund means with respect to Vilenkin system in Lebesgue spaces

Approximation theorems for multivariate Taylor-Abel-Poisson means

Approximation by matrix transform means with respect to the Walsh system in Lebesgue spaces

On Best Approximation by Nonconvex Sets and Perturbation of Nonconvex Inequality Systems in Hilbert Spaces.

Anisotropic Best Τc -Approximation in Normed Spaces

On approximation of functions, conjugate to the functions of several variables belonging to weighted Lipschitz and Zygmund classes

Lipschitz-free spaces over strongly countable-dimensional spaces and approximation properties

Approximation in Hölder Spaces

Approximation by α-Bernstein-Kantorovich Type Operators for Functions of One and Two Variables

Approximate Solutions for Abstract Inequality Systems

Approximation Theory of Tree Tensor Networks: Tensorized Univariate Functions -- Part II

Approximation on Variable Exponent Spaces by Linear Integral Operators

Approximation in Hilbert spaces of the Gaussian and related analytic kernels

Approximation results for compact Vaisman manifolds

Geometric and arithmetic aspects of approximation vectors

Approximation by modified -gamma-type operators

On approximation by tight wavelet frames on Vilenkin groups

Infinite-dimensional integration and $L^2$-approximation on Hermite spaces

Approximation of functions of many variables from the generalization Nikol'skii-Besov type classes in the uniform and integral metrics