Abstract:Hyperbolic cross approximation is a special type of multivariate approximation. Recently, driven by applications in engineering, biology, medicine and other areas of science new challenging problems have appeared. The common feature of these problems is high dimensions. We present here a survey on classical methods developed in multivariate approximation theory, which are known to work very well for moderate dimensions and which have potential for applications in really high dimensions. The theory of hyperbolic cross approximation and related theory of functions with mixed smoothness are under detailed study for more than 50 years. It is now well understood that this theory is important both for theoretical study and for practical applications. It is also understood that both theoretical analysis and construction of practical algorithms are very difficult problems. This explains why many fundamental problems in this area are still unsolved. Only a few survey papers and monographs on the topic are published. This and recently discovered deep connections between the hyperbolic cross approximation (and related sparse grids) and other areas of mathematics such as probability, discrepancy, and numerical integration motivated us to write this survey. We try to put emphases on the development of ideas and methods rather than list all the known results in the area. We formulate many problems, which, to our knowledge, are open problems. We also include some very recent results on the topic, which sometimes highlight new interesting directions of research. We hope that this survey will stimulate further active research in this fascinating and challenging area of approximation theory and numerical analysis.

Multivariate Smooth Symmetrized and Perturbed Hyperbolic Tangent Neural Network Approximation over Infinite Domains

Multivariate Perturbed Hyperbolic Tangent-Activated Singular Integral Approximation

Approximation by Symmetrized and Perturbed Hyperbolic Tangent Activated Convolution-Type Operators

Approximation by non-symmetric networks for cross-domain learning

Approximation Theory of Tree Tensor Networks: Tensorized Univariate Functions -- Part II

Multivariate Jackson-type inequality for a new type neural network approximation

Approximation by multivariate generalized Poisson–Cauchy type singular integral operators

Universal approximation results for neural networks with non-polynomial activation function over non-compact domains

Approximation Theory of Tree Tensor Networks: Tensorized Multivariate Functions

Approximation and interpolation of deep neural networks

Weighted Sobolev Approximation Rates for Neural Networks on Unbounded Domains

Simultaneous approximation by neural network operators with applications to Voronovskaja formulas

Low dimensional approximation and generalization of multivariate functions on smooth manifolds using deep ReLU neural networks

Hyperbolic Cross Approximation

Approximate Interpolation by a Class of Neural Networks in Lebesgue Metric.

Neural network approximation of coarse-scale surrogates in numerical homogenization

Optimal approximation using complex-valued neural networks

Simultaneous approximation of a smooth function and its derivatives by deep neural networks with piecewise-polynomial activations

Approximation of RKHS Functionals by Neural Networks

Approximation by approximate interpolation neural networks with single hidden layer