Abstract:In this work, we study non-asymptotic bounds on correlation between two time realizations of stable linear systems with isotropic Gaussian noise. Consequently, via sampling from a sub-trajectory and using \emph{Talagrands'} inequality, we show that empirical averages of reward concentrate around steady state (dynamical system mixes to when closed loop system is stable under linear feedback policy ) reward , with high-probability. As opposed to common belief of larger the spectral radius stronger the correlation between samples, \emph{large discrepancy between algebraic and geometric multiplicity of system eigenvalues leads to large invariant subspaces related to system-transition matrix}; once the system enters the large invariant subspace it will travel away from origin for a while before coming close to a unit ball centered at origin where an isotropic Gaussian noise can with high probability allow it to escape the current invariant subspace it resides in, leading to \emph{bottlenecks} between different invariant subspaces that span $\mathbb{R}^{n}$, to be precise : system initiated in a large invariant subspace will be stuck there for a long-time: log-linear in dimension of the invariant subspace and inversely to log of inverse of magnitude of the eigenvalue. In the problem of Ordinary Least Squares estimate of system transition matrix via a single trajectory, this phenomenon is even more evident if spectrum of transition matrix associated to large invariant subspace is explosive and small invariant subspaces correspond to stable eigenvalues. Our analysis provide first interpretable and geometric explanation into intricacies of learning and concentration for random dynamical systems on continuous, high dimensional state space; exposing us to surprises in high dimensions

On the Distribution and Convergence of Feature Space in Self-Organizing Maps

Self-representative kernel concept factorization

The Self-Intersections of A Gaussian Random Field

Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization

Learning nonlinear manifolds based on mixtures of localized linear manifolds under a self-organizing framework

Convergence Theorems for the Kohonen Feature Mapping Algorithms with VLRPs

Convergence to a Self-Normalized G-Brownian Motion

Modeling Nonlinear Manifolds with Mixtures of Localized Principal Subspaces under a Self-Organizing Framework

On Eigenvalues of a High-Dimensional Spatial-Sign Covariance Matrix

Non-Euclidean Self-Organizing Maps

SMLSOM: The shrinking maximum likelihood self-organizing map

Feature Map for Quantum Data in Classification

Learning and Concentration for High Dimensional Linear Gaussians: an Invariant Subspace Approach

Learning conditional distributions on continuous spaces

Convergence of Continuous Normalizing Flows for Learning Probability Distributions

Deep Scalable Supervised Quantization by Self-Organizing Map

Weak Convergence for Self-Normalized Partial Sum Processes in the Skorokhod M1 Topology with Applications to Regularly Varying Time Series

Statistical Convergence Rates of Optimal Transport Map Estimation between General Distributions

Convergence of densities of spatial averages of the linear stochastic heat equation

Uniform Convergence Rate of the Kernel Density Estimator Adaptive to Intrinsic Volume Dimension

Self-organizing maps and generalization: an algorithmic description of Numerosity and Variability Effects