Abstract:Many existing results on statistical learning theory are based on the assumption that samples are independently and identically distributed (i.i.d.). However, the assumption of i.i.d. samples is not suitable for practical application to problems in which samples are time dependent. In this paper, we are mainly concerned with the empirical risk minimization (ERM) based learning process for time-dependent samples drawn from a continuous-time Markov chain. This learning process covers many kinds of practical applications, e.g., the prediction for a time series and the estimation of channel state information. Thus, it is significant to study its theoretical properties including the generalization bound, the asymptotic convergence, and the rate of convergence. It is noteworthy that, since samples are time dependent in this learning process, the concerns of this paper cannot (at least straightforwardly) be addressed by existing methods developed under the sample i.i.d. assumption. We first develop a deviation inequality for a sequence of time-dependent samples drawn from a continuous-time Markov chain and present a symmetrization inequality for such a sequence. By using the resultant deviation inequality and symmetrization inequality, we then obtain the generalization bounds of the ERM-based learning process for time-dependent samples drawn from a continuous-time Markov chain. Finally, based on the resultant generalization bounds, we analyze the asymptotic convergence and the rate of convergence of the learning process.

Continuous-time statistics and generalized relaxation equations

Continuous-time random walk model of relaxation of two-state systems

Occupation time statistics for non-Markovian random walks

On properties of Continuous-Time Random Walks with Non-Poissonian jump-times

Anomalous relaxation in quantum systems and the non-Markovian stochastic Liouville equation

Fluctuations around equilibrium laws in ergodic continuous-time random walks

Continuous Time Random Walks with Internal Dynamics and Subdiffusive Reaction-Diffusion Equations

Doubly stochastic continuous time random walk

Singular relaxation of a random walk in a box with a Metropolis Monte Carlo dynamics

Generalization Bounds of ERM-based Learning Processes for Continuous-Time Markov Chains.

Long-time asymptotics of stochastic reaction systems

Large deviations for Markov processes with stochastic resetting : analysis via the empirical density and flows or via excursions between resets

Asymptotic relaxation in quantum Markovian dynamics

Diffusion and Fokker-Planck-Smoluchowski Equations with Generalized Memory Kernel

Correlated continuous time random walks

Interlacing Relaxation and First-Passage Phenomena in Reversible Discrete and Continuous Space Markovian Dynamics

Justice in the Shadow of Self-Interest. An Experiment on Redistributive Behavior

Biased continuous-time random walks with Mittag-Leffler jumps

Ergodicity of Langevin Dynamics and its Discretizations for Non-smooth Potentials

Coupled continuous time random walks in finance

Thermodynamics of chaotic relaxation processes