Abstract:Interpreting partial information collected from systems subject to noise is a key problem across scientific disciplines. Theoretical frameworks often focus on the dynamics of variables that result from coarse-graining the internal states of a physical system. However, most experimental apparatuses can only detect a partial set of transitions, while internal states are inaccessible. Here, we consider an observer who records a time series of occurrences of one or several transitions performed by a system, under the assumption that its underlying dynamics is Markovian. We pose the question of how one can use the transitions' information to make inferences of dynamical, thermodynamical, and biochemical properties. First, elaborating on first-passage time techniques, we derive analytical expressions for the probabilities of consecutive transitions and the time elapsed between them. Second, we derive a lower bound for the entropy production rate that equals the sum of two non-negative contributions, one due to the statistics of transitions and a second due to the statistics of inter-transition times. We also show that when only one current is measured, our estimate still detects irreversibility even in the absence of net currents. We illustrate the developed framework in experimentally-validated biophysical models of kinesin and dynein molecular motors, and in a minimal model for template-directed polymerization. Our results reveal that while entropy production is entailed in the statistics of two successive transitions of the same type, the statistics of two different successive transitions can probe the existence of an underlying disorder in the motion of a molecular motor. Taken all together, our results highlight the power of inference from transition statistics ranging from thermodynamic quantities to network-topology properties of Markov processes.

Maximum entropy estimation of transition probabilities of reversible Markov chains

Maximum Likelihood Estimation for Markov Chains

Non-asymptotic Estimates for Markov Transition Matrices with Rigorous Error Bounds

Estimation and uncertainty of reversible Markov models

On the Complexity of Computing Maximum Entropy for Markovian Models.

Reversibility and Entropy Production of Inhomogeneous Markov Chains

Geometric ergodicity of trans-dimensional Markov chain Monte Carlo algorithms

Large Deviations Properties of Maximum Entropy Markov Chains from Spike Trains

Thermodynamic inference in partially accessible Markov networks: A unifying perspective from transition-based waiting time distributions

Maxentropy completion and properties of some partially defined Stationary Markov chains

Spectrum of large random reversible Markov chains: two examples

Cutoff for mixtures of permuted Markov chains: reversible case

Maximum Entropy Principle, Equal Probability a Priori and Gibbs Paradox

What to learn from a few visible transitions' statistics?

Maximum Caliber Inference and the Stochastic Ising Model

The Statistical Discrepancy between the IGM and Dark Matter Fields: One-Point Statistics

Statistical Methods in Markov Chains

Markov Processes Follow from the Principle of Maximum Caliber

Entropy estimation for partially accessible Markov networks based on imperfect observations: Role of finite resolution and finite statistics

Metastability of Exponentially Perturbed Markov Chains

Approximate maximum entropy principles via Goemans-Williamson with applications to provable variational methods