Abstract:In many fields, including biology, medicine, physics, chemistry, economy and actuarial science, data can be represented as the time-to-event of a finite state Markov chain model. The distribution of time intervals between successive recorded events is known as a phase-type distribution. We demonstrate that in cases where the eigenvalues of the Markov chain transition matrix are distinct (non-degenerate), the phase-type distribution is multi-exponential. We then pose and solve an inverse problem: given knowledge of the phase-type distribution, can we determine the transition rate parameters of the underlying Markov chain? To tackle this challenge, we initially convert the inverse problem into a computer algebraic task, involving the solution of a system of polynomial equations. These equations are symmetrized with respect to the parameters of the phase-type distribution. For a specific subset of Markov models that we refer to as "solvable," the inverse problem yields a unique solution, up to transformations by finite symmetries. We outline a recursive approach to compute these solutions for specific families of models, regardless of their number of states. Additionally, we use the Thomas decomposition technique to calculate solutions for models possessing 2, 3, or 4 states. Interestingly, we show that models having the same number of states but different transition graphs can yield identical phase-distributions. In such "Rashomon effect" scenarios, time-to-event data permits the formulation of multiple models and interpretations, all of which are consistent with the observed experimental data. To differentiate among these models, we propose additional distinguishing properties beyond just the time until the next event. In order to prove its applicability, we discuss how this method can be used to infer models of transcription regulation from transcriptional bursting data.

Embedding of Markov matrices for d ⩽ 4

Embedding of Markov matrices for $d\leqslant 4$

Markov invariants for phylogenetic rate matrices derived from embedded submodels

A solution to the reversible embedding problem for finite Markov chains

Geometric Aspects of Data-Processing of Markov Chains

Markov Bases: A 25 Year Update

Lie geometry of 2x2 Markov matrices

A multiple coupon collection process and its Markov embedding structure

On the algebra of equal-input matrices in time-inhomogeneous Markov flows

Markovian embedding of nonlocal equations using spectral representation

On sampling graphical Markov models

Markov chains and mappings of distributions on compact spaces

Reversible Mcmc on Markov Equivalence Classes of Sparse Directed Acyclic Graphs

A Markovian Perspective on the Classical Occupancy Problem with a Generalization to Pure Birth Processes

Identifying Markov chain models from time-to-event data: an algebraic approach

Quantum-embeddable stochastic matrices

Hoeffding's lemma for Markov Chains and its applications to statistical learning

Markov Observation Models

Markov chains and mappings of distributions on compact spaces II: Numerics and Conjectures

Concentration Bounds for Co-occurrence Matrices of Markov Chains.

Information divergences of Markov chains and their applications