Martingales for physicists: a treatise on stochastic thermodynamics and beyond

Édgar Roldán,Izaak Neri,Raphael Chetrite,Shamik Gupta,Simone Pigolotti,Frank Jülicher,Ken Sekimoto

DOI: https://doi.org/10.1080/00018732.2024.2317494

IF: 23.75

2024-05-24

Advances In Physics

Abstract:We review the theory of martingales as applied to stochastic thermodynamics and stochastic processes in physics more generally.

physics, condensed matter

What problem does this paper attempt to address?

Martingales for physicists: A treatise on stochastic thermodynamics and beyond

Édgar Roldán,Izaak Neri,Raphael Chetrite,Shamik Gupta,Simone Pigolotti,Frank Jülicher,Ken Sekimoto

2023-12-19

Abstract:We review the theory of martingales as applied to stochastic thermodynamics and stochastic processes in physics more generally.

Statistical Mechanics,Mathematical Physics,Probability,Biological Physics
A generalization of the martingale property of entropy production in stochastic systems

Xiangting Li,Tom Chou

2024-11-13

Abstract:By decoupling forward and backward stochastic trajectories, we develop a family of martingales and work theorems for the same stochastic process. We achieve this by introducing an alternative work theorem derivation that uses tools from stochastic calculus instead of path integrals. Our derivation applies to both overdamped and underdamped Langevin dynamics and generalizes work theorems so that they connect new quantities in stochastic processes, potentially revealing new applications in dissipative systems.

Statistical Mechanics,Mathematical Physics,Probability
Martingale Structure for General Thermodynamic Functionals of Diffusion Processes under Second-Order Averaging

Ge Hao,Jia Chen,Jin Xiao

DOI: https://doi.org/10.1007/s10955-021-02798-y

2021-01-01

Journal of Statistical Physics

Abstract:Novel hidden thermodynamic structures have recently been uncovered during theinvestigation of nonequilibrium thermodynamics for multiscale stochasticprocesses. Here we reveal the martingale structure for a general thermodynamicfunctional of inhomogeneous singularly perturbed diffusion processes undersecond-order averaging, where a general thermodynamic functional is defined asthe logarithmic Radon-Nykodim derivative between the laws of the originalprocess and a comparable process (forward case) or its time reversal (backwardcase). In the forward case, we prove that the regular and anomalous parts of athermodynamic functional are orthogonal martingales. In the backward case,while the regular part may not be a martingale, we prove that the anomalouspart is still a martingale. With the aid of the martingale structure, we provethe integral fluctuation theorem satisfied by the regular and anomalous partsof a general thermodynamic functional. Further extensions and applications tostochastic thermodynamics are also discussed, including the martingalestructure and fluctuation theorems for the regular and anomalous parts ofentropy production and housekeeping heat in the absence or presence of oddvariables.
Introduction to Martingales

Rohan Shah

2024-07-17

Abstract:This paper introduces Martingales by covering introductory measure theory concepts and the Lebesgue Integration and Conditional Expectation. It follows up with proofs of Kolomorgov's Theorem on conditional expectations, the Martingale Property, and the Pythagorean Theorem on Martingales. Finally, it ends with Martingales' applications in finance.

Probability
Continuous Martingales and Brownian Motion

Daniel Revuz,Marc Yor

DOI: https://doi.org/10.1007/978-3-662-21726-9

1991-01-01

Abstract:This book focuses on the probabilistic theory ofBrownian motion. This is a good topic to center a discussion around because Brownian motion is in the intersec tioll of many fundamental classes of processes. It is a continuous martingale, a Gaussian process, a Markov process or more specifically a process with in dependent increments; it can actually be defined, up to simple transformations, as the real-valued, centered process with independent increments and continuous paths. It is therefore no surprise that a vast array of techniques may be success fully applied to its study and we, consequently, chose to organize the book in the following way. After a first chapter where Brownian motion is introduced, each of the following ones is devoted to a new technique or notion and to some of its applications to Brownian motion. Among these techniques, two are of para mount importance: stochastic calculus, the use ofwhich pervades the whole book and the powerful excursion theory, both of which are introduced in a self contained fashion and with a minimum of apparatus. They have made much easier the proofs of many results found in the epoch-making book of Itö and McKean: Diffusion Processes and their Sampie Paths, Springer (1965).
Additive martingales of the branching Brownian motion

Louis Chataignier

2024-07-30

Abstract:In this thesis, we study asymptotic properties of the standard branching Brownian motion, with a specific emphasis on the additive martingales at high temperature. We start by presenting classic and fundamental tools for our investigation. Subsequently, we establish various convergence results that enhance our understanding of the model. In particular, these results include the determination of particles contributing to the additive martingales, the description of the fluctuations of these martingales around their limits, and an approximation of the so-called overlap distribution. Regarding the latter, we believe this is the first time that such an approximation is given. Remarkably, we identify a specific regime in which stable distributions emerge.

Probability
Limit Theorems for Stochastic Processes

Jean Jacod,Albert N. Shiryaev

DOI: https://doi.org/10.1007/978-3-662-05265-5

2003-01-01

Abstract:Initially the theory of convergence in law of stochastic processes was developed quite independently from the theory of martingales, semimartingales and stochastic integrals. Apart from a few exceptions essentially concerning diffusion processes, it is only recently that the relation between the two theories has been thoroughly studied. The authors of this Grundlehren volume, two of the international leaders in the field, propose a systematic exposition of convergence in law for stochastic processes, from the point of view of semimartingale theory, with emphasis on results that are useful for mathematical theory and mathematical statistics. This leads them to develop in detail some particularly useful parts of the general theory of stochastic processes, such as martingale problems, and absolute continuity or contiguity results. The book contains an introduction to the theory of martingales and semimartingales, random measures stochastic integrales, Skorokhod topology, etc., as well as a large number of results which have never appeared in book form, and some entirely new results. It should be useful to the professional probabilist or mathematical statistician, and of interest also to graduate students.
Conic Martingales from Stochastic Integrals

Frédéric Vrins,Monique Jeanblanc

DOI: https://doi.org/10.48550/arXiv.1603.07488

2016-03-24

Abstract:In this paper we introduce the concept of conic martingales}. This class refers to stochastic processes having the martingale property, but that evolve within given (possibly time-dependent) boundaries. We first review some results about the martingale property of solution to driftless stochastic differential equations. We then provide a simple way to construct and handle such processes. Specific attention is paid to martingales in $[0,1]$. One of these martingales proves to be analytically tractable. It is shown that up to shifting and rescaling constants, it is the only martingale (with the trivial constant, Brownian motion and Geometric Brownian motion) having a separable coefficient $\sigma(t,y)=g(t)h(y)$ and that can be obtained via a time-homogeneous mapping of Gaussian diffusions. The approach is exemplified to the modeling of stochastic conditional survival probabilities in the univariate (both conditional and unconditional to survival) and bivariate cases.

Probability,Mathematical Finance
Concept of Martingale in random Processes: from Game system to financial Mathematics

V. B. Gisin,E. G. Panov

DOI: https://doi.org/10.26794/22267867-2024-14-2-86-93

2024-07-19

Abstract:The proposed study undertakes an interdisciplinary analysis of the problem of randomness in various forms of social activity. The authors find a significant relation between linguistic analysis and the conclusions of financial mathematics about the possibility of forecasting under conditions of uncertainty. It realizes the intention to find a strategy for profitable actions in random processes. This intention is reflected in the meaning of the concept “martingale”. For centuries it was used to refer to the special capabilities of horse harnesses. Then this term began to denote winning strategies in various gambling games, leading to the enrichment of the one who owns them. The introduction of mathematical calculations into these strategies became one of the foundations of probability theory. In the middle of the last century, the term “martingale” began to denote the process of capital accumulation when implementing a trading strategy in the financial market. In recent years, the concept of martingale began to characterize calculated strategies for playing in the financial market. This opened up the possibility of forming a version of probability theory specially adapted for modeling market phenomena and processes. The emergence of the science of quantum computing and the emergence of new computing capabilities revives the problem of overcoming uncertainty using the means of modern digitalization. Therefore, the concept of martingale, which implies the search for opportunities to control random processes, remains relevant not only for modern economic thought, but also for various areas of social and humanitarian knowledge. Analysis of the nature of randomness and its various manifestations is also relevant for everyday life of modern people. This makes it relevant for educational programs aimed at promoting economic and financial literacy among the population.
A Martingale Approach to Noncommutative Stochastic Calculus

David A. Jekel,Todd A. Kemp,Evangelos A. Nikitopoulos

2023-08-19

Abstract:We present a new approach to noncommutative stochastic calculus that is, like the classical theory, based primarily on the martingale property. Using this approach, we introduce a general theory of stochastic integration and quadratic (co)variation for a certain class of noncommutative processes -- analogous to semimartingales -- that includes both the $q$-Brownian motions and classical $n \times n$ matrix-valued Brownian motions. As applications, we obtain Burkholder-Davis-Gundy inequalities (with $p \geq 2$) for continuous-time noncommutative martingales and a noncommutative Itô formula for "adapted $C^2$ maps," including trace $\ast$-polynomial maps and operator functions associated to the noncommutative $C^2$ scalar functions $\mathbb{R} \to \mathbb{C}$ introduced by Nikitopoulos, as well as the more general multivariate tracial noncommutative $C^2$ functions introduced by Jekel-Li-Shlyakhtenko.

Operator Algebras,Probability
Martingale drift of Langevin dynamics and classical canonical spin statistics

Ken Sekimoto

DOI: https://doi.org/10.1103/physreve.109.014106

IF: 2.707

2024-01-06

Physical Review E

Abstract:A martingale is a stochastic process that encodes a kind of fairness or unbiasedness, which is associated with a reference process. Here we show that, if the reference process xt evolves according to the Langevin equation with drift a(x) and if a(xt) is a martingale, then its amplitude is the Langevin function, which originally described the canonical response of a single classical Heisenberg spin under static field. Furthermore, the asymptotic limit of xt/t obeys the ensemble statistics of such a Heisenberg spin. https://doi.org/10.1103/PhysRevE.109.014106 ©2024 American Physical Society

physics, fluids & plasmas, mathematical
Lindeberg's Central Limit Theorems for Martingale-Like Sequences under Sub-Linear Expectations

Zhang Li-Xin

DOI: https://doi.org/10.1007/s11425-018-9556-7

2020-01-01

Science China Mathematics

Abstract:The central limit theorem of martingales is the fundamental tool for studying the convergence of stochastic processes, especially stochastic integrals and differential equations. In this paper, the central limit theorem and the functional central limit theorem are obtained for martingale-like random variables under the sub-linear expectation. As applications, the Lindeberg’s central limit theorem is obtained for independent but not necessarily identically distributed random variables, and a new proof of the Lévy characterization of a GBrownian motion without using stochastic calculus is given. For proving the results, Rosenthal’s inequality and the exponential inequality for the martingale-like random variables are established.
The fundamental martingale with applications to Markov Random Fields

Kevin Hu,Kavita Ramanan,William Salkeld

2024-05-15

Abstract:We consider collections of SDEs indexed by a graph. Each SDE is driven by an additive Gaussian noise and each drift term interacts with all other SDEs within the graph neighbourhood. We derive the fundamental martingale for a class of Gaussian processes and use this to prove a Girsanov type theorem. Further, we use this to construct a clique factorisation to prove that the law of the interacting SDEs forms a 2-Markov Random Field.

Probability
The Martingale Property in the Context of Stochastic Differential Equations

Johannes Ruf

DOI: https://doi.org/10.1214/ECP.v20-3449

2015-04-27

Abstract:This note studies the martingale property of a nonnegative, continuous local martingale Z, given as a nonanticipative functional of a solution to a stochastic differential equation. The condition states that Z is a (uniformly integrable) martingale if and only if an integral test of a related functional holds.

Probability
Martingale drift of Langevin dynamics and classical canonical spin statistics -- II

Ken Sekimoto

2024-10-19

Abstract:In the previous paper we have shown analytically that, if the drift function of the d-dimensional Langevin equation is the Langevin function with a properly chosen scale factor, then the evolution of the drift function is a martingale associated with the histories generated by the very Langevin equation. Moreover, we numerically demonstrated that those generated histories from a common initial data become asymptotically ballistic, whose orientations obey the classical canonical spin statistics under the external field corresponding to the initial data. In the present paper we provide with an analytical explanation of the latter numerical finding by introducing a martingale in the spin functional space. In a specific context the present result elucidates a new physical aspect of martingale theory.

Statistical Mechanics,Data Analysis, Statistics and Probability
Stochastic thermodynamics for linear kinetic equations

C Van den Broeck,R Toral,C. Van den Broeck,R. Toral

DOI: https://doi.org/10.1103/physreve.92.012127

IF: 2.707

2015-07-22

Physical Review E

Abstract:Stochastic thermodynamics is formulated for variables that are odd under time reversal. The invariance under spatial rotation of the collision rates due to the isotropy of the heat bath is shown to be a crucial ingredient. An alternative detailed fluctuation theorem is derived, expressed solely in terms of forward statistics. It is illustrated for a linear kinetic equation with kangaroo rates.

physics, fluids & plasmas, mathematical
Martingale approximation of non-stationary stochastic processes

Dalibor Volny

DOI: https://doi.org/10.1142/S0219493706001694

2023-11-06

Abstract:We generalise the martingale-coboundary representation of discrete time stochastic processes to the non-stationary case and to random variables in Orlicz spaces. Related limit theorems (CLT, invariance principle, log log law, probabilities of large deviations) are studied.

Probability
Martingale integrals over Poissonian processes and the Ito-type equations with white shot noise

Ryszard Zygadło

DOI: https://doi.org/10.1103/PhysRevE.68.046117

Abstract:The construction of the Ito-type stochastic integrals and differential equations for compound Poisson processes is provided. The general martingale and nonanticipating properties of the ordinary (Gaussian) Ito theory are conserved. These properties appear particularly important if the stochastic description has to be proposed according to game theory or the linear relaxation (or the exponential growth) requirements. In contrast to the ordinary Ito theory the (uncorrelated) parametric fluctuation of a definite sign can be still modeled by asymmetric white shot noise, so the general scope of applications is not restricted by the positivity requirements. The possible use of the developed formalism in econophysics is addressed.
Controlled Measure-Valued Martingales: a Viscosity Solution Approach

Alexander M.G. Cox,Sigrid Källblad,Martin Larsson,Sara Svaluto-Ferro

2023-08-27

Abstract:We consider a class of stochastic control problems where the state process is a probability measure-valued process satisfying an additional martingale condition on its dynamics, called measure-valued martingales (MVMs). We establish the `classical' results of stochastic control for these problems: specifically, we prove that the value function for the problem can be characterised as the unique solution to the Hamilton-Jacobi-Bellman equation in the sense of viscosity solutions. In order to prove this result, we exploit structural properties of the MVM processes. Our results also include an appropriate version of Itô's lemma for controlled MVMs. We also show how problems of this type arise in a number of applications, including model-independent derivatives pricing, the optimal Skorokhod embedding problem, and two player games with asymmetric information.

Probability,Analysis of PDEs,Optimization and Control,Mathematical Finance

Martingales for physicists: a treatise on stochastic thermodynamics and beyond

Martingales for physicists: A treatise on stochastic thermodynamics and beyond

A generalization of the martingale property of entropy production in stochastic systems

Martingale Structure for General Thermodynamic Functionals of Diffusion Processes under Second-Order Averaging

Introduction to Martingales

Continuous Martingales and Brownian Motion

Additive martingales of the branching Brownian motion

Limit Theorems for Stochastic Processes

Conic Martingales from Stochastic Integrals

Concept of Martingale in random Processes: from Game system to financial Mathematics

A Martingale Approach to Noncommutative Stochastic Calculus

Martingale drift of Langevin dynamics and classical canonical spin statistics

Lindeberg's Central Limit Theorems for Martingale-Like Sequences under Sub-Linear Expectations

The fundamental martingale with applications to Markov Random Fields

The Martingale Property in the Context of Stochastic Differential Equations

Martingale drift of Langevin dynamics and classical canonical spin statistics -- II

Stochastic thermodynamics for linear kinetic equations

Martingale approximation of non-stationary stochastic processes

Martingale integrals over Poissonian processes and the Ito-type equations with white shot noise

Controlled Measure-Valued Martingales: a Viscosity Solution Approach