Explicit Solution of A Kolmogorov Equation

S. -T. Yau,S. S. -T. Yau

DOI: https://doi.org/10.1007/bf01182625

1996-01-01

Abstract:The original motivation of this study was to solve the Duncan-Mortensen-Zakai equation in nonlinear filtering theory. It was found that to do so one has to solve the so-called Kolmogorov equation. A scheme for solving the Kolmogorov equation explicitly is outlined.< >

What problem does this paper attempt to address?

Recent Advance In Computing Kolmogorov Equation Arising From Nonlinear Filtering

Sst Yau,X Wu,Kp Lin

DOI: https://doi.org/10.1109/CDC.1998.757918

1998-01-01

Abstract:It is well known that Kolmogorov equation is a fundamental equation in Applied Science, especially in Electrical Engineering. In this paper, we present two closed form solutions to Kolmogorov equation which plays an essential role in nonlinear filtering.
Explicit Solution to Generalized Time-Varying Kolmogorov Equation

Xi Wu,Yau, S.S.-T.

DOI: https://doi.org/10.1109/cdc.1999.830912

1999-01-01

Abstract:In this paper, we give a closed formal solution to generalized Kolmogorov equation. Estimates of the formal solution are obtained. From the truncated formal solution, we are able to construct the convergent fundamental solution and estimate the time interval on which our solution converges
Finite-dimensional Filters with Nonlinear Drift. V: Solution to Kolmogorov Equation Arising from Linear Filtering with Non-Gaussian Initial Condition

ZG Liang,SST Yau,ST Yau

DOI: https://doi.org/10.1109/7.625130

IF: 3.491

1997-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:Despite its usefulness, the Kalman-Bucy filter is not perfect. One of its weaknesses is that it needs a Gaussian assumption on the initial data. Recently Yau and Yau introduced a new direct method to solve the estimation problem for linear filtering with non-Gaussian initial data. They factored the problem into two parts: (1) the on-line solution of a finite system of ordinary differential equations (ODEs), and (2) the off-line calculation of the Kolmogorov equation. Here we derive an explicit closed-form solution of the Kolmogorov equation. We also give some properties and conduct a numerical study of the solution.
Explicit Solution of DMZ Equation in Nonlinear Filtering Via Solution of ODEs.

SST Yau,YT Lai

DOI: https://doi.org/10.1109/tac.2003.809169

IF: 6.549

2003-01-01

IEEE Transactions on Automatic Control

Abstract:In this note, we develop a real-time and accurate solution for nonlinear filtering problems based on the Gaussian distribution. Specifically, we present an explicit solution of the Duncan-Mortensen-Zakai (DMZ) equation of the Yau filtering system, which includes the linear filtering system and exact filtering system. The solution is given in terms of a solution of a system of ordinary differential equations. In particular, our method can be implemented in hardware. The complexity of our algorithms is the same as those of Kalman-Bucy filters in the case of linear filtering systems.
Special Solutions to Some Kolmogorov Equations Arising from Cubic Sensor Problems.

Ruxu Du,Lixing Jia,Stephen S.-T. Yau

DOI: https://doi.org/10.4310/cis.2007.v7.n2.a6

2007-01-01

Abstract:1. Introduction. Ever since the technique of the Kalman-Bucy filter was pop- ularized, there has been an intense interest in developing nonlinear filtering theory. Basically we have a signal or state process x = {xt} which is usually not observable. What we can observe is a related process y = {yt}. The goal of nonlinear filtering is to determine the conditional expectation of the form E(�(xt) : ys,0 � st) whereis any C ∞ function or even better to compute the entire conditional probability density �(t,x) of xt given the observation history {ys : 0 � st}. In practical applications, it is preferable that the computation of conditional probability density be preformed recursively in terms of a statistic � = {�t}, which can be updated by using only the latest observations. In some cases, �t is computable with a finite system of differential equations driven by y. This leads to the ideal notion of finite dimensional recursive filter. By definition such a filter is a system: dt = �(�t)dt + p X i=1 �i(�t)dyit
Direct Method for Time-Varying Nonlinear Filtering Problems

Xiuqiong Chen,Xue Luo,Stephen S. -T. Yau

DOI: https://doi.org/10.1109/taes.2017.2651650

IF: 3.491

2017-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:This paper discusses how to solve a filtering problem for a class of continuous nonlinear time-varying systems via the Duncan-Mortensen-Zakai (DMZ) equation. In this paper, the original DMZ equation is changed into the Kolmogorov forward equation (KFE) by exponential transformations in each time interval, and then, under some assumptions, the KFE can be transformed into a time-varying Schrodinger equation, which can be solved explicitly. The novelty of this paper lies in how to transform the KFE into the Schrodinger equation. As a direct application, the results of the paper "Nonlinear filtering and time varying Schrodinger equation" are extended for time-varying Yau systems.
Real Time Solution of Duncan-Mortensen-Zakai Equation Without Memory

Stephen S. -T. Yau,Shing-Tung Yau

DOI: https://doi.org/10.1109/cdc.2008.4739506

2008-01-01

Abstract:It is well known that the nonlinear filtering problem has important applications in both military and commercial industries. The central problem of nonlinear filtering is to solve the DMZ equation in real time and memoryless manner. The purpose of this paper is to show that, under very mild conditions (which essentially say that the growth of the observation |h| is greater than the growth of the drift |f|), the DMZ equation admits a unique nonnegative weak solution u which can be approximated by a solution uR of the DMZ equation on the ball BR with uR|¿BR = 0. The error of this approximation is bounded by a function of R which tends to zero as R goes to infinity. The solution uR can in turn be approximated efficiently by an algorithm depending only on solving the observation-independent Kolmogorov equation on BR. In theory, our algorithm can solve basically all engineering problems in real time manner. Specifically, we show that the solution obtained from our algorithms converges to the solution of the DMZ equation in L1-sense. Equally important, we have a precise error estimate of this convergence which is important in numerical computation.
Wavelet-Galerkin Method for the Kolmogorov Equation

Zhigang Liang,Stephen S.-T. Yau

DOI: https://doi.org/10.1016/j.mcm.2003.07.016

2004-01-01

Abstract:It is well known that the Kolmogorov equation plays an important role in applied science. For example, the nonlinear filtering problem, which plays a key role in modern technologies, was solved by Yau and Yau [1] by reducing it to the off-line computation of the Kolmogorov equation. In this paper, we develop a theorical foundation of using the wavelet-Galerkin method to solve linear parabolic P.D.E. We apply our theory to the Kolmogorov equation. We give a rigorous proof that the solution of the Kolmogorov equation can be approximated very well in any finite domain by our wavelet-Galerkin method. An example is provided by using Daubechies D 4 scaling functions.
Linear Filtering with Nonlinear Observations

SST Yau,ST Yau,CL Yan

DOI: https://doi.org/10.1109/cdc.2004.1430360

2004-01-01

Abstract:For all known finite dimensional filters, one always needs the condition that the observation terms are degree one polynomials. On the other hand, in many practical examples, e.g. tracking problems, the observation terms may be nonlinear. In this paper, we develop a new method to treat linear filtering problems with nonlinear observation terms. We first show that real time computation of Duncan-Mortensen-Zakai (DMZ) equation can be reduced to off time computation of Kolmogorov equation. An explicit algorithm of such a reduction is provided. We next show that if the drifts are linear and the observation terms are nonlinear with linear growths, then the Kolmogorov equation can be solved in real time via a system of ODEs. Consequently, the nonlinear filtering problem with linear drifts and nonlinear observations with linear growth can be solved in real time and memoryless manner.
Explicit Solution of DMZ Equation

GQ Hu,SST Yau

DOI: https://doi.org/10.1109/cdc.1997.649666

1997-01-01

Abstract:We consider the explicit solution of the Duncan-Mortensen-Zakai (DMZ) equation for the finite dimensional filtering system. We show that the nonlinear filtering system under the Hu-Yau conditions can be solved explicitly with an arbitrary initial condition by solving and system of ordinary differential equations and a Kolmogorov-type equation. Let n be the dimension of state space. We show that we need only n sufficient statistics in order to solve the DMZ equation
Direct Method for Yau Filtering System with Nonlinear Observations

Ji Shi,Zhiyu Yang,Stephen S. -T. Yau

DOI: https://doi.org/10.1080/00207179.2017.1288300

IF: 2.102

2017-01-01

International Journal of Control

Abstract:For all known finite dimensional filters, one always assumes that the observation terms be degree one polynomials. However, in practice, the observation terms may be nonlinear, e.g. tracking problems. In this paper, we consider the Yau filtering system (partial derivative f(j)/partial derivative x(i) - partial derivative f(i)/partial derivative x(j) - c(ij) is constant for all i, j) with nonlinear observation terms and arbitrary initial condition. The novelty of the paper lies in (i) the real time computation of the solution of the Duncan-Mortensen-Zakai (DMZ) equation is reduced to the computation of Kolmogorov equation. Based on Gaussian approximation of the initial condition, the Kolmogorov equation can be solved in terms of ordinary differential equations; (ii) For a given probability density function, we give a new and original approach to do Gaussian approximation which is very effective and simple. The direct method developed here can be easily implemented in a real time and memoryless way. Besides, we do not need the controllability and observability assumption. Compared to the extended Kalman filter, our method is much stable and has theoretical proof. The numerical experiments show that the proposed Gaussian approximation method is very effective and our method can track the states very well.
Real Time Solution of the Nonlinear Filtering Problem Without Memory Ii

ST Yau,SST Yau

DOI: https://doi.org/10.1137/050648353

IF: 2.2

2008-01-01

SIAM Journal on Control and Optimization

Abstract:It is well known that the nonlinear filtering problem has important applications in both military and commercial industries. The central problem of nonlinear filtering is to solve the Duncan-Mortensen-Zakai ( DMZ) equation in real time and in a memoryless manner. The purpose of this paper is to show that, under very mild conditions ( which essentially say that the growth of the observation vertical bar h vertical bar is greater than the growth of the drift vertical bar f vertical bar), the DMZ equation admits a unique nonnegative weak solution u which can be approximated by a solution u(R) of the DMZ equation on the ball B-R with u(R)vertical bar(partial derivative BR) = 0. The error of this approximation is bounded by a function of R which tends to zero as R goes to infinity. The solution uR can in turn be approximated efficiently by an algorithm depending only on solving the observation-independent Kolmogorov equation on BR. In theory, our algorithm can solve basically all engineering problems in real time. Specifically, we show that the solution obtained from our algorithms converges to the solution of the DMZ equation in the L-1 sense. Equally important, we have a precise error estimate of this convergence, which is important in numerical computation.
Schr&#x00F6;dinger Equation with Quartic Potential and Nonlinear Filtering Problem

Der–Chen Chang,Stephen S.‐T. Yau,Ke-Pao Lin

DOI: https://doi.org/10.1109/cdc.2009.5400128

2009-01-01

Abstract:The celebrated work of Yau and Yau solved the nonlinear filtering problem in theory in the following manner. They reduced the problem of solving the Duncan-Mortensen-Zakai equation in real-time to the off-time solution of a Kolmogorov type equation. For the Yau filtering system, this Kolmogorov equation can be transformed as the Schrodinger equation. In this paper, we shall describe the fundamental solution of this Schrodinger equation with quartic potential.
Finite-dimensional Filters with Nonlinear Drift X: Explicit Solution of DMZ Equation

SST Yau,GQ Hu

DOI: https://doi.org/10.1109/9.898707

IF: 6.549

2001-01-01

IEEE Transactions on Automatic Control

Abstract:In this note, we consider the explicit solution of Duncan-Mortensen-Zakai (DMZ) equation for the finite-dimensional filtering system. We show that Yau filtering system ((partial derivativef(j)/partial derivativex(i)) - (partial derivativef(i)/partial derivativex(j)) = c(ij) = constant for all (i, j) can be solved explicitly with an arbitrary initial condition by solving a system of ordinary differential equations and a Kolmogorov-type equation. Let n be the dimension of state space. We show that we need only n sufficient statistics in order to solve the DMZ equation.
An Efficient Algorithm of Yau-Yau Method for Solving Nonlinear Filtering Problems.

Mei-Heng Yueh,Wen-Wei Lin,Shing-Tung Yau

DOI: https://doi.org/10.4310/cis.2014.v14.n2.a3

2014-01-01

Communications in Information and Systems

Abstract:It is well known that the nonlinear filter has important applications in military, engineering and commercial industries. In this paper, we propose efficient and accurate numerical algorithms for the realization of the Yau-Yau method for solving nonlinear filtering problems by using finite difference schemes. The Yau-Yau method reduces the nonlinear filtering problem to the initial-value problem of Kolmogorov equations. We first solve this problem by the implicit Euler method, which is stable in most cases, but costly. Then, we propose a quasi-implicit Euler method which is feasible for acceleration by fast Fourier transformations. Furthermore, we propose a superposition technique which enables us to deal with the nonlinear filtering problem in an off-time process and thus, save a large amount of computational cost. Next, we prove that the numerical solutions of Kolmogorov equations by our schemes are always nonnegative in each iteration. Consequently, our iterative process preserves the probability density functions. In addition, we prove convergence of our schemes under some mild conditions. Numerical results show that the proposed algorithms are efficient and promising.
Complete Real Time Solution of the General Nonlinear Filtering Problem Without Memory

Xue Luo,Stephen S.-T. Yau

DOI: https://doi.org/10.1109/tac.2013.2264552

IF: 6.549

2013-10-01

IEEE Transactions on Automatic Control

Abstract:It is well known that the nonlinear filtering problem has important applications in both military and civil industries. The central problem of nonlinear filtering is to solve the Duncan-Mortensen-Zakai (DMZ) equation in real time and in a memoryless manner. In this paper, we shall extend the algorithm developed previously by S.-T. Yau and the second author to the most general setting of nonlinear filterings, where the explicit time-dependence is in the drift term, observation term, and the variance of the noises could be a matrix of functions of both time and the states. To preserve the off-line virtue of the algorithm, necessary modifications are illustrated clearly. Moreover, it is shown rigorously that the approximated solution obtained by the algorithm converges to the real solution in the $L^{1}$ sense. And the precise error has been estimated. Finally, the numerical simulation support the feasibility and efficiency of our algorithm.

automation & control systems,engineering, electrical & electronic
New Direct Method for Yau Filtering System with Arbitrary Initial Conditions

SST Yau,GQ Hu

DOI: https://doi.org/10.1109/cdc.1996.573479

1996-01-01

Abstract:In this paper we consider the explicit solution of the Duncan-Mortensen-Zakai (DMZ) equation for the finite dimensional filtering system. We show that the Yau filtering system (∂fj /∂xi-∂fi/∂xj=c ij=constant for all i,j) can be solved explicitly with an arbitrary initial condition by solving a system of ordinary differential equations and a Kolmogorov-type equation. Let n be the dimension of state space. We show that we need only n sufficient statistics in order to solve the DMZ equation
Finite-dimensional Filters with Nonlinear Drift. III: Duncan-Mortensen-Zakai Equation with Arbitrary Initial Condition for the Linear Filtering System and the Benes Filtering System

ST Yau,SST Yau

DOI: https://doi.org/10.1109/7.625127

IF: 3.491

1997-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:We consider the Duncan-Mortensen-Zakai (DMZ) equation for the Kalman-Bucy filtering system and Benes filtering system. We show that this equation can be solved explicitly with an arbitrary initial condition by solving a system of ordinary differential equations and a Kolmogorov-type equation, Let n be the dimension of state space. We show that we need only n sufficient statistics in order to solve the DMZ equation.
Finite-Dimensional Filters with Nonlinear Drift Xv: New Direct Method for Construction of Universal Finite-Dimensional Filter

GQ Hu,SST Yau

DOI: https://doi.org/10.1109/7.993228

IF: 3.491

2002-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:We consider the explicit solution of Duncan-Mortensen-Zakai (DMZ) equation for the finite-dimensional filtering system. We show that under certain conditions the nonlinear filtering system can be solved explicitly with an arbitrary initial condition by solving a system of ordinary differential equations and a Kolmogorov-type equation. Let n be the dimension of state space. We show that we need only n sufficient statistics in order to solve the DMZ equation.
A Novel Algorithm to Solve the Robust DMZ Equation in Real Time

Xue Luo,Stephen S. -T. Yau

DOI: https://doi.org/10.1109/cdc.2012.6427113

2012-01-01

Abstract:In this note, we extend the algorithm developed in [13] to the most general settings of nonlinear filtering. We rigorously show that under very mild conditions (which essentially say that the growth of the observation |h| is greater than the growth of the drift |f|), the unique nonnegative weak solution of the robust Duncan-Mortensen-Zakai (DMZ) equation can be approximated by solving the same Kolmogorov forward equation (KFE) restricted on a large ball BR with 0-Dirichlet boundary condition on every time steps (off-line computations) and updating the initial data from the observations (on-line computations). The precise error estimates are obtained to validate the algorithm theoretically. Furthermore, we use 1D cubic sensor as an example to show the efficiency of our algorithm, where the Hermite spectral method (HSM) is adopted to compute the off-line data. The detailed formulation of HSM is illustrated.

Explicit Solution of A Kolmogorov Equation

Recent Advance In Computing Kolmogorov Equation Arising From Nonlinear Filtering

Explicit Solution to Generalized Time-Varying Kolmogorov Equation

Finite-dimensional Filters with Nonlinear Drift. V: Solution to Kolmogorov Equation Arising from Linear Filtering with Non-Gaussian Initial Condition

Explicit Solution of DMZ Equation in Nonlinear Filtering Via Solution of ODEs.

Special Solutions to Some Kolmogorov Equations Arising from Cubic Sensor Problems.

Direct Method for Time-Varying Nonlinear Filtering Problems

Real Time Solution of Duncan-Mortensen-Zakai Equation Without Memory

Wavelet-Galerkin Method for the Kolmogorov Equation

Linear Filtering with Nonlinear Observations

Explicit Solution of DMZ Equation

Direct Method for Yau Filtering System with Nonlinear Observations

Real Time Solution of the Nonlinear Filtering Problem Without Memory Ii

Schr&amp;#x00F6;dinger Equation with Quartic Potential and Nonlinear Filtering Problem

Finite-dimensional Filters with Nonlinear Drift X: Explicit Solution of DMZ Equation

An Efficient Algorithm of Yau-Yau Method for Solving Nonlinear Filtering Problems.

Complete Real Time Solution of the General Nonlinear Filtering Problem Without Memory

New Direct Method for Yau Filtering System with Arbitrary Initial Conditions

Finite-dimensional Filters with Nonlinear Drift. III: Duncan-Mortensen-Zakai Equation with Arbitrary Initial Condition for the Linear Filtering System and the Benes Filtering System

Finite-Dimensional Filters with Nonlinear Drift Xv: New Direct Method for Construction of Universal Finite-Dimensional Filter

A Novel Algorithm to Solve the Robust DMZ Equation in Real Time

Schrödinger Equation with Quartic Potential and Nonlinear Filtering Problem