Recent Results On Nonlinear Filtering - New Class Of Finite-Dimensional Filters

Sst Yau

DOI: https://doi.org/10.1109/CDC.1990.203587

1990-01-01

Abstract:The author reports some of his recent results on nonlinear filtering. A new class of finite-dimensional filters is constructed which includes both Kalman-Bucy filters and Benes filters as special cases

What problem does this paper attempt to address?

Addendum to "Finite-Dimensional Filters with Nonlinear Drift": A Response to F. Daum'S Comments

SST Yau,ST Yau

DOI: https://doi.org/10.1109/taes.1998.670363

IF: 3.491

1998-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:Over ten years ago Daum [1986-88] introduced nonlinear filters for discrete time measurements which are more general than the filters recently announced by Yau and Yau [1997] for continuous time observations. The authors say that, "Recently Yau and Yau introduced a new direct method to solve the estimation problem... . They factored the problem into two parts: 1) the on-line solution of a finite s...
Solution of Filtering Problem with Nonlinear Observations

SST Yau,ST Yau

DOI: https://doi.org/10.1137/s0363012902411970

IF: 2.2

2005-01-01

SIAM Journal on Control and Optimization

Abstract:For all known finite-dimensional filters, one always needs the conditon that the observation terms are degree one polynomial. On the other hand, in many practical examples, e.g., tracking problem, the observation terms may be nonlinear. Our new method in this paper can treat filtering problems with nonlinear observation terms in the first time, which includes Kalman--Bucy filter as a special case.
Finite Dimensional Filters with Nonlinear Drift, XI

ST Yau,SST Yau

DOI: https://doi.org/10.1006/aima.1998.1767

IF: 1.675

1998-01-01

Advances in Mathematics

Abstract:Ever since the technique of the Kalman–Bucy filter was popularized, there has been an intense interest in finding new classes of finite-dimensional recursive filters. In the late 1970s the concept of the estimation algebra of a filtering system was introduced. Brockett, Clark, and Mitter proposed to use the Wei–Norman approach to solve the nonlinear filtering problem. In 1990, Tam, Wong, and Yau presented a rigorous proof of the Brocket–Mitter program which allows one to construct finite-dimensional recursive filters from finite–dimensional estimation algebras. Later Yau wrote down explicitly a system of ordinary differential equations and generalized Kolmogorov equation to which the robust Duncan–Mortenser– Zakai equation can be reduced. Thus there remains three fundamental problems in Brockett–Mitter program. The first is the problem of finding explicit solution to the generalized Kolmogorov equation. The second is the problem of finding real-time solution of a system of ODEs. The third is the Brockett's problem of classification of finite–dimensional estimation algebras. In this paper, we solve the first problem.
Parallel Computations for Yau Filters

HW Cheng,SST Yau

DOI: https://doi.org/10.1016/j.camwa.2005.01.026

IF: 3.218

2005-01-01

Computers & Mathematics with Applications

Abstract:In the early 1990s, Yau developed a new class of nonlinear filters, called the Yau Filterswhich contain the Kalman-Bucy filters and the Benes filters as special cases. It has been shown that, from the Lie algebraic point of view, the Yau filters are the most general finite-dimensional filters. Yau and Hu proved that the DMZ equation for a Yau filter can be reduced to a Kolmogorov type partial differential equation and a system of linear differential equations. They noticed that the PDE is independent of the observed data and hence can be solved off-line. An efficient parallel algorithm for the system of ODEs would lead to fast solutions of Yau filters and hence their suitability for real-life applications. In this paper, we have proposed several parallel methods suitable for this system of ODEs.
Explicit Construction of Finite Dimensional Nonlinear Filters with State Space Dimension 2

SST YAU,WL CHIOU

DOI: https://doi.org/10.1109/cdc.1993.325057

1993-01-01

Abstract:Ever since the technique of the Kalman-Bucy filter was popularized, there has been an intense interest in finding new classes of finite dimensional recursive filters. The idea of using estimation algebras to construct finite dimensional nonlinear filters was first proposed in Brockett and Clark (1980), Brockett, and Mitter (1979). Tam, Wong and Yau (1990), and Yau have demonstrated that the concept of estimation algebra is an invaluable tool in the study of nonlinear filtering problems. In Chiou and Yau, the concept of an estimation algebra with maximal rank was introduced. Let n be the dimension of the state space. For n=1, it turns out that all nontrivial finite dimensional estimation algebras are with maximal rank. They were classified by the works of Tam-Wong-Yau (1990). For n=2, the authors have classified all finite dimensional estimation algebras with maximal rank. In this paper the authors construct explicitly finite dimensional filters with state space dimension 2 via the Wei-Norman (1964) approach by using the result of Chiou and Yau. From the Lie algebraic point of view, these are the most general finite dimensional filters.<>
New Classes of Finite Dimensional Filters with Nonmaximal Rank Estimation Algebra on State Dimension N and Linear Rank N-2.

Xiao-pei Jiao,Stephen S-T Yau

DOI: https://doi.org/10.1137/20m1350467

IF: 2.2

2020-01-01

SIAM Journal on Control and Optimization

Abstract:Ever since the Kalman filter technique was popularized, there has been an abundance of interest in finding new classes of finite dimensional recursive filters. In this paper, by applying Wong's theorem [W. S. Wong, Systems Control Lett, 9 (1987), pp. 79-83], we construct a new class of finite dimensional filters with arbitrary state space dimension n and linear rank n - 2. Importantly, we show that in the new class of nonlinear filtering systems, the entries of Wong's Omega-matrix need not be constants or polynomials and can be C-infinity functions.
New Classes of Finite Dimensional Filters with Non-Maximal Rank

Junwei Shi,Xiuqiong Chen,Wenhui Dong,Stephen S.‐T. Yau

DOI: https://doi.org/10.1109/lcsys.2017.2713604

2017-01-01

IEEE Control Systems Letters

Abstract:Ever since the technique of Kalman filter was popularized, there has been an intense interest in finding new classes of finite dimensional recursive filters. In the late seventies, the idea of using estimation algebra to construct finite-dimensional nonlinear filters was first proposed by Brockett and Mitter independently. It has been proven to be an invaluable tool in the study of nonlinear filtering problem. For all known finite dimensional estimation algebras, the Wong's Ω-matrix has been proven to be a constant matrix. However, the Wong's Ω-matrix is shown not necessary to be a constant matrix in this letter when we consider finite dimensional estimation algebras with state dimension 3 and rank equal to 1. Several easily satisfied conditions are established for an estimation algebra of a special class of filtering systems to be finite-dimensional. Finally, we give the construction of finite dimensional filters of non-maximal rank.
Recent Advances in Classification of Finite-Dimensional Estimation Algebras for Nonlinear Filtering Systems

Shanjian Tang

2000-01-01

Abstract:The recent progresses on Brockett s problem of classifying all finite-dimensional estimation algebras of maximal rank for nonlinear filtering systems are introduced.
Construction of New Finite Dimensional Nonlinear Filters

SST Yau,A Rasoulian

DOI: https://doi.org/10.1109/cdc.1995.479231

1995-01-01

Abstract:The authors present a new way to construct finite dimensional estimation algebra of nonmaximal rank. For a given finite dimensional estimation algebra E, one can construct a finite dimensional estimation algebra E' of nonmaximal rank which is isomorphic to E. The interesting fact is that even if E comes from a linear filtering system, there are arbitrary nonlinear filtering systems associated to E. Since every finite dimensional estimation algebra gives rise to a finite dimensional filter, we have constructed quite a large class of finite dimensional nonlinear filters
New Algorithms in Real Time Solution of the Nonlinear Filtering Problem.

Stephen S.-T. Yau

DOI: https://doi.org/10.4310/cis.2008.v8.n3.a6

2008-01-01

Abstract:It is well known that the filtering theory has important applications in both military and commercial industries.The Kalman-Bucy filter has been used in many areas such as navigational and guidance systems, radar tracking, solar mapping, and satellite orbit determination.However, the Kalman-Bucy filter has limited applicability because of the linearity assumptions of the drift term and observation term as well as the Gaussian assumption of the initial value.Therefore there has been an intensive interest in solving the nonlinear filtering problem.The central problem of nonlinear filtering theory is to solve the DMZ equation in real time and memoryless way.In this paper, we shall describe three methods to solve the DMZ equation: Brockett-Mitter estimation algebra method, direct method, and new algorithm method.The first two methods are relatively easy to implement in hardware and can solve a large class of nonlinear filtering problems.We shall present the recent advance in the third method which solves all the nonlinear filtering problems in a real-time manner in theory.
The Novel Classes of Finite Dimensional Filters with Non-Maximal Rank Estimation Algebra on State Dimension Four and Rank of One.

Wenhui Dong,Xiuqiong Chen,Stephen S. -T. Yau

DOI: https://doi.org/10.1080/00207179.2019.1637543

IF: 2.102

2019-01-01

International Journal of Control

Abstract:Ever since the technique of Kalman-Bucy filter was popularized, due to its limitations of linear assumption and Gaussian initial condition in model, there has been an intense interest in finding new classes of finite dimensional recursive filters. The idea of using estimation algebra was first proposed to construct finite-dimensional nonlinear filters by Brockett and Mitter independently in the late seventies, and it has rapidly been proven to be an invaluable tool in the study of nonlinear filtering (NLF) problem. For all known finite dimensional estimation algebras (FDEAs), the Wong's matrix has to be constant. However, as shown in this paper, the Wong's matrix is a polynomial when we consider FDEAs with state dimension 4 and linear rank equal to 2. Several mild conditions are established for finding a special class of NLF system. Finally, we give the construction of finite dimensional filters for this class of NLF system by Wei-Norman approach.
Solution to Brockett's Problem on Finite-Dimensional Estimation Algebras of Maximal Rank in Nonlinear Filtering

SST Yau

DOI: https://doi.org/10.1109/cdc.2000.912775

2000-01-01

Abstract:The Kalman-Bucy filter is widely used in modern industry. Despite its usefulness, however, the Kalman-Bucy filter is not perfect. One of the weakness is that it needs a Gaussian assumption for the initial data. The other weakness is that it requires the drift term f(x) be a linear function. Brockett (1981), Brockett and Clark (1980), and Mitter (1979) proposed independently using a Lie algebraic method to solve the Duncan-Mortensen-Zakai equation for nonlinear filtering. This method requires only n sufficient statistics, where n is the state space dimension, and it allows the initial condition to be modeled by an arbitrary distribution. The idea was worked out in detail by Tam, Wong, and Yau (1990) and Yau (1990, 1994). However, in the Lie algebraic method, one has to know explicitly the structure of the estimation algebra. In 1983, Brockett proposed to classify all finite dimensional filters. In this paper, we report more recent results on classification of finite dimensional maximal rank estimation algebras with arbitrary state space dimension
Finite-dimensional Filters with Nonlinear Drift. V: Solution to Kolmogorov Equation Arising from Linear Filtering with Non-Gaussian Initial Condition

ZG Liang,SST Yau,ST Yau

DOI: https://doi.org/10.1109/7.625130

IF: 3.491

1997-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:Despite its usefulness, the Kalman-Bucy filter is not perfect. One of its weaknesses is that it needs a Gaussian assumption on the initial data. Recently Yau and Yau introduced a new direct method to solve the estimation problem for linear filtering with non-Gaussian initial data. They factored the problem into two parts: (1) the on-line solution of a finite system of ordinary differential equations (ODEs), and (2) the off-line calculation of the Kolmogorov equation. Here we derive an explicit closed-form solution of the Kolmogorov equation. We also give some properties and conduct a numerical study of the solution.
An Efficient Algorithm of Yau-Yau Method for Solving Nonlinear Filtering Problems.

Mei-Heng Yueh,Wen-Wei Lin,Shing-Tung Yau

DOI: https://doi.org/10.4310/cis.2014.v14.n2.a3

2014-01-01

Communications in Information and Systems

Abstract:It is well known that the nonlinear filter has important applications in military, engineering and commercial industries. In this paper, we propose efficient and accurate numerical algorithms for the realization of the Yau-Yau method for solving nonlinear filtering problems by using finite difference schemes. The Yau-Yau method reduces the nonlinear filtering problem to the initial-value problem of Kolmogorov equations. We first solve this problem by the implicit Euler method, which is stable in most cases, but costly. Then, we propose a quasi-implicit Euler method which is feasible for acceleration by fast Fourier transformations. Furthermore, we propose a superposition technique which enables us to deal with the nonlinear filtering problem in an off-time process and thus, save a large amount of computational cost. Next, we prove that the numerical solutions of Kolmogorov equations by our schemes are always nonnegative in each iteration. Consequently, our iterative process preserves the probability density functions. In addition, we prove convergence of our schemes under some mild conditions. Numerical results show that the proposed algorithms are efficient and promising.
Filtering problem with nonlinear observations and drift terms equal to gradient vector field plus affine vector field

Yau, S.S.-T.,Jia Lixing

DOI: https://doi.org/10.1109/CDC.2005.1583099

2005-01-01

Abstract:For all known finite dimensional filters, one always needs the condition that the observation terms are degree one polynomial. On the other hand, in many practical examples, e.g. tracking problem, the observation terms may be nonlinear. In this paper, we solve filtering problems with nonlinear observation terms and drift term equal to gradient vector field plus affine vector field, which includes Kalman-Bucy filter, Benes filter and Yau filter as special cases. © 2005 IEEE.
Kalman Filter and its Modern Extensions for the Continuous-time Nonlinear Filtering Problem

Amirhossein Taghvaei,Jana de Wiljes,Prashant G. Mehta,Sebastian Reich

DOI: https://doi.org/10.48550/arXiv.1702.07241

2017-12-22

Abstract:This paper is concerned with the filtering problem in continuous-time. Three algorithmic solution approaches for this problem are reviewed: (i) the classical Kalman-Bucy filter which provides an exact solution for the linear Gaussian problem, (ii) the ensemble Kalman-Bucy filter (EnKBF) which is an approximate filter and represents an extension of the Kalman-Bucy filter to nonlinear problems, and (iii) the feedback particle filter (FPF) which represents an extension of the EnKBF and furthermore provides for an consistent solution in the general nonlinear, non-Gaussian case. The common feature of the three algorithms is the gain times error formula to implement the update step (to account for conditioning due to the observations) in the filter. In contrast to the commonly used sequential Monte Carlo methods, the EnKBF and FPF avoid the resampling of the particles in the importance sampling update step. Moreover, the feedback control structure provides for error correction potentially leading to smaller simulation variance and improved stability properties. The paper also discusses the issue of non-uniqueness of the filter update formula and formulates a novel approximation algorithm based on ideas from optimal transport and coupling of measures. Performance of this and other algorithms is illustrated for a numerical example.

Optimization and Control,Systems and Control
Lie Algebraic Method in Nonlinear Filtering with State Space Dimension Up to 6

Stephen S.-T. Yau,Larn-Ying Yeh

DOI: https://doi.org/10.1016/s1474-6670(17)56660-4

1999-01-01

IFAC Proceedings Volumes

Abstract:The Kalman-Bucy filter is widely used in modern industry. Despite its usefulness, however, the Kalman-Bucy filter is not perfect. One of its weaknesses is that it needs a Gaussian assumption for the initial data. In this paper we present a Lie algebraic method to solve Duncan-Mortensen-Zakai equation for nonlinear filtering. This method requires only n sufficient statistics, and it allows the initial condition be modeled by an arbitrary distribution. On the other hand, the well-known Makowski method and Haussman-Pardoux method for linear filtering both require a number of sufficient statistics to be a polynomial of degree two in n. However, in the Lie algebraic method, one has to know explicitly the structure of the estimation algebra. In this paper we report the recent results on classification fo finite dimensional maximal rank estimation algebras with state space dimension up to 6.
On the Convergence Analysis of Yau-Yau Nonlinear Filtering Algorithm: from a Probabilistic Perspective

Zeju Sun,Xiuqiong Chen,Stephen S.-T. Yau

2024-05-10

Abstract:At the beginning of this century, a real time solution of the nonlinear filtering problem without memory was proposed in [1, 2] by the third author and his collaborator, and it is later on referred to as Yau-Yau algorithm. During the last two decades, a great many nonlinear filtering algorithms have been put forward and studied based on this framework. In this paper, we will generalize the results in the original works and conduct a novel convergence analysis of Yau-Yau algorithm from a probabilistic perspective. Instead of considering a particular trajectory, we estimate the expectation of the approximation error, and show that commonly-used statistics of the conditional distribution (such as conditional mean and covariance matrix) can be accurately approximated with arbitrary precision by Yau-Yau algorithm, for general nonlinear filtering systems with very liberal assumptions. This novel probabilistic version of convergence analysis is more compatible with the development of modern stochastic control theory, and will provide a more valuable theoretical guidance for practical implementations of Yau-Yau algorithm.

Optimization and Control,Probability
Finite Dimensional Estimation Algebra for Time-Varying Filtering System and Optimal Transport Particle Filter: A Tangent Flow Point of View

Jiayi Kang,Xiaopei Jiao,Stephen S. -T. Yau

DOI: https://doi.org/10.1109/taes.2023.3299916

IF: 3.491

2023-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:Ever since the technique of the Kalman filter was popularized, there has been a lot of research interest in finding more classes of finite-dimensional recursive filters. In past research, the estimation algebra method could only be used for time-invariant systems. In this article, we extend the estimation algebra method so that it applies to a general class of time-varying filtering systems. Then, the Wei-Norman method can be used to derive the explicit solution of the posterior distribution of state estimation. As a special control law, tangent flow is derived for the nonlinear filtering system based on the Monge-Amp$\grave{\text{e}}$re equation in optimal transport. As a result, we propose an optimal transportation filter by applying stochastic tangent flow to Yau filtering systems. The numerical experiments demonstrate the higher efficacy and accuracy of the proposed optimal transportation filter compared to common traditional algorithms such as the extended Kalman filter and feedback particle filter.
Framework of Belief Condensation Filtering and Deterministic Discrete Filters

Santiago Mazuelas,Yuan Shen,Moe Z. Win

DOI: https://doi.org/10.1109/icuwb.2012.6340469

2012-01-01

Abstract:Inferring a sequence of variables from observations is a prevalent task in a multitude of applications. However, in some nonlinear or non-Gaussian scenarios, traditional techniques such as Kalman filters (KFs) and particle filters (PFs) fail to provide satisfactory performance. Moreover, there is a lack of a unifying framework for the analysis and development of different filtering techniques. In this paper, we present a general framework for filtering that allows to formulate an optimality criterium leading to the concept of belief condensation filtering (BCF). Moreover, we develop discrete BCFs that are optimal under such framework. Finally, simulation results are presented for the important filtering task that arises in ultrawide bandwidth (UWB) ranging. We show that BCF can obtain accuracies approaching the theoretical benchmark but with a smaller complexity than PFs.

Recent Results On Nonlinear Filtering - New Class Of Finite-Dimensional Filters

Addendum to "Finite-Dimensional Filters with Nonlinear Drift": A Response to F. Daum'S Comments

Solution of Filtering Problem with Nonlinear Observations

Finite Dimensional Filters with Nonlinear Drift, XI

Parallel Computations for Yau Filters

Explicit Construction of Finite Dimensional Nonlinear Filters with State Space Dimension 2

New Classes of Finite Dimensional Filters with Nonmaximal Rank Estimation Algebra on State Dimension N and Linear Rank N-2.

New Classes of Finite Dimensional Filters with Non-Maximal Rank

Recent Advances in Classification of Finite-Dimensional Estimation Algebras for Nonlinear Filtering Systems

Construction of New Finite Dimensional Nonlinear Filters

New Algorithms in Real Time Solution of the Nonlinear Filtering Problem.

The Novel Classes of Finite Dimensional Filters with Non-Maximal Rank Estimation Algebra on State Dimension Four and Rank of One.

Solution to Brockett's Problem on Finite-Dimensional Estimation Algebras of Maximal Rank in Nonlinear Filtering

Finite-dimensional Filters with Nonlinear Drift. V: Solution to Kolmogorov Equation Arising from Linear Filtering with Non-Gaussian Initial Condition

An Efficient Algorithm of Yau-Yau Method for Solving Nonlinear Filtering Problems.

Filtering problem with nonlinear observations and drift terms equal to gradient vector field plus affine vector field

Kalman Filter and its Modern Extensions for the Continuous-time Nonlinear Filtering Problem

Lie Algebraic Method in Nonlinear Filtering with State Space Dimension Up to 6

On the Convergence Analysis of Yau-Yau Nonlinear Filtering Algorithm: from a Probabilistic Perspective

Finite Dimensional Estimation Algebra for Time-Varying Filtering System and Optimal Transport Particle Filter: A Tangent Flow Point of View

Framework of Belief Condensation Filtering and Deterministic Discrete Filters