The Kalman Filter: a didactical overview

E. Matsinos

DOI: https://doi.org/10.48550/arXiv.1607.05590

2016-07-16

Abstract:The present document aims at providing a short, didactical introduction to three standard versions of the Kalman filter, namely its variants identified as Basic, Extended, and Unscented. The application of these algorithms in three representative problems is discussed.

Systems and Control

What problem does this paper attempt to address?

The Kalman Filter: An Introduction to Concepts

Peter S. Maybeck

DOI: https://doi.org/10.1007/978-1-4613-8997-2_15

1990-01-01

Abstract:Before we delve into the details of the text, it would be useful to see where we are going on a conceptual basis. Therefore, the rest of this chapter will provide an overview of the optimal linear estimator, the Kalman filter. This will be conducted at a very elementary level but will provide insights into the underlying concepts. As we progress through this overview, contemplate the ideas being presented: try to conceive of graphic images to portray the concepts involved (such as time propagation of density functions), and to generate a logical structure for the component pieces that are brought together to solve the estimation problem. If this basic conceptual framework makes sense to you, then you will better understand the need for the details to be developed later in the text. Should the idea of where we are going ever become blurred by the development of detail, refer back to this overview to regain sight of the overall objectives.
An Elementary Introduction to Kalman Filtering

Yan Pei,Swarnendu Biswas,Donald S. Fussell,Keshav Pingali

DOI: https://doi.org/10.48550/arXiv.1710.04055

2019-06-28

Abstract:Kalman filtering is a classic state estimation technique used in application areas such as signal processing and autonomous control of vehicles. It is now being used to solve problems in computer systems such as controlling the voltage and frequency of processors. Although there are many presentations of Kalman filtering in the literature, they usually deal with particular systems like autonomous robots or linear systems with Gaussian noise, which makes it difficult to understand the general principles behind Kalman filtering. In this paper, we first present the abstract ideas behind Kalman filtering at a level accessible to anyone with a basic knowledge of probability theory and calculus, and then show how these concepts can be applied to the particular problem of state estimation in linear systems. This separation of concepts from applications should make it easier to understand Kalman filtering and to apply it to other problems in computer systems.

Systems and Control
The Kalman filter in analytical chemistry

Steven D. Brown

DOI: https://doi.org/10.1016/s0003-2670(00)85216-2

IF: 6.911

1986-01-01

Analytica Chimica Acta

Abstract:During the past ten years, the means by which more information can be extracted from experimental data have become an important area of research in analytical chemistry. Digital filters have been demonstrated to have a number of applications to analytical problems. These techniques typically involve a least-squares fit of experimental data to some model of the process being filtered. One method for filtering experimental data is based on the Kalman filter, a recursive, linear digital filter first developed for use in navigation, but now used in many fields. This paper discusses the implementation of Kalman filters in analytical chemistry. The principles of state-space digital filtering are reviewed, and the development of state/space models is discussed. Discussion is focused on the discrete Kalman algorithms. Two examples are provided to demonstrate the operation of the discrete Kalman filtering algorithm. Similarities between Kalman filtering and weighted least-squares methods are considered, and the specific advantages and disadvantages of linear and nonlinear Kalman filtering approaches are evaluated. To illustrate the range of problems which benefit from use of the filter, a comprehensive literature survey of the application of Kalman filtering to chemical problems is provided.

chemistry, analytical
A Step by Step Mathematical Derivation and Tutorial on Kalman Filters

Hamed Masnadi-Shirazi,Alireza Masnadi-Shirazi,Mohammad-Amir Dastgheib

DOI: https://doi.org/10.48550/arXiv.1910.03558

2019-10-08

Other Statistics

Abstract:We present a step by step mathematical derivation of the Kalman filter using two different approaches. First, we consider the orthogonal projection method by means of vector-space optimization. Second, we derive the Kalman filter using Bayesian optimal filtering. We provide detailed proofs for both methods and each equation is expanded in detail.
Kalman Filter: Historical Overview and Review of Its Use in Robotics 60 Years after Its Creation

Claudio Urrea,Rayko Agramonte

DOI: https://doi.org/10.1155/2021/9674015

IF: 2.336

2021-09-02

Journal of Sensors

Abstract:Due to its widespread application in the robotics field, the Kalman filter has received increased attention from researchers. This work reviews some of the modifications conducted on to this algorithm over the last years. Problems such as the consistency, convergence, and accuracy of the filter are also dealt with. Sixty years after its creation, the Kalman filter is still used in autonomous navigation processes, robot control, and trajectory tracking, among other activities. The filter is not only restricted to robotics but is also present in different fields, such as economics and medicine. In addition, the characteristics of each modification on this filter are analyzed and compared.

engineering, electrical & electronic,instruments & instrumentation
Notes on Kalman Filter (KF, EKF, ESKF, IEKF, IESKF)

Gyubeom Im

2024-06-28

Abstract:The Kalman Filter (KF) is a powerful mathematical tool widely used for state estimation in various domains, including Simultaneous Localization and Mapping (SLAM). This paper presents an in-depth introduction to the Kalman Filter and explores its several extensions: the Extended Kalman Filter (EKF), the Error-State Kalman Filter (ESKF), the Iterated Extended Kalman Filter (IEKF), and the Iterated Error-State Kalman Filter (IESKF). Each variant is meticulously examined, with detailed derivations of their mathematical formulations and discussions on their respective advantages and limitations. By providing a comprehensive overview of these techniques, this paper aims to offer valuable insights into their applications in SLAM and enhance the understanding of state estimation methodologies in complex environments.

Robotics
Weighted Minimum Mean Square Kalman Filter

陈鹏,钱徽,朱淼良

DOI: https://doi.org/10.3969/j.issn.1002-137x.2009.11.057

2009-01-01

Computer Science

Abstract:In order to use Kalman Filter(KF) in nonlinear systems,a new method was proposed.Using the principle that a set of discretely sampled points can be used to form a linear system,the estimator yields performance equivalent to the Extended Kalman Filter(EKF) for nonlinear systems and can be elegantly used to nonlinear systems without the differential steps required by the EKF.We argue that the ease of implementation and more accurate estimation features of the new filter recommend its use in applications.
Kalman filter demystified: from intuition to probabilistic graphical model to real case in financial markets

Eric Benhamou

DOI: https://doi.org/10.48550/arXiv.1811.11618

2018-11-28

Statistical Finance

Abstract:In this paper, we revisit the Kalman filter theory. After giving the intuition on a simplified financial markets example, we revisit the maths underlying it. We then show that Kalman filter can be presented in a very different fashion using graphical models. This enables us to establish the connection between Kalman filter and Hidden Markov Models. We then look at their application in financial markets and provide various intuitions in terms of their applicability for complex systems such as financial markets. Although this paper has been written more like a self contained work connecting Kalman filter to Hidden Markov Models and hence revisiting well known and establish results, it contains new results and brings additional contributions to the field. First, leveraging on the link between Kalman filter and HMM, it gives new algorithms for inference for extended Kalman filters. Second, it presents an alternative to the traditional estimation of parameters using EM algorithm thanks to the usage of CMA-ES optimization. Third, it examines the application of Kalman filter and its Hidden Markov models version to financial markets, providing various dynamics assumptions and tests. We conclude by connecting Kalman filter approach to trend following technical analysis system and showing their superior performances for trend following detection.
UltimateKalman: Flexible Kalman Filtering and Smoothing Using Orthogonal Transformations

Sivan Toledo

2024-08-29

Abstract:UltimateKalman is a flexible linear Kalman filter and smoother implemented in three popular programming languages: MATLAB, C, and Java. UltimateKalman is a slight simplification and slight generalization of an elegant Kalman filter and smoother that was proposed in 1977 by Paige and Saunders. Their algorithm appears to be numerically superior and more flexible than other Kalman filters and smoothers, but curiously has never been implemented or used before. UltimateKalman is flexible: it can easily handle time-dependent problems, problems with state vectors whose dimensions vary from step to step, problems with varying number of observations in different steps (or no observations at all in some steps), and problems in which the expectation of the initial state is unknown. The programming interface of UltimateKalman is broken into simple building blocks that can be used to construct filters, single or multi-step predictors, multi-step or whole-track smoothers, and combinations. The paper describes the algorithm and its implementation as well as with a test suite of examples and tests.

Numerical Analysis,Systems and Control
Kalman Filters on Differentiable Manifolds

Dongjiao He,Wei Xu,Fu Zhang

DOI: https://doi.org/10.48550/arXiv.2102.03804

IF: 3.7

2021-02-07

Robotics

Abstract:Kalman filter is presumably one of the most important and extensively used filtering techniques in modern control systems. Yet, nearly all current variants of Kalman filters are formulated in the Euclidean space $\mathbb{R}^n$, while many real-world systems (e.g., robotic systems) are really evolving on manifolds. In this paper, we propose a method to develop Kalman filters for such on-manifold systems. Utilizing $\boxplus$, $\boxminus$ operations and further defining an oplus operation on the respective manifold, we propose a canonical representation of the on-manifold system. Such a canonical form enables us to separate the manifold constraints from the system behaviors in each step of the Kalman filter, ultimately leading to a generic and symbolic Kalman filter framework that are naturally evolving on the manifold. Furthermore, the on-manifold Kalman filter is implemented as a toolkit in $C$++ packages which enables users to implement an on-manifold Kalman filter just like the normal one in $\mathbb{R}^n$: the user needs only to provide the system-specific descriptions, and then call the respective filter steps (e.g., predict, update) without dealing with any of the manifold constraints. The existing implementation supports full iterated Kalman filtering for systems on any manifold composed of $\mathbb{R}^n$, $SO(3)$ and $\mathbb{S}^2$, and is extendable to other types of manifold when necessary. The proposed symbolic Kalman filter and the developed toolkit are verified by implementing a tightly-coupled lidar-inertial navigation system. Results show that the developed toolkit leads to superior filtering performances and computation efficiency comparable to hand-engineered counterparts. Finally, the toolkit is opened sourced at https://github.com/hku-mars/IKFoM to assist practitioners to quickly deploy an on-manifold Kalman filter.
Introduction to the Kalman Filter and Tuning its Statistics for Near Optimal Estimates and Cramer Rao Bound

Shyam Mohan M,Naren Naik,R.M.O. Gemson,M.R. Ananthasayanam

DOI: https://doi.org/10.48550/arXiv.1503.04313

2015-03-14

Abstract:This report provides a brief historical evolution of the concepts in the Kalman filtering theory since ancient times to the present. A brief description of the filter equations its aesthetics, beauty, truth, fascinating perspectives and competence are described. For a Kalman filter design to provide optimal estimates tuning of its statistics namely initial state and covariance, unknown parameters, and state and measurement noise covariances is important. The earlier tuning approaches are reviewed. The present approach is a reference recursive recipe based on multiple filter passes through the data without any optimization to reach a `statistical equilibrium' solution. It utilizes the a priori, a posteriori, and smoothed states, their corresponding predicted measurements and the actual measurements help to balance the measurement equation and similarly the state equation to help form a generalized likelihood cost function. The filter covariance at the end of each pass is heuristically scaled up by the number of data points is further trimmed to statistically match the exact estimates and Cramer Rao Bounds (CRBs) available with no process noise provided the initial covariance for subsequent passes. During simulation studies with process noise the matching of the input and estimated noise sequence over time and in real data the generalized cost functions helped to obtain confidence in the results. Simulation studies of a constant signal, a ramp, a spring, mass, damper system with a weak non linear spring constant, longitudinal and lateral motion of an airplane was followed by similar but more involved real airplane data was carried out in MATLAB. In all cases the present approach was shown to provide internally consistent and best possible estimates and their CRBs.

Methodology,Applications
A summary on the UD Kalman Filter

J. Humberto Ramos,Kevin Brink,Prashant Ganesh,John E. Hurtado

DOI: https://doi.org/10.48550/arXiv.2203.06105

2022-03-11

Systems and Control

Abstract:This document contains a concise and unified reference for one of the existing mechanizations of the UD Kalman filter. The associated matrix algorithms are also included along with the corresponding references.
Kalman Filter for Robot Vision: A Survey

S. Y. Chen

DOI: https://doi.org/10.1109/tie.2011.2162714

IF: 7.7

2012-11-01

IEEE Transactions on Industrial Electronics

Abstract:Kalman filters have received much attention with the increasing demands for robotic automation. This paper briefly surveys the recent developments for robot vision. Among many factors that affect the performance of a robotic system, Kalman filters have made great contributions to vision perception. Kalman filters solve uncertainties in robot localization, navigation, following, tracking, motion control, estimation and prediction, visual servoing and manipulation, and structure reconstruction from a sequence of images. In the 50th anniversary, we have noticed that more than 20 kinds of Kalman filters have been developed so far. These include extended Kalman filters and unscented Kalman filters. In the last 30 years, about 800 publications have reported the capability of these filters in solving robot vision problems. Such problems encompass a rather wide application area, such as object modeling, robot control, target tracking, surveillance, search, recognition, and assembly, as well as robotic manipulation, localization, mapping, navigation, and exploration. These reports are summarized in this review to enable easy referral to suitable methods for practical solutions. Representative contributions and future research trends are also addressed in an abstract level.

automation & control systems,engineering, electrical & electronic,instruments & instrumentation
AI-Aided Kalman Filters

Nir Shlezinger,Guy Revach,Anubhab Ghosh,Saikat Chatterjee,Shuo Tang,Tales Imbiriba,Jindrich Dunik,Ondrej Straka,Pau Closas,Yonina C. Eldar

2024-10-16

Abstract:The Kalman filter (KF) and its variants are among the most celebrated algorithms in signal processing. These methods are used for state estimation of dynamic systems by relying on mathematical representations in the form of simple state-space (SS) models, which may be crude and inaccurate descriptions of the underlying dynamics. Emerging data-centric artificial intelligence (AI) techniques tackle these tasks using deep neural networks (DNNs), which are model-agnostic. Recent developments illustrate the possibility of fusing DNNs with classic Kalman-type filtering, obtaining systems that learn to track in partially known dynamics. This article provides a tutorial-style overview of design approaches for incorporating AI in aiding KF-type algorithms. We review both generic and dedicated DNN architectures suitable for state estimation, and provide a systematic presentation of techniques for fusing AI tools with KFs and for leveraging partial SS modeling and data, categorizing design approaches into task-oriented and SS model-oriented. The usefulness of each approach in preserving the individual strengths of model-based KFs and data-driven DNNs is investigated in a qualitative and quantitative study, whose code is publicly available, illustrating the gains of hybrid model-based/data-driven designs. We also discuss existing challenges and future research directions that arise from fusing AI and Kalman-type algorithms.

Machine Learning,Signal Processing,Systems and Control
Kalman Filter, Unscented Filter and Particle Flow Filter on Non-linear Models

Yan Zhao

DOI: https://doi.org/10.48550/arXiv.1803.08503

2018-03-22

Applications

Abstract:Filters, especially wide range of Kalman Filters have shown their impacts on predicting variables of stochastic models with higher accuracy then traditional statistic methods. Updating mean and covariance each time makes Bayesian inferences more meaningful. In this paper, we mainly focused on the derivation and implementation of three powerful filters: Kalman Filter, Unscented Kalman Filter and Particle Flow Filter. Comparison for these different type of filters could make us more clear about the suitable applications for different circumstances.
Time and the Kalman Filter

L. Galleani,P. Tavella

DOI: https://doi.org/10.1109/mcs.2009.935568

2010-04-01

IEEE Control Systems

Abstract:This article reviews applications of the Kalman filter to atomic timing. The objectives of the article are twofold - present diverse applications and concepts in a consistent fashion, both in regard to notation and mathematical concepts. and develop the key ideas in a tutorial form by introducing the basic concepts and then applications.we apply the Kalman filter to clock estimation, clock monitoring, and time-scale definition. Furthermore, the GPS composite clock algorithm along with numerical simulations is described. Finally, the advantages and criticalities of the application of the Kalman filter to atomic timing, highlighting issues that are worth investigating are pointed out and on which the time and frequency community is currently working.
Kalman Filter and its Modern Extensions for the Continuous-time Nonlinear Filtering Problem

Amirhossein Taghvaei,Jana de Wiljes,Prashant G. Mehta,Sebastian Reich

DOI: https://doi.org/10.48550/arXiv.1702.07241

2017-12-22

Abstract:This paper is concerned with the filtering problem in continuous-time. Three algorithmic solution approaches for this problem are reviewed: (i) the classical Kalman-Bucy filter which provides an exact solution for the linear Gaussian problem, (ii) the ensemble Kalman-Bucy filter (EnKBF) which is an approximate filter and represents an extension of the Kalman-Bucy filter to nonlinear problems, and (iii) the feedback particle filter (FPF) which represents an extension of the EnKBF and furthermore provides for an consistent solution in the general nonlinear, non-Gaussian case. The common feature of the three algorithms is the gain times error formula to implement the update step (to account for conditioning due to the observations) in the filter. In contrast to the commonly used sequential Monte Carlo methods, the EnKBF and FPF avoid the resampling of the particles in the importance sampling update step. Moreover, the feedback control structure provides for error correction potentially leading to smaller simulation variance and improved stability properties. The paper also discusses the issue of non-uniqueness of the filter update formula and formulates a novel approximation algorithm based on ideas from optimal transport and coupling of measures. Performance of this and other algorithms is illustrated for a numerical example.

Optimization and Control,Systems and Control
The universality of the Kalman filter: a conditional characteristic function perspective

Sandhya Rathore,Shambhu N. Sharma,Shaival H. Nagarsheth

DOI: https://doi.org/10.48550/arXiv.1910.03446

2019-10-08

Optimization and Control

Abstract:The universality of the celebrated Kalman filtering can be found in control theory. The Kalman filter has found its striking applications in sophisticated autonomous systems and smart products, which are attributed to its realization in a single complex chip. In this paper, we revisit the Kalman filter from the perspective of conditional characteristic function evolution and Ito calculus and develop three Kalman filtering Theorems and their formal proof. Most notably, this paper reveals the following: (i) Kalman filtering equations are a consequence of the evolution of conditional characteristic function for the linear stochastic differential system coupled with the linear discrete measurement system. (ii) The Kalman filtering is a consequence of the stochastic evolution of conditional characteristic function for the linear stochastic differential system coupled with the linear continuous measurement system. (iii) The structure of the Kalman filter remains invariant under two popular stochastic interpretations, the Ito vs Stratonovich.
Kalman Filtering of Distributed Time Series

Dan Stefanoiu,Janetta Culita

DOI: https://doi.org/10.48550/arXiv.1703.07194

2017-03-21

General Literature

Abstract:This paper aims to introduce an application to Kalman Filtering Theory, which is rather unconventional. Recent experiments have shown that many natural phenomena, especially from ecology or meteorology, could be monitored and predicted more accurately when accounting their evolution over some geographical area. Thus, the signals they provide are gathered together into a collection of distributed time series. Despite the common sense, such time series are more or less correlated each other. Instead of processing each time series independently, their collection can constitute the set of measurable states provided by some open system. Modeling and predicting the system states can take benefit from the family of Kalman filtering algorithms. The article describes an adaptation of basic Kalman filter to the context of distributed signals collections and completes with an application coming from Meteorology.
On Computational Complexity Reduction Methods for Kalman Filter Extensions

Matti Raitoharju,Robert Piché

DOI: https://doi.org/10.1109/MAES.2019.2927898

2019-10-10

Abstract:The Kalman filter and its extensions are used in a vast number of aerospace and navigation applications for nonlinear state estimation of time series. In the literature, different approaches have been proposed to exploit the structure of the state and measurement models to reduce the computational demand of the algorithms. In this tutorial, we survey existing code optimization methods and present them using unified notation that allows them to be used with various Kalman filter extensions. We develop the optimization methods to cover a wider range of models, show how different structural optimizations can be combined, and present new applications for the existing optimizations. Furthermore, we present an example that shows that the exploitation of the structure of the problem can lead to improved estimation accuracy while reducing the computational load. This tutorial is intended for persons who are familiar with Kalman filtering and want to get insights for reducing the computational demand of different Kalman filter extensions.

Systems and Control,Optimization and Control,Probability

The Kalman Filter: a didactical overview

The Kalman Filter: An Introduction to Concepts

An Elementary Introduction to Kalman Filtering

The Kalman filter in analytical chemistry

A Step by Step Mathematical Derivation and Tutorial on Kalman Filters

Kalman Filter: Historical Overview and Review of Its Use in Robotics 60 Years after Its Creation

Notes on Kalman Filter (KF, EKF, ESKF, IEKF, IESKF)

Weighted Minimum Mean Square Kalman Filter

Kalman filter demystified: from intuition to probabilistic graphical model to real case in financial markets

UltimateKalman: Flexible Kalman Filtering and Smoothing Using Orthogonal Transformations

Kalman Filters on Differentiable Manifolds

Introduction to the Kalman Filter and Tuning its Statistics for Near Optimal Estimates and Cramer Rao Bound

A summary on the UD Kalman Filter

Kalman Filter for Robot Vision: A Survey

AI-Aided Kalman Filters

Kalman Filter, Unscented Filter and Particle Flow Filter on Non-linear Models

Time and the Kalman Filter

Kalman Filter and its Modern Extensions for the Continuous-time Nonlinear Filtering Problem

The universality of the Kalman filter: a conditional characteristic function perspective

Kalman Filtering of Distributed Time Series

On Computational Complexity Reduction Methods for Kalman Filter Extensions