Abstract:The Kalman filter (KF) is a widely-used algorithm for tracking dynamic systems that are captured by state space (SS) models. The need to fully describe a SS model limits its applicability under complex settings, e.g., when tracking based on visual data, and the processing of high-dimensional signals often induces notable latency. These challenges can be treated by mapping the measurements into latent features obeying some postulated closed-form SS model, and applying the KF in the latent space. However, the validity of this approximated SS model may constitute a limiting factor. In this work, we study tracking from high-dimensional measurements under complex settings using a hybrid model-based/data-driven approach. By gradually tackling the challenges in handling the observations model and the task, we develop Latent-KalmanNet, which implements tracking from high-dimensional measurements by leveraging data to jointly learn the KF along with the latent space mapping. Latent-KalmanNet combines a learned encoder with data-driven tracking in the latent space using the recently proposed-KalmanNet, while identifying the ability of each of these trainable modules to assist its counterpart via providing a suitable prior (by KalmanNet) and by learning a latent representation that facilitates data-aided tracking (by the encoder). Our empirical results demonstrate that the proposed Latent-KalmanNet achieves improved accuracy and run-time performance over both model-based and data-driven techniques by learning a surrogate latent representation that most facilitates tracking, while operating with limited complexity and latency.

What problem does this paper attempt to address?

The paper primarily aims to address the problem of dynamic system state tracking in complex high-dimensional signal environments. Specifically, the paper attempts to solve the following key issues: 1. **Tracking problem under high-dimensional data**: Traditional Kalman Filter (KF) and its variants require an accurate State Space (SS) model to describe the system's dynamic characteristics. However, this requirement limits their application when dealing with complex high-dimensional data (such as visual data). 2. **Non-Gaussian noise and nonlinear models**: KF assumes that the system dynamics are linear and that the noise follows a known Gaussian distribution. However, in practical applications (e.g., autonomous driving, smart city surveillance), the observed data are often high-dimensional and contain non-Gaussian noise, which limits the application of KF. 3. **Delay issues brought by high-dimensional signal processing**: Processing high-dimensional signals usually leads to significant computational delays, which is a challenge for real-time applications. To address the above issues, the paper proposes the Latent-KalmanNet method, a hybrid model-driven/data-driven approach. The main contributions of this method include: - **Joint learning of Kalman filtering and latent space mapping**: Latent-KalmanNet achieves tracking from high-dimensional observations by combining learned encoders and data-driven Kalman filtering in the latent space. This approach can simultaneously learn the Kalman filtering algorithm and the mapping of the latent space. - **Overcoming the limitations of complex observation models**: The paper adopts a data-driven approach to handle complex and potentially intractable observation models. By mapping observations to a latent feature space and applying Kalman filtering within that space, this method avoids the complexity issues associated with directly processing raw high-dimensional data. - **Improving accuracy and runtime performance**: Experimental results show that the proposed Latent-KalmanNet method outperforms traditional model-driven methods and purely data-driven techniques in terms of both accuracy and runtime performance. This is because it can learn an approximate latent representation that is most suitable for the tracking task while maintaining low complexity and delay. In summary, this paper aims to propose a new framework to address the challenges faced by traditional Kalman filtering methods when dealing with high-dimensional complex data. By combining model knowledge and data-driven approaches, it improves the accuracy and efficiency of tracking.

Latent-KalmanNet: Learned Kalman Filtering for Tracking from High-Dimensional Signals

GSP-KalmanNet: Tracking Graph Signals via Neural-Aided Kalman Filtering

KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics

Uncertainty in Data-Driven Kalman Filtering for Partially Known State-Space Models

EKFNet: Learning System Noise Covariance Parameters for Nonlinear Tracking

Adaptive KalmanNet: Data-Driven Kalman Filter with Fast Adaptation

Multisensor Fusion Tracking Using Continuous Dynamic Bayesian Network

Neural Augmentation of Kalman Filter with Hypernetwork for Channel Tracking

Application of Extended Kalman Filter to Dynamic Tracking Problem in R-LATs

Kalman Filter For Multi-Target Tracking With Integrated Measurements Subject To Signal Attenuation

Kalman filtering aspects in camera and deep learning based tracking for traffic monitoring

Adaptive Kernel Learning Kalman Filtering with Application to Model-Free Maneuvering Target Tracking

Novel sparseness-inducing dual Kalman filter and its application to tracking time-varying spatially-sparse structural stiffness changes and inputs

AI-Aided Kalman Filters

Beyond Kalman Filters: Deep Learning-Based Filters for Improved Object Tracking

The discriminative Kalman filter for nonlinear and non-Gaussian sequential Bayesian filtering

Nonlinear Kalman Filtering based on Self-Attention Mechanism and Lattice Trajectory Piecewise Linear Approximation

PKF: Probabilistic Data Association Kalman Filter for Multi-Object Tracking

An Improved Kalman Filter Based on Long Short-Memory Recurrent Neural Network for Nonlinear Radar Target Tracking

Performance Evaluation of Deep Learning-Based State Estimation: A Comparative Study of KalmanNet