Non-Myopic Target Tracking Strategies for State-Dependent Noise

Zhonghshun Zhang,Pratap Tokekar

DOI: https://doi.org/10.48550/arXiv.1611.02343

2016-11-08

Abstract:We study the problem of devising a closed-loop strategy to control the position of a robot that is tracking a possibly moving target. The robot is capable of obtaining noisy measurements of the target's position. The key idea in active target tracking is to choose control laws that drive the robot to measurement locations that will reduce the uncertainty in the target's position. The challenge is that measurement uncertainty often is a function of the (unknown) relative positions of the target and the robot. Consequently, a closed-loop control policy is desired which can map the current estimate of the target's position to an optimal control law for the robot. Our main contribution is to devise a closed-loop control policy for target tracking that plans for a sequence of control actions, instead of acting greedily. We consider scenarios where the noise in measurement is a function of the state of the target. We seek to minimize the maximum uncertainty (trace of the posterior covariance matrix) over all possible measurements. We exploit the structural properties of a Kalman Filter to build a policy tree that is orders of magnitude smaller than naive enumeration while still preserving optimality guarantees. We show how to obtain even more computational savings by relaxing the optimality guarantees. The resulting algorithms are evaluated through simulations.

Robotics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to design a closed - loop control strategy to control the position of a robot in the presence of state - dependent noise in order to track a potentially moving target. Specifically, the paper focuses on how to plan a series of control actions for the robot to reduce the uncertainty in estimating the target position when the value of future measured positions depends on the unknown target state. The main contribution of the paper lies in proposing a closed - loop control strategy that plans a series of control actions instead of adopting a greedy strategy, and uses the structural characteristics of the Kalman filter to construct a policy tree that is several orders of magnitude smaller than simple enumeration while retaining the optimality guarantee. In addition, the paper also shows a method that can further save computational resources by relaxing the optimality guarantee. These algorithms are evaluated through simulation.