A variable structure multi-model maneuvering target tracking algorithm based on Monte Carlo learning
Shen-tu Han,Haoye Zhang,Yiming Zhu,Xinliang Wu,Long Teng
DOI: https://doi.org/10.1049/rsn2.12464
2023-01-01
Abstract:A well-liked maneuvering target tracking algorithm is a variable structure multi-model (VSMM). One of the crucial elements determining the tracking effect is the successful model set adaptation (MSA). The ability to further enhance tracking accuracy for the conventional VSMM method is constrained by the absence of a mechanism to thoroughly utilise observation and tracking data to optimise MSA. We incorporate the Reinforcement learning (RL) approach into the MSA procedure to address this issue and provide a VSMM algorithm based on Monte Carlo (MC) learning. To formulate the challenge of optimising the number of effective models as a RL problem, we first used the prediction error, the number of effective model sets, and tracking accuracy to build the models of the appropriate state space, decision space, and reward. The number of efficient models was optimised using MC learning, and the entire VSMM algorithm was then created. The proposed approach was compared to the simulated experiment's five maneuvering target tracking algorithms. The outcomes demonstrate that the suggested algorithm has a lower computation scale and accurate tracking accuracy. We incorporate Monte Carlo learning into the LMS-VSMM algorithm framework and propose an MC-LMS-VSMM maneuvering target tracking algorithm. Firstly, the prediction error, number of effective models, and tracking errors were modelled as reward-related states, actions, and rewards. Secondly, the number of effective models was then optimised via MC learning. Finally, a comprehensive MC-LMS-VSMM tracking algorithm is built.image