Multi-step Dual Control for Exploration and Exploitation in Autonomous Search with Convergence Guarantee

Yuan Tan,Jun Yang,Wen-Hua Chen,Shihua Li
DOI: https://doi.org/10.1109/tii.2024.3366979
IF: 12.3
2024-01-01
IEEE Transactions on Industrial Informatics
Abstract:Inspired by the concept of recently proposed dual control for exploration and exploitation, this article presents a multistep dual control for exploration and exploitation with guaranteed convergence in search for autonomous sources. To deal with an unknown source position and environment, the proposed dual control algorithm faces significant challenges in demonstrating its recursive feasibility and convergence. With the help of the properties of Bayesian estimators, we redesign a multistep dual control for exploitation and exploration algorithm with necessary terminal ingredients and show that the recursive feasibility and the convergence of the modified dual control algorithm are guaranteed. Two simulation scenarios are conducted, which demonstrate that the proposed algorithm outperforms the stochastic model-predictive control approach and the informative path planning approach in terms of searching successful rates and efficiency.
What problem does this paper attempt to address?