Research on Geomagnetic Perceiving Navigation Method Based on Deep Reinforcement Learning

Li Hong,Xu yan,Liu yu
DOI: https://doi.org/10.21203/rs.3.rs-5113044/v1
2024-01-01
Abstract:Path planning and navigation of Autonomous Underwater Vehicles face great challenges in unknown environments without a prior information. In this paper, a deep Q-network-based geomagnetic sensing navigation method is proposed to solve the navigation problem without a prior maps. By constructing a deep Q-network model, the method utilizes the powerful representation capability of deep learning to handle complex geomagnetic sensing data. Meanwhile, an action selection strategy combining heuristic and greedy search is introduced to balance exploration and exploitation and enhance the autonomous navigation capability of underwater vehicles in unknown environments. The strategy dynamically adjusts the exploration probability based on the distance to the target, ensuring effective exploration at an early stage and efficient utilization of the learned knowledge when approaching the target. Moreover, the Autonomous Underwater Vehicle explores the environment using local geomagnetic data and trains a regression model to predict the global geomagnetic map. Simulation results show that the method is significantly effective in reducing path lengths, improving exploration efficiency, and enhancing geomagnetic map accuracy. The results show that the method significantly improves the robot's navigation performance in unknown environments and provides a new way to construct geomagnetic maps.
What problem does this paper attempt to address?