Abstract:The major challenge in mobile agent path planning, within an uncertain environment, is effectively determining an optimal control model to discover the target location as quickly as possible and evaluating the control system’s reliability. To address this challenge, we introduce a learning-verification integrated mobile agent path planning method to achieve both the effectiveness and the reliability. More specifically, we first propose a modified Q-learning algorithm (a popular reinforcement learning algorithm), called Q E A − l e a r n i n g algorithm, to find the best Q-table in the environment. We then determine the location transition probability matrix, and establish a probability model using the assumption that the agent selects a location with a higher Q-value. Secondly, the learnt behaviour of the mobile agent based on Q E A − l e a r n i n g algorithm, is formalized as a Discrete-time Markov Chain (DTMC) model. Thirdly, the required reliability requirements of the mobile agent control system are specified using Probabilistic Computation Tree Logic (PCTL). In addition, the DTMC model and the specified properties are taken as the input of the Probabilistic Model Checker PRISM for automatic verification. This is preformed to evaluate and verify the control system’s reliability. Finally, a case study of a mobile agent walking in a grids map is used to illustrate the proposed learning algorithm. Here we have a special focus on the modelling approach demonstrating how PRISM can be used to analyse and evaluate the reliability of the mobile agent control system learnt via the proposed algorithm. The results show that the path identified using the proposed integrated method yields the largest expected reward.

Probabilistic model checking for path planning in dynamic environ-ment

New Path Planner for Mobile Robot in Dynamic Unkown Environment

On-line Real-Time Path Planning of Mobile Robots in Dynamic Uncertain Environment

Real-Time Path Planning for Mobile Robots

Probabilistic Roadmap With Self-Learning For Path Planning Of A Mobile Robot In A Dynamic And Unstructured Environment

Mobile Agent Path Planning under Uncertain Environment Using Reinforcement Learning and Probabilistic Model Checking.

Path Planning for Robot in Multi-dimensional Environment Based on Dynamic PRM Blended Potential Field

Applying Probabilistic Model Checking to Path Planning for a Smart Multimodal Transportation System Using IoT Sensor Data

Dynamic path planning of mobile robots using adaptive dynamic programming

Predictive Probability Path Planning Model For Dynamic Environments

A Dynamic Subgoal Path Planner for Unpredictable Environments

An Indoor Path Planning and Motion Planning Method Based on POMDP

Mobile Robot Path Planning Based on Local Environment Modeling and Adaptive Window

A Hybrid Approach for Mobile Robot Path Planning in Dynamic Environments

A Model Based Path Planning Algorithm for Self-Driving Cars in Dynamic Environment

Path Planning in Environment with Moving Obstacles for Mobile Robot

Path Planning Approach Based On Probabilistic Roadmap For Sensor Based Car-Like Robot In Unknown Environments

Multi-risk Aware Trajectory Planning for Car-like Robot in Highly Dynamic Environments

Real-Time Path Planning Of Multiple Mobile Robots In A Dynamic Certain Environment

Research on path planning for mobile robot among dynamic obstacles

Rolling path planning of mobile robot in a kind of dynamic uncertain environment