Nobel Lecture. Protein phosphorylation and cellular regulation I.

E. Krebs

Bioscience Reports

Abstract:

What problem does this paper attempt to address?

Mapless Path Planning for Mobile Robot Based on Improved Deep Deterministic Policy Gradient Algorithm

Shuzhen Zhang,Wei Tang,Panpan Li,Fusheng Zha

DOI: https://doi.org/10.3390/s24175667

IF: 3.9

2024-09-03

Sensors

Abstract:In the traditional Deep Deterministic Policy Gradient (DDPG) algorithm, path planning for mobile robots in mapless environments still encounters challenges regarding learning efficiency and navigation performance, particularly adaptability and robustness to static and dynamic obstacles. To address these issues, in this study, an improved algorithm frame was proposed that designs the state and action spaces, and introduces a multi-step update strategy and a dual-noise mechanism to improve the reward function. These improvements significantly enhance the algorithm's learning efficiency and navigation performance, rendering it more adaptable and robust in complex mapless environments. Compared to the traditional DDPG algorithm, the improved algorithm shows a 20% increase in the stability of the navigation success rate with static obstacles along with a 25% reduction in pathfinding steps for smoother paths. In environments with dynamic obstacles, there is a remarkable 45% improvement in success rate. Real-world mobile robot tests further validated the feasibility and effectiveness of the algorithm in true mapless environments.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Research on robot path planning based on improved A* algorithm and DWA

ZHAO Jiuqiang,ZHAO Tinghui,FENG Yiping,CAO Zheng,ZHONG Yufang

DOI: https://doi.org/10.16791/j.cnki.sjg.2023.03.015

2023-01-01

Abstract:The traditional A* algorithm does not take into account the actual travel time of the mobile robot, there are many turning points in path planning, and it is unable deal with random obstacles in complex environments.Aiming at the above problems, an improved A* algorithm that takes the travel time of the mobile robot as the cost and can adjust the weight of the heuristic function according to the obstacle information is proposed, which effectively reduces the number of turns and the turning angle in path planning. Further optimization is carried out using the Floyd algorithm to remove redundant turning points, reduce the number of turns and improve the smoothness of the path. Compared with the traditional A* algorithm, the path planned by the improved A * algorithm reduces the average number of turns by 49.0%, the turning angle by 50.8%, and the path length by 1.7%.After integrating the DWA algorithm, the local path correction can be performed on the basis of the global path planned by the improved A * algorithm to achieve dynamic obstacle avoidance. Finally, the feasibility and effectiveness of the algorithm are verified by simulation.
Research on Dynamic Path Planning of Mobile Robot Based on Improved DDPG Algorithm

Peng Li,Xiangcheng Ding,Hongfang Sun,Shiquan Zhao,Ricardo Cajo

DOI: https://doi.org/10.1155/2021/5169460

2021-11-12

Mobile Information Systems

Abstract:Aiming at the problems of low success rate and slow learning speed of the DDPG algorithm in path planning of a mobile robot in a dynamic environment, an improved DDPG algorithm is designed. In this article, the RAdam algorithm is used to replace the neural network optimizer in DDPG, combined with the curiosity algorithm to improve the success rate and convergence speed. Based on the improved algorithm, priority experience replay is added, and transfer learning is introduced to improve the training effect. Through the ROS robot operating system and Gazebo simulation software, a dynamic simulation environment is established, and the improved DDPG algorithm and DDPG algorithm are compared. For the dynamic path planning task of the mobile robot, the simulation results show that the convergence speed of the improved DDPG algorithm is increased by 21%, and the success rate is increased to 90% compared with the original DDPG algorithm. It has a good effect on dynamic path planning for mobile robots with continuous action space.

computer science, information systems,telecommunications
Efficient Path Planning for Mobile Robot Based on Deep Deterministic Policy Gradient

Hui Gong,Peng Wang,Cui Ni,Nuo Cheng

DOI: https://doi.org/10.3390/s22093579

IF: 3.9

2022-05-09

Sensors

Abstract:When a traditional Deep Deterministic Policy Gradient (DDPG) algorithm is used in mobile robot path planning, due to the limited observable environment of mobile robots, the training efficiency of the path planning model is low, and the convergence speed is slow. In this paper, Long Short-Term Memory (LSTM) is introduced into the DDPG network, the former and current states of the mobile robot are combined to determine the actions of the robot, and a Batch Norm layer is added after each layer of the Actor network. At the same time, the reward function is optimized to guide the mobile robot to move faster towards the target point. In order to improve the learning efficiency, different normalization methods are used to normalize the distance and angle between the mobile robot and the target point, which are used as the input of the DDPG network model. When the model outputs the next action of the mobile robot, mixed noise composed of Gaussian noise and Ornstein–Uhlenbeck (OU) noise is added. Finally, the simulation environment built by a ROS system and a Gazebo platform is used for experiments. The results show that the proposed algorithm can accelerate the convergence speed of DDPG, improve the generalization ability of the path planning model and improve the efficiency and success rate of mobile robot path planning.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
A path planning algorithm fusion of obstacle avoidance and memory functions

Qingchun Zheng,Shubo Li,Peihao Zhu,Wenpeng Ma,Yanlu Wang

DOI: https://doi.org/10.1049/ccs2.12098

2023-12-10

Cognitive Computation and Systems

Abstract:In this study, to address the issues of sluggish convergence and poor learning efficiency at the initial stages of training, the authors improve and optimise the Deep Deterministic Policy Gradient (DDPG) algorithm. First, inspired by the Artificial Potential Field method, the selection strategy of DDPG has been improved to accelerate the convergence speed during the early stages of training and reduce the time it takes for the mobile robot to reach the target point. Then, optimising the neural network structure of the DDPG algorithm based on the Long Short‐Term Memory accelerates the algorithm's convergence speed in complex dynamic scenes. Static and dynamic scene simulation experiments of mobile robots are carried out in ROS. Test findings demonstrate that the Artificial Potential Field method‐Long Short Term Memory Deep Deterministic Policy Gradient (APF‐LSTM DDPG) algorithm converges significantly faster in complex dynamic scenes. The success rate is improved by 7.3% and 3.6% in contrast to the DDPG and LSTM‐DDPG algorithms. Finally, the usefulness of the method provided in this study is similarly demonstrated in real situations using real mobile robot platforms, laying the foundation for the path planning of mobile robots in complex changing conditions.
Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

Laiyi Yang,Jing Bi,Haitao Yuan

DOI: https://doi.org/10.1016/j.ifacol.2022.08.042

2022-01-01

Abstract:Traditional path planning algorithms for mobile robots are not effective to solve high-dimensional problems, and suffer from slow convergence and complex modelling. Therefore, it is highly essential to design a more efficient algorithm to realize intelligent path planning of mobile robots. This work proposes an improved path planning algorithm, which is based on the algorithm of Soft Actor-Critic (SAC). It attempts to solve a problem of poor robot performance in complicated environments with static and dynamic obstacles. This work designs an improved reward function to enable mobile robots to quickly avoid obstacles and reach targets by using state dynamic normalization and priority replay buffer techniques. To evaluate its performance, a Pygame-based simulation environment is constructed. The proposed method is compared with a Proximal Policy Optimization (PPO) algorithm in the simulation environment. Experimental results demonstrate that the cumulative reward of the proposed method is much higher than that of PPO, and it is also more robust than PPO.
Bidirectional Obstacle Avoidance Enhancement‐Deep Deterministic Policy Gradient: A Novel Algorithm for Mobile‐Robot Path Planning in Unknown Dynamic Environments

Junxiao Xue,Shiwen Zhang,Yafei Lu,Xiaoran Yan,Yuanxun Zheng

DOI: https://doi.org/10.1002/aisy.202300444

IF: 7.298

2024-02-08

Advanced Intelligent Systems

Abstract:A novel deep reinforcement learning‐based method called bidirectional obstacle avoidance enhancement‐deep deterministic policy gradient (BOAE‐DDPG) for mobile‐robot path planning in unknown dynamic environments is proposed. The core BOAE mechanism is inspired by dynamic psychology, making BOAE‐DDPG better at learning obstacle avoidance without relying on environmental information. In addition, new assisted reward factors designed for path planning promote learning and convergence. Real‐time path planning in unknown dynamic environments is a significant challenge for mobile robots. Many researchers have attempted to solve this problem by introducing deep reinforcement learning, which trains agents through interaction with their environments. A method called BOAE‐DDPG, which combines the novel bidirectional obstacle avoidance enhancement (BOAE) mechanism with the deep deterministic policy gradient (DDPG) algorithm, is proposed to enhance the learning ability of obstacle avoidance. Inspired by the analysis of the reaction advantage in dynamic psychology, the BOAE mechanism focuses on obstacle‐avoidance reactions from the state and action. The cross‐attention mechanism is incorporated to enhance the attention to valuable obstacle‐avoidance information. Meanwhile, the obstacle‐avoidance behavioral advantage is separately estimated using the modified dueling network. Based on the learning goals of the mobile robot, new assistive reward factors are incorporated into the reward function to promote learning and convergence. The proposed method is validated through several experiments conducted using the simulation platform Gazebo. The results show that the proposed method is suitable for path planning tasks in unknown environments and has an excellent obstacle‐avoidance learning capability.
Intelligent Navigation of Indoor Robot Based on Improved DDPG Algorithm

Xuemei He,Yin Kuang,Ning Song,Fan Liu

DOI: https://doi.org/10.1155/2023/6544029

IF: 1.43

2023-04-15

Mathematical Problems in Engineering

Abstract:Targeting the problem of autonomous navigation of indoor robots in large-scale, complicated, and unknown environments, an autonomous online decision-making algorithm based on deep reinforcement learning is put forward in this paper. Traditional path planning methods rely on the environment modeling, which can cause more workload of calculating. In this paper, the sensors to detect surrounding obstacles are combined with the DDPG (deep deterministic policy gradient) algorithm to input environmental perception and control the action direct output, which enables robots to complete the tasks of autonomous navigation and distribution without relying on environment modeling. In addition, the algorithm preprocesses the relevant data in the learning sample with Gaussian noise, facilitating the agent to adapt to noisy training environment and improve its robustness. The simulation results show that the optimized DL-DDPG algorithm is more efficient on online decision-making for the indoor robot navigation system, which enables the robot to complete autonomous navigation and intelligent control independently.

engineering, multidisciplinary,mathematics, interdisciplinary applications
Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Yu Cao,Kan Ni,Xiongwen Jiang,Taiga Kuroiwa,Haohao Zhang,Takahiro Kawaguchi,Seiji Hashimoto,Wei Jiang

DOI: https://doi.org/10.3390/app13116847

2023-01-01

Abstract:The potential of autonomous driving technology to revolutionize the transportation industry has attracted significant attention. Path following, a fundamental task in autonomous driving, involves accurately and safely guiding a vehicle along a specified path. Conventional path-following methods often rely on rule-based or parameter-tuning aspects, which may not be adaptable to complex and dynamic scenarios. Reinforcement learning (RL) has emerged as a promising approach that can learn effective control policies from experience without prior knowledge of system dynamics. This paper investigates the effectiveness of the Deep Deterministic Policy Gradient (DDPG) algorithm for steering control in ground vehicle path following. The algorithm quickly converges and the trained agent achieves stable and fast path following, outperforming three baseline methods. Additionally, the agent achieves smooth control without excessive actions. These results validate the proposed approach’s effectiveness, which could contribute to the development of autonomous driving technology.
Research on Dynamic Path Planning of Wheeled Robot Based on Deep Reinforcement Learning on the Slope Ground

Peng Wang,Xiaoqiang Li,Chunxiao Song,Shipeng Zhai

DOI: https://doi.org/10.1155/2020/7167243

2020-02-01

Journal of Robotics

Abstract:The existing dynamic path planning algorithm cannot properly solve the problem of the path planning of wheeled robot on the slope ground with dynamic moving obstacles. To solve the problem of slow convergence rate in the training phase of DDQN, the dynamic path planning algorithm based on Tree-Double Deep Q Network (TDDQN) is proposed. The algorithm discards detected incomplete and over-detected paths by optimizing the tree structure, and combines the DDQN method with the tree structure method. Firstly, DDQN algorithm is used to select the best action in the current state after performing fewer actions, so as to obtain the candidate path that meets the conditions. And then, according to the obtained state, the above process is repeatedly executed to form multiple paths of the tree structure. Finally, the non-maximum suppression method is used to select the best path from the plurality of eligible candidate paths. ROS simulation and experiment verify that the wheeled robot can reach the target effectively on the slope ground with moving obstacles. The results show that compared with DDQN algorithm, TDDQN has the advantages of fast convergence and low loss function.
A Path Planning Algorithm Based on Deep Reinforcement Learning for Mobile Robots in Unknown Environment

B. Qiao,Yuxuan Deng,Hao Qin,Wenjia Wu

DOI: https://doi.org/10.1109/IMCEC55388.2022.10020025

2022-12-16

Abstract:The path planning is one of the hottest issues of the mobile robotics, which is to find an optimized path for the robot to reach the target location from a start position. In this research a Proximal Policy Optimization (PPO) algorithm, which is by far the most widely used and efficient Deep Reinforcement Learning (DRL) algorithm, is applied to plan a safe and collision-free path from the initial position to the target one for the mobile robot in an unknown environment where a global map of the environment is unavailable for the robot during the planning. The mobile robot can only obtain the local information of the environment through the Lidar installed on it. The path planning of the mobile robots is modeled as a Partially Observed Markov Decision Problem (POMDP), of which the state space is represented by the position of the target relative to the mobile robot and the distance information obtained by the 2D-lidar, the action space is represented by the position for the mobile robot to reach in the next step. The execution of motion controller is only conducted for the robot to implement the learned strategy rather than conducted in the whole learning episodes during the training phase, which resulted in a great improvement in the training efficiency. Computer simulations demonstrated the effectiveness of the proposed approach.

Engineering,Computer Science
Path planning of mobile robot based on improved TD3 algorithm in dynamic environment

Peng Li,Donghui Chen,Yuchen Wang,Lanyong Zhang,Shiquan Zhao

DOI: https://doi.org/10.1016/j.heliyon.2024.e32167

IF: 3.776

2024-05-31

Heliyon

Abstract:This paper proposes an improved TD3 (Twin Delayed Deep Deterministic Policy Gradient) algorithm to address the flaws of low success rate and slow training speed, when using the original TD3 algorithm in mobile robot path planning in dynamic environment. Firstly, prioritized experience replay and transfer learning are introduced to enhance the learning efficiency, where the probability of beneficial experiences being sampled in the experience pool is increased, and the pre-trained model is applied in an obstacle-free environment as the initial model for training in a dynamic environment. Secondly, dynamic delay update strategy is devised and OU noise is added to improve the success rate of path planning, where the probability of missing high-quality value estimate is reduced through changing the delay update interval dynamically, and the correlated exploration of the mobile robot inertial navigation system in the dynamic environment is temporally improved. The algorithm is tested by simulation where the Turtlebot3 robot model as a training object, the ROS melodic operating system and Gazebo simulation software as an experimental environment. Meanwhile, the result shows that the improved TD3 algorithm has a 16.6 % increase in success rate and a 23.5 % reduction in algorithm training time. A generalization experiment was designed finally, and it indicates that superior generation performance has been acquired in mobile robot path planning with continuous action spaces through the improved TD3 algorithm.
Immune deep reinforcement learning-based path planning for mobile robot in unknown environment

Chengliang Yan,Guangzhu Chen,Yang Li,Fuchun Sun,Yuanyuan Wu

DOI: https://doi.org/10.1016/j.asoc.2023.110601

2023-07-21

Applied Soft Computing Journal

Abstract:A new deep deterministic policy gradient (DDPG) integrating kinematics analysis and immune optimization (KAI-DDPG) is proposed to address the drawbacks of DDPG in path planning. An orientation angle reward component, linear velocity reward factor, and safety performance reward factor are added to the DDPG reward function based on kinematic modeling and analysis of mobile robots. A multi-objective performance index turns the path planning problem into one of multi-objective optimization. We propose KA-DDPG, which uses the orientation angle, linear speed, and safety degree as evaluation indices, and information entropy to alter the influence coefficient of the multi-objective function in the reward function. KAI-DDPG is proposed to address the low learning and training efficiency of KA-DDPG, using immune optimization to optimize the experience samples in the experience buffer pool. Performance indices of traditional path planning and the proposed techniques are compared on a gazebo simulation platform, and the results suggest that KAI-DDPG can mitigate the drawbacks of DDPG, such as a protracted training cycle and poor path planning technique, and can broaden the range of application.
A decentralized path planning model based on deep reinforcement learning

Dong Guo,Shouwen Ji,Yanke Yao,Cheng Chen

DOI: https://doi.org/10.1016/j.compeleceng.2024.109276

IF: 4.152

2024-05-07

Computers & Electrical Engineering

Abstract:The escalating usage of automated guided vehicles (AGVs) on a grand scale accentuates the scalability limitations inherent in traditional, centrally-controlled path planning algorithms. Addressing this challenge, we introduce a pioneering decentralized path planning model, DPPDRL, built upon the foundations of deep reinforcement learning. Drawing inspiration from human path planning and dynamic coupling techniques, DPPDRL imbues AGVs with the autonomy to independently dictate and dynamically adapt their paths in real time. Notably, DPPDRL champions the adoption of diverse policies, thereby facilitating efficient collision avoidance and exploration of potential routes. Simulation-based evidence substantiates critical findings, including remarkable improvements in training speed and scalability, heightened adaptability to environmental variations and agent number changes, and applicability across any number of AGVs, provided a reasonable task distribution. However, DPPDRL's performance becomes limited when tasks are densely concentrated. Addressing this issue through task distribution and hierarchical reinforcement learning is a promising direction for future research. These findings underscore the transformative potential of DPPDRL in managing extensive, dynamic AGV operations.

engineering, electrical & electronic,computer science, interdisciplinary applications, hardware & architecture
Dynamic path planning of mobile robots using adaptive dynamic programming

Xin Li,Lei Wang,Yi An,Qi-Li Huang,Yun-Hao Cui,Huo-Sheng Hu

DOI: https://doi.org/10.1016/j.eswa.2023.121112

IF: 8.5

2023-08-20

Expert Systems with Applications

Abstract:Dynamic path planning has gained increasing popularity in mobile robot navigation . Some of the current path planning methods require a priori information about the motion space and are easily affected by the distribution of obstacles. To address the above limitation, this paper presents a novel dynamic method that transforms path planning into an optimal control problem and solves it dynamically through adaptive dynamic programming and artificial potential field . The proposed method can obtain optimal paths for a differentially-driven mobile robot model in an unknown environment with many irregular obstacles. First, by combining path optimization and kinematical constraints of the mobile robot, the original problem is transformed into a new problem. Second, the total distance traveled, the effect of heading angle, the distance from the target to the robot, and the resultant force of the artificial potential field are included in the new performance index function. Third, the method based on adaptive dynamic programming is developed to avoid obstacles and guarantee the safety of autonomous navigation . The convergence analysis provides theoretical guarantees for our method, and the iterative control sequence will converge to the optimal control. Furthermore, simulation results and analyses under different complexity levels demonstrate that our method has promising performance in exploring and exploiting dynamic path planning problems.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Multi-Agent Path Planning based on MPC and DDPG

Junxiao Xue,Xiangyan Kong,Bowei Dong,Mingliang Xu

DOI: https://doi.org/10.48550/arXiv.2102.13283

IF: 14.4

2021-02-26

Artificial Intelligence

Abstract:The problem of mixed static and dynamic obstacle avoidance is essential for path planning in highly dynamic environment. However, the paths formed by grid edges can be longer than the true shortest paths in the terrain since their headings are artificially constrained. Existing methods can hardly deal with dynamic obstacles. To address this problem, we propose a new algorithm combining Model Predictive Control (MPC) with Deep Deterministic Policy Gradient (DDPG). Firstly, we apply the MPC algorithm to predict the trajectory of dynamic obstacles. Secondly, the DDPG with continuous action space is designed to provide learning and autonomous decision-making capability for robots. Finally, we introduce the idea of the Artificial Potential Field to set the reward function to improve convergence speed and accuracy. We employ Unity 3D to perform simulation experiments in highly uncertain environment such as aircraft carrier decks and squares. The results show that our method has made great improvement on accuracy by 7%-30% compared with the other methods, and on the length of the path and turning angle by reducing 100 units and 400-450 degrees compared with DQN (Deep Q Network), respectively.
Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Yulei Gu,Jiao Zhao,Hui Hu,Wenjie Tong,Yuge Wang

DOI: https://doi.org/10.3390/app131810056

2023-09-06

Applied Sciences

Abstract:Autonomous vehicles can reduce labor power during cargo transportation, and then improve transportation efficiency, for example, the automated guided vehicle (AGV) in the warehouse can improve the operation efficiency. To overcome the limitations of traditional path planning algorithms in unknown environments, such as reliance on high-precision maps, lack of generalization ability, and obstacle avoidance capability, this study focuses on investigating the Deep Q-Network and its derivative algorithm to enhance network and algorithm structures. A new algorithm named APF-D3QNPER is proposed, which combines the action output method of artificial potential field (APF) with the Dueling Double Deep Q Network algorithm, and experience sample rewards are considered in the experience playback portion of the traditional Deep Reinforcement Learning (DRL) algorithm, which enhances the convergence ability of the traditional DRL algorithm. A long short-term memory (LSTM) network is added to the state feature extraction network part to improve its adaptability in unknown environments and enhance its spatiotemporal sensitivity to the environment. The APF-D3QNPER algorithm is compared with mainstream deep reinforcement learning algorithms and traditional path planning algorithms using a robot operating system and the Gazebo simulation platform by conducting experiments. The results demonstrate that the APF-D3QNPER algorithm exhibits excellent generalization abilities in the simulation environment, and the convergence speed, the loss value, the path planning time, and the path planning length of the APF-D3QNPER algorithm are all less than for other algorithms in diverse scenarios.

Engineering,Computer Science
Path Planning in Complex Environments Using Attention-Based Deep Deterministic Policy Gradient

Jinlong Chen,Yun Jiang,Hongren Pan,Minghao Yang

DOI: https://doi.org/10.3390/electronics13183746

IF: 2.9

2024-09-21

Electronics

Abstract:The traditional Deep Deterministic Policy Gradient (DDPG) algorithm frequently exhibits a notable reduction in success rate when transferred to new environments after being trained in complex simulation settings. To address these issues, this paper adopts a Multi-Environment (Multi-Env) parallel training approach and integrates Multi-Head Attention (MHA) and Prioritized Experience Replay (PER) into the DDPG framework, optimizing the reward function to form the MAP-DDPG algorithm. This approach enhances the algorithm's generalization capability and execution efficiency. Through comparative training and testing of the DDPG and MAP-DDPG algorithms in both simulation and real-world environments, the experimental results demonstrate that MAP-DDPG significantly improves generalization and execution efficiency over the DDPG algorithm. Specifically, in simulation environment tests, the MAP-DDPG algorithm achieved an average 30% increase in success rate and reduced the average time to reach the target point by 23.7 s compared to the DDPG algorithm. These results indicate that the MAP-DDPG algorithm significantly enhances path planning generalization and execution efficiency, providing a more effective solution for path planning in complex environments.

engineering, electrical & electronic,computer science, information systems,physics, applied
Exploration- and Exploitation-Driven Deep Deterministic Policy Gradient for Active SLAM in Unknown Indoor Environments

Shengmin Zhao,Seung-Hoon Hwang

DOI: https://doi.org/10.3390/electronics13050999

IF: 2.9

2024-03-07

Electronics

Abstract:This study proposes a solution for Active Simultaneous Localization and Mapping (Active SLAM) of robots in unknown indoor environments using a combination of Deep Deterministic Policy Gradient (DDPG) path planning and the Cartographer algorithm. To enhance the convergence speed of the DDPG network and minimize collisions with obstacles, we devised a unique reward function that integrates exploration and exploitation strategies. The exploration strategy allows the robot to achieve the shortest running time and movement trajectory, enabling efficient traversal of unmapped environments. Moreover, the exploitation strategy introduces active closed loops to enhance map accuracy. We conducted experiments using the simulation platform Gazebo to validate our proposed model. The experimental results demonstrate that our model surpasses other Active SLAM methods in exploring and mapping unknown environments, achieving significant grid completeness of 98.7%.

engineering, electrical & electronic,computer science, information systems,physics, applied
An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving

Kai Yang,Li Liu

DOI: https://doi.org/10.1109/access.2024.3400159

IF: 3.9

2024-05-22

IEEE Access

Abstract:In the domain of intelligent transportation systems, the advent of autonomous driving technology represents a critical milestone, profoundly shaping the automotive industry's evolutionary path. This technology's core, particularly the algorithms facilitating driverless path planning, has attracted significant scholarly interest. This paper presents an advanced Deep Reinforcement Learning algorithm for Path Planning (DRL-PP), designed to rectify the shortcomings inherent in existing path planning techniques. Considering the complex nature of the environment, the DRL-PP algorithm is meticulously crafted to ascertain optimal actions, thereby effectively reducing the propensity for overfitting. The algorithm harnesses the capabilities of deep reinforcement learning, utilizing neural networks to identify the most advantageous action corresponding to a specific state. It then constructs an optimal action sequence, extending from the vehicle's initial position to its designated target. Additionally, the algorithm enhances the reward function by incorporating data pertinent to the objective. This refinement enables the nuanced differentiation of action values based on dynamically adjusted reward metrics, thereby augmenting the efficiency of the action selection process and yielding improved results in path planning. Empirical results validate the algorithm's proficiency in stabilizing the reward metric while minimizing exploratory steps, consistently surpassing comparative models in path-finding effectiveness.

computer science, information systems,telecommunications,engineering, electrical & electronic

Nobel Lecture. Protein phosphorylation and cellular regulation I.

Mapless Path Planning for Mobile Robot Based on Improved Deep Deterministic Policy Gradient Algorithm

Research on robot path planning based on improved A* algorithm and DWA

Research on Dynamic Path Planning of Mobile Robot Based on Improved DDPG Algorithm

Efficient Path Planning for Mobile Robot Based on Deep Deterministic Policy Gradient

A path planning algorithm fusion of obstacle avoidance and memory functions

Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

Bidirectional Obstacle Avoidance Enhancement‐Deep Deterministic Policy Gradient: A Novel Algorithm for Mobile‐Robot Path Planning in Unknown Dynamic Environments

Intelligent Navigation of Indoor Robot Based on Improved DDPG Algorithm

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Research on Dynamic Path Planning of Wheeled Robot Based on Deep Reinforcement Learning on the Slope Ground

A Path Planning Algorithm Based on Deep Reinforcement Learning for Mobile Robots in Unknown Environment

Path planning of mobile robot based on improved TD3 algorithm in dynamic environment

Immune deep reinforcement learning-based path planning for mobile robot in unknown environment

A decentralized path planning model based on deep reinforcement learning

Dynamic path planning of mobile robots using adaptive dynamic programming

Multi-Agent Path Planning based on MPC and DDPG

Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Path Planning in Complex Environments Using Attention-Based Deep Deterministic Policy Gradient

Exploration- and Exploitation-Driven Deep Deterministic Policy Gradient for Active SLAM in Unknown Indoor Environments

An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving