Abstract:The transportation system is moving towards higher levels of autonomy. Longitudinal speed control, or adaptive cruise control (ACC), is intended to provide driver assistance by controlling vehicle speed and maintaining a safe distance from the preceding vehicle. Artificial intelligence (AI) and machine learning (ML) paved the way for robust navigation and decision-making in complex environments. In this paper, we propose a comprehensive framework for speed control using a deep reinforcement learning algorithm for safety and comfort. We incorporate the deep deterministic policy gradient (DDPG) framework with an attention mechanism for this. Many works achieved smooth vehicle control output from the DDPG algorithm with different network structures, but we demonstrate that adding an attention mechanism improves the overall performance. The baseline DDPG framework is based on fully connected layers. However, when we bring the attention mechanism to the DDPG model, it helps to increase focus on the most important features and enhances the overall model effectiveness. We also designed a custom reward function as our priority is to improve overall safety and comfort. The efficacy of our model is evaluated in comparison to the baseline DDPG model, emphasizing the influence of the attention mechanism. We have performed an ablation study to determine the impact of the number of layers and neurons in the hidden layer. In addition, we tested this model on diverse datasets (simulated and real), including some unknown scenarios in the testing datasets. We demonstrate that our architecture has outperformed the state-of-the-art model, and is quite robust across different datasets.

Event-Triggered Parallel Control Using Deep Reinforcement Learning with Application to Comfortable Autonomous Driving

PEP: Policy-Embedded Trajectory Planning for Autonomous Driving

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Path tracking control based on Deep reinforcement learning in Autonomous driving

Combining Deep Reinforcement Learning and Safety Based Control for Autonomous Driving

Dynamic Target Following Control for Autonomous Vehicles with Deep Reinforcement Learning.

Deep Reinforcement Learning or Lyapunov Analysis? A Preliminary Comparative Study on Event-Triggered Optimal Control

Asynchronous Episodic Deep Deterministic Policy Gradient: Toward Continuous Control in Computationally Complex Environments

Deep reinforcement learning and reward shaping based eco-driving control for automated HEVs among signalized intersections

Distributed Drive Autonomous Vehicle Trajectory Tracking Control Based on Multi-Agent Deep Reinforcement Learning

Multi-Objective Optimization of Vehicle-Following Control for Connected Electric Vehicles Based on Deep Deterministic Policy Gradient

Path Tracking Control of Autonomous Ground Vehicles Via Model Predictive Control and Deep Deterministic Policy Gradient Algorithm

Deep reinforcement learning for autonomous driving in uncontrolled intersections of Indian roads

Enhancing Longitudinal Velocity Control With Attention Mechanism-Based Deep Deterministic Policy Gradient (DDPG) for Safety and Comfort

Model Predictive Adaptive Cruise Control of Intelligent Electric Vehicles Based on Deep Reinforcement Learning Algorithm FWOR Driver Characteristics

Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline

A Deep Reinforcement Learning Based Hierarchical Eco-Driving Strategy for Connected and Automated HEVs

An Automatic Driving Control Method Based on Deep Deterministic Policy Gradient

High-Speed Cornering Control and Real-Vehicle Deployment for Autonomous Electric Vehicles

Target tracking strategy using deep deterministic policy gradient