Abstract:Abstract Urban complex scenarios are the most challenging situations in the field of Autonomous Driving (AD). In that sense, an AD pipeline should be tested in countless environments and scenarios, escalating the cost and development time exponentially with a physical approach. In this paper we present a validation of our fully-autonomous driving architecture using the NHTSA (National Highway Traffic Safety Administration) protocol in the CARLA simulator, focusing on the analysis of our decision-making module, based on Hierarchical Interpreted Binary Petri Nets (HIBPN). First, the paper states the importance of using hyper-realistic simulators, as a preliminary help to real test, as well as an appropriate design of the traffic scenarios as the two current keys to build safe and robust AD technology. Second, our pipeline is introduced, which exploits the concepts of standard communication in robotics using the Robot Operating System (ROS) and the Docker approach to provide the system with isolation, flexibility and portability, describing the main modules and approaches to perform the navigation. Third, the CARLA simulator is described, outlining the steps carried out to merge our architecture with the simulator and the advantages to create ad-hoc driving scenarios for use cases validation instead of just modular evaluation. Finally, the architecture is validated using some challenging driving scenarios such as Pedestrian Crossing, Stop, Adaptive Cruise Control (ACC) and Unexpected Pedestrian. Some qualitative (video files: Simulation Use Cases ) and quantitative (linear velocity and trajectory splitted in the corresponding HIBPN states) results are presented for each use case, as well as an analysis of the temporal graphs associated to the Vulnerable Road Users (VRU) cases, validating our architecture in simulation as a preliminary stage before implementing it in our real autonomous electric car.

Deep Reinforcement Learning based control algorithms: Training and validation using the ROS Framework in CARLA Simulator for Self-Driving applications

Deep reinforcement learning based control for Autonomous Vehicles in CARLA

Train here, drive there: ROS based end-to-end autonomous-driving pipeline validation in CARLA simulator using the NHTSA typology

Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA

A reinforcement learning based autonomous vehicle control in diverse daytime and weather scenarios

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Reinforcement Learning-Based Autonomous Driving at Intersections in CARLA Simulator

Exploring applications of deep reinforcement learning for real-world autonomous driving systems

Autonomous Driving with Deep Reinforcement Learning in CARLA Simulation

Deep Reinforcement Learning framework for Autonomous Driving

A Software Architecture for Autonomous Vehicles: Team LRM-B Entry in the First CARLA Autonomous Driving Challenge

Modelling, Positioning, and Deep Reinforcement Learning Path Tracking Control of Scaled Robotic Vehicles: Design and Experimental Validation

Deep-Reinforcement-Learning-Based Collision Avoidance of Autonomous Driving System for Vulnerable Road User Safety

Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers

Reinforcement Learning from Simulation to Real World Autonomous Driving using Digital Twin

Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control

Deep Reinforcement Learning for Autonomous Driving Systems

Self-Learning Robot Autonomous Navigation with Deep Reinforcement Learning Techniques

Integrating Deep Reinforcement Learning with Model-based Path Planners for Automated Driving

Deep Reinforcement Learning with Intervention Module for Autonomous Driving.

Racing Towards Reinforcement Learning based control of an Autonomous Formula SAE Car