Abstract:We consider the challenging problem of high speed autonomous racing in a realistic Formula One environment. DeepRacing is a novel end-to-end framework, and a virtual testbed for training and evaluating algorithms for autonomous racing. The virtual testbed is implemented using the realistic F1 series of video games, developed by Codemasters, which many Formula One drivers use for training. This virtual testbed is released under an open-source license both as a standalone C++ API and as a binding to the popular Robot Operating System 2 (ROS2) framework. This open-source API allows anyone to use the high fidelity physics and photo-realistic capabilities of the F1 game as a simulator, and without hacking any game engine code. We use this framework to evaluate several neural network methodologies for autonomous racing. Specifically, we consider several fully end-to-end models that directly predict steering and acceleration commands for an autonomous race car as well as a model that predicts a list of waypoints to follow in the car's local coordinate system, with the task of selecting a steering/throttle angle left to a classical control algorithm. We also present a novel method of autonomous racing by training a deep neural network to predict a parameterized representation of a trajectory rather than a list of waypoints. We evaluate these models performance in our open-source simulator and show that trajectory prediction far outperforms end-to-end driving. Additionally, we show that open-loop performance for an end-to-end model, i.e. root-mean-square error for a model's predicted control values, does not necessarily correlate with increased driving performance in the closed-loop sense, i.e. actual ability to race around a track. Finally, we show that our proposed model of parameterized trajectory prediction outperforms both end-to-end control and waypoint prediction.

Autonomous Overtaking in Gran Turismo Sport Using Curriculum Reinforcement Learning

Super-Human Performance in Gran Turismo Sport Using Deep Reinforcement Learning

Outracing Human Racers with Model-based Autonomous Racing

Outracing champion Gran Turismo drivers with deep reinforcement learning

Expert Human-Level Driving in Gran Turismo Sport Using Deep Reinforcement Learning with Image-based Representation

Outracing Human Racers with Model-based Planning and Control for Time-trial Racing

Towards Optimal Head-to-head Autonomous Racing with Curriculum Reinforcement Learning

Gaussian Process Based Model Predictive Control for Overtaking in Autonomous Driving

Autonomous Driving at the Handling Limit Using Residual Reinforcement Learning

Game-Theoretic Model Predictive Control with Data-Driven Identification of Vehicle Model for Head-to-Head Autonomous Racing

A Super-human Vision-based Reinforcement Learning Agent for Autonomous Racing in Gran Turismo

Learning from Demonstration with Hierarchical Policy Abstractions Toward High-Performance and Courteous Autonomous Racing

Deep High-Level Policy Model Predictive Contour Control for Autonomous Racing.

Trajectory Planning Using Reinforcement Learning for Interactive Overtaking Maneuvers in Autonomous Racing Scenarios

Multi-policy Soft Actor-Critic Reinforcement Learning for Autonomous Racing

Heuristic Reinforcement Learning Based Overtaking Decision for an Autonomous Vehicle

Learning Dynamic Graph for Overtaking Strategy in Autonomous Driving

Residual Policy Learning Facilitates Efficient Model-Free Autonomous Racing

DeepRacing: Parameterized Trajectories for Autonomous Racing

A Deep Reinforcement Learning Based Approach for Autonomous Overtaking

Predictive Spliner: Data-Driven Overtaking in Autonomous Racing Using Opponent Trajectory Prediction