Abstract:Fully autonomous driving is considered one of the grand challenges of modern technology and a variety of approaches have emerged for creating and evaluating autonomous driving agents. The self-driving industry typically adopts a modular software architecture and uses large fleets of autonomous vehicles for data collection and evaluation. Simulation generally occupies a minor role in these workflows as a tool for basic unit tests and debugging. However, recent end-to-end methods in academia have elevated simulation’s role in the training of machine learning models and demonstrate state-of-the-art performance on simulated driving benchmarks as a result. In this thesis, we consider two questions. First, what are the state-ofthe-art approaches for end-to-end driving in simulation and how can we improve them? We use the open-source CARLA simulator as our testbed and work with the recent Leaderboard benchmark for evaluation. In our first project, we give a detailed failure analysis of “Learning by Cheating” (LBC) which has been considered the state-of-the-art in imitation learning. We then propose offline imitative reinforcement learning (OIRL) as an alternative approach and investigate its performance. In our second project, we give a failure analysis of the “World on Rails” (WOR) offline reinforcement learning method and propose “Slightly Online Reinforcement Learning” (SORL) as an improvement. Second, what value does simulation provide for the training and evaluation of driving algorithms? We draw attention to the crucial role that privileged information plays in both LBC and WOR’s algorithms. We emphasize that these methods are impossible to replicate without simulation and advocate for privileged information as an important tool for developing planning algorithms. Finally, we give a critical analysis of CARLA by pointing out issues in its perceptual and behavioral realism. We also critique the Leaderboard benchmark and provide discussion on why its primary metric cannot be reliably used as a proxy for good driving behavior.

A Monte Carlo Approach to Closing the Reality Gap

What Went Wrong? Closing the Sim-to-Real Gap via Differentiable Causal Discovery

Towards Closing the Sim-to-Real Gap in Collaborative Multi-Robot Deep Reinforcement Learning

Assessing Transferability From Simulation to Reality for Reinforcement Learning

Quantifying the Reality Gap in Robotic Manipulation Tasks

Validating Robotics Simulators on Real-World Impacts

A novel simulation reality closed loop learning framework for autonomous robot skill learning

Crossing the Reality Gap: A Survey on Sim-to-Real Transferability of Robot Controllers in Reinforcement Learning

Augmenting Differentiable Simulators with Neural Networks to Close the Sim2Real Gap

A Multi-Layered Approach for Measuring the Simulation-to-Reality Gap of Radar Perception for Autonomous Driving

How to Close Sim-Real Gap? Transfer with Segmentation!

Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL

Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomy

RoboGSim: A Real2Sim2Real Robotic Gaussian Splatting Simulator

End-to-end Methods for Autonomous Driving in Simulation

Safety-Critical Controller Verification via Sim2Real Gap Quantification

Learning to navigate efficiently and precisely in real environments

Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulation

DROID: Minimizing the Reality Gap Using Single-Shot Human Demonstration

Evaluating Real-World Robot Manipulation Policies in Simulation

Quantifying the Sim2real Gap for GPS and IMU Sensors