Abstract:Fully autonomous driving is considered one of the grand challenges of modern technology and a variety of approaches have emerged for creating and evaluating autonomous driving agents. The self-driving industry typically adopts a modular software architecture and uses large fleets of autonomous vehicles for data collection and evaluation. Simulation generally occupies a minor role in these workflows as a tool for basic unit tests and debugging. However, recent end-to-end methods in academia have elevated simulation’s role in the training of machine learning models and demonstrate state-of-the-art performance on simulated driving benchmarks as a result. In this thesis, we consider two questions. First, what are the state-ofthe-art approaches for end-to-end driving in simulation and how can we improve them? We use the open-source CARLA simulator as our testbed and work with the recent Leaderboard benchmark for evaluation. In our first project, we give a detailed failure analysis of “Learning by Cheating” (LBC) which has been considered the state-of-the-art in imitation learning. We then propose offline imitative reinforcement learning (OIRL) as an alternative approach and investigate its performance. In our second project, we give a failure analysis of the “World on Rails” (WOR) offline reinforcement learning method and propose “Slightly Online Reinforcement Learning” (SORL) as an improvement. Second, what value does simulation provide for the training and evaluation of driving algorithms? We draw attention to the crucial role that privileged information plays in both LBC and WOR’s algorithms. We emphasize that these methods are impossible to replicate without simulation and advocate for privileged information as an important tool for developing planning algorithms. Finally, we give a critical analysis of CARLA by pointing out issues in its perceptual and behavioral realism. We also critique the Leaderboard benchmark and provide discussion on why its primary metric cannot be reliably used as a proxy for good driving behavior.

AutoML @ NeurIPS 2018 challenge: Design and Results

C^2:Co-design of Robots via Concurrent Networks Coupling Online and Offline Reinforcement Learning

Winning Solutions and Post-Challenge Analyses of the ChaLearn AutoDL Challenge 2019

C2: Co-design of Robots Via Concurrent-Network Coupling Online and Offline Reinforcement Learning

AutoDL Challenge Design and Beta Tests-Towards Automatic Deep Learning

Towards AutoML in the Presence of Drift: First Results

Drift to Remember

AutoCompete: A Framework for Machine Learning Competition

The AI Driving Olympics at NeurIPS 2018

Dealing with Drift of Adaptation Spaces in Learning-based Self-Adaptive Systems using Lifelong Self-Adaptation

The RoboDrive Challenge: Drive Anytime Anywhere in Any Condition

Lessons Learned from the NeurIPS 2021 MetaDL Challenge: Backbone Fine-Tuning Without Episodic Meta-Learning Dominates for Few-Shot Learning Image Classification

Online AutoML: an adaptive AutoML framework for online learning

Winning the 3rd Japan Automotive AI Challenge -- Autonomous Racing with the Autoware.Auto Open Source Software Stack

Bridging Sim2Real Gap Using Image Gradients for the Task of End-to-End Autonomous Driving

End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving

End-to-End Deep Reinforcement Learning for Lane Keeping Assist

End-to-end Methods for Autonomous Driving in Simulation

Learn 2 Rage: Experiencing The Emotional Roller Coaster That Is Reinforcement Learning

The NeurIPS 2022 Neural MMO Challenge: A Massively Multiagent Competition with Specialization and Trade

A Sim-to-Real Deep Learning-Based Framework for Autonomous Nano-Drone Racing