Abstract:To safely navigate intricate real-world scenarios, autonomous vehicles must be able to adapt to diverse road conditions and anticipate future events. World model (WM) based reinforcement learning (RL) has emerged as a promising approach by learning and predicting the complex dynamics of various environments. Nevertheless, to the best of our knowledge, there does not exist an accessible platform for training and testing such algorithms in sophisticated driving environments. To fill this void, we introduce CarDreamer, the first open-source learning platform designed specifically for developing WM based autonomous driving algorithms. It comprises three key components: 1) World model backbone: CarDreamer has integrated some state-of-the-art WMs, which simplifies the reproduction of RL algorithms. The backbone is decoupled from the rest and communicates using the standard Gym interface, so that users can easily integrate and test their own algorithms. 2) Built-in tasks: CarDreamer offers a comprehensive set of highly configurable driving tasks which are compatible with Gym interfaces and are equipped with empirically optimized reward functions. 3) Task development suite: This suite streamlines the creation of driving tasks, enabling easy definition of traffic flows and vehicle routes, along with automatic collection of multi-modal observation data. A visualization server allows users to trace real-time agent driving videos and performance metrics through a browser. Furthermore, we conduct extensive experiments using built-in tasks to evaluate the performance and potential of WMs in autonomous driving. Thanks to the richness and flexibility of CarDreamer, we also systematically study the impact of observation modality, observability, and sharing of vehicle intentions on AV safety and efficiency. All code and documents are accessible on <a class="link-external link-https" href="https://github.com/ucd-dare/CarDreamer" rel="external noopener nofollow">this https URL</a>.

ApolloRL: a Reinforcement Learning Platform for Autonomous Driving

Self-Driving Car Racing: Application of Deep Reinforcement Learning

DeepRacer: Educational Autonomous Racing Platform for Experimentation with Sim2Real Reinforcement Learning

Deep Reinforcement Learning on Autonomous Driving Policy With Auxiliary Critic Network

A Platform-Agnostic Deep Reinforcement Learning Framework for Effective Sim2Real Transfer towards Autonomous Driving

FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicing

Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey

Improving Agent Behaviors with RL Fine-tuning for Autonomous Driving

Exploring applications of deep reinforcement learning for real-world autonomous driving systems

RL STaR Platform: Reinforcement Learning for Simulation based Training of Robots

AutoVRL: A High Fidelity Autonomous Ground Vehicle Simulator for Sim-to-Real Deep Reinforcement Learning

Robust RL with LLM-Driven Data Synthesis and Policy Adaptation for Autonomous Driving

Application of Reinforcement Learning in the Autonomous Driving Platform of the DeepRacer

Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers

Applications of Distributional Soft Actor-Critic in Real-world Autonomous Driving

Continuous Reinforcement Learning From Human Demonstrations With Integrated Experience Replay For Autonomous Driving

A Survey of Deep RL and IL for Autonomous Driving Policy Learning

Deep Reinforcement Learning framework for Autonomous Driving

Learning to drive via Apprenticeship Learning and Deep Reinforcement Learning

CarDreamer: Open-Source Learning Platform for World Model based Autonomous Driving

HGRL: Human-Driving-Data Guided Reinforcement Learning for Autonomous Driving