Abstract:Realistic and diverse simulation scenarios with reactive and feasible agent behaviors can be used for validation and verification of self-driving system performance without relying on expensive and time-consuming real-world testing. Existing simulators rely on heuristic-based behavior models for background vehicles, which cannot capture the complex interactive behaviors in real-world scenarios. Meanwhile, existing learning-based methods are typical insufficient, yielding behaviors of traffic participants that frequently collide or drive off the road especially for a long horizon. To address this issue, we propose TrajGen, a two-stage trajectory generation framework, which can capture more realistic and diverse behaviors directly from human demonstration. In particular, TrajGen consists of the multi-modal trajectory prediction stage and the reinforcement learning based trajectory modification stage. In the first stage, we propose a novel auxiliary RouteLoss for the trajectory prediction model to generate multi-modal diverse trajectories in the drivable area. In the second stage, reinforcement learning is used to track the predicted trajectories while avoiding collisions, which can improve the reactivity and feasibility of generated trajectories. In addition, we develop a simulator I-Sim that can provide support for data-driven agent behavior simulation and train reinforcement learning models in parallel based on naturalistic driving data. The vehicle model in I-Sim can guarantee that the generated trajectories by TrajGen satisfy vehicle kinematic constraints. Finally, we give comprehensive metrics to evaluate generated trajectories for simulation scenarios, which shows that TrajGen outperforms either trajectory prediction or inverse reinforcement learning in terms of fidelity, reactivity, feasibility, and diversity.

TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarios.

DragTraffic: Interactive and Controllable Traffic Scene Generation for Autonomous Driving

RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarios

ScenarioNet: Open-Source Platform for Large-Scale Traffic Scenario Simulation and Modeling

TrajGen: Generating Realistic and Diverse Trajectories With Reactive and Feasible Agent Behaviors for Autonomous Driving

Traffic Scene Generation from Natural Language Description for Autonomous Vehicles with Large Language Model

Automating Traffic Model Enhancement with AI Research Agent

TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oracles

UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarios

Trajeglish: Traffic Modeling as Next-Token Prediction

TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction

RoadGen: Generating Road Scenarios for Autonomous Vehicle Testing

TrafficPro: A Road Speed Prediction Framework for Urban Signal-Controlled Road Networks

Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors

Adaptive-AR Model with Drivers' Prediction for Traffic Simulation

ITGAN: An Interactive Trajectories Generative Adversarial Network Model for Automated Driving Scenario Generation

Advancing Traffic Simulation Precision and Scalability: A Data-Driven Approach Utilizing Deep Neural Networks

SimGen: Simulator-conditioned Driving Scene Generation

TrafficNet: An Open Naturalistic Driving Scenario Library

Gen-Drive: Enhancing Diffusion Generative Driving Policies with Reward Modeling and Reinforcement Learning Fine-tuning