Abstract:Realistic and diverse simulation scenarios with reactive and feasible agent behaviors can be used for validation and verification of self-driving system performance without relying on expensive and time-consuming real-world testing. Existing simulators rely on heuristic-based behavior models for background vehicles, which cannot capture the complex interactive behaviors in real-world scenarios. Meanwhile, existing learning-based methods are typical insufficient, yielding behaviors of traffic participants that frequently collide or drive off the road especially for a long horizon. To address this issue, we propose TrajGen, a two-stage trajectory generation framework, which can capture more realistic and diverse behaviors directly from human demonstration. In particular, TrajGen consists of the multi-modal trajectory prediction stage and the reinforcement learning based trajectory modification stage. In the first stage, we propose a novel auxiliary RouteLoss for the trajectory prediction model to generate multi-modal diverse trajectories in the drivable area. In the second stage, reinforcement learning is used to track the predicted trajectories while avoiding collisions, which can improve the reactivity and feasibility of generated trajectories. In addition, we develop a simulator I-Sim that can provide support for data-driven agent behavior simulation and train reinforcement learning models in parallel based on naturalistic driving data. The vehicle model in I-Sim can guarantee that the generated trajectories by TrajGen satisfy vehicle kinematic constraints. Finally, we give comprehensive metrics to evaluate generated trajectories for simulation scenarios, which shows that TrajGen outperforms either trajectory prediction or inverse reinforcement learning in terms of fidelity, reactivity, feasibility, and diversity.

ARES: Text-Driven Automatic Realistic Simulator for Autonomous Traffic

AADS: Augmented autonomous driving simulation using data-driven algorithms

TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarios.

RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarios

DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving

Traffic Scene Generation from Natural Language Description for Autonomous Vehicles with Large Language Model

KiGRAS: Kinematic-Driven Generative Model for Realistic Agent Simulation

S-NeRF++: Autonomous Driving Simulation via Neural Reconstruction and Generation

TrajGen: Generating Realistic and Diverse Trajectories With Reactive and Feasible Agent Behaviors for Autonomous Driving

OASim: an Open and Adaptive Simulator based on Neural Rendering for Autonomous Driving

SCTrans: Constructing a Large Public Scenario Dataset for Simulation Testing of Autonomous Driving Systems.

(Re)^2h2o: Autonomous Driving Scenario Generation Via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learning

ReinforcementDriving: Exploring Trajectories and Navigation for Autonomous Vehicles

AI-TP: Attention-based Interaction-aware Trajectory Prediction for Autonomous Driving

A Digital Twin-based Testing and Data Collection System for Autonomous Driving in Extreme Traffic Scenarios

Generating Critical Scenarios for Testing Automated Driving Systems

BEV-TSR: Text-Scene Retrieval in BEV Space for Autonomous Driving

Task-Driven Controllable Scenario Generation Framework Based on AOG

SurrealDriver: Designing Generative Driver Agent Simulation Framework in Urban Contexts based on Large Language Model

Real-World Data Inspired Interactive Connected Traffic Scenario Generation