Abstract:Realistic and diverse simulation scenarios with reactive and feasible agent behaviors can be used for validation and verification of self-driving system performance without relying on expensive and time-consuming real-world testing. Existing simulators rely on heuristic-based behavior models for background vehicles, which cannot capture the complex interactive behaviors in real-world scenarios. Meanwhile, existing learning-based methods are typical insufficient, yielding behaviors of traffic participants that frequently collide or drive off the road especially for a long horizon. To address this issue, we propose TrajGen, a two-stage trajectory generation framework, which can capture more realistic and diverse behaviors directly from human demonstration. In particular, TrajGen consists of the multi-modal trajectory prediction stage and the reinforcement learning based trajectory modification stage. In the first stage, we propose a novel auxiliary RouteLoss for the trajectory prediction model to generate multi-modal diverse trajectories in the drivable area. In the second stage, reinforcement learning is used to track the predicted trajectories while avoiding collisions, which can improve the reactivity and feasibility of generated trajectories. In addition, we develop a simulator I-Sim that can provide support for data-driven agent behavior simulation and train reinforcement learning models in parallel based on naturalistic driving data. The vehicle model in I-Sim can guarantee that the generated trajectories by TrajGen satisfy vehicle kinematic constraints. Finally, we give comprehensive metrics to evaluate generated trajectories for simulation scenarios, which shows that TrajGen outperforms either trajectory prediction or inverse reinforcement learning in terms of fidelity, reactivity, feasibility, and diversity.

Scalable Traffic Simulation for Autonomous Driving Via Multi-Agent Goal Assignment and Autoregressive Goal-Directed Planning

TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction

InterSim: Interactive Traffic Simulation Via Explicit Relation Modeling

Adversarial and Reactive Traffic Agents for Realistic Driving Simulation

Planning by Simulation: Motion Planning with Learning-based Parallel Scenario Prediction for Autonomous Driving

Solving Motion Planning Tasks with a Scalable Generative Model

TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oracles

SurrealDriver: Designing Generative Driver Agent Simulation Framework in Urban Contexts based on Large Language Model

Autonomous driving planning and decision making based on game theory and reinforcement learning

Agent-Agnostic Centralized Training for Decentralized Multi-Agent Cooperative Driving

Immersive Traffic Interactive Simulator for Multi-Agent

SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries

Distributed Simulation of Multi- Lane Traffic Flow Based on Multi - Agent

Generative AI-empowered Simulation for Autonomous Driving in Vehicular Mixed Reality Metaverses

BehaviorGPT: Smart Agent Simulation for Autonomous Driving with Next-Patch Prediction

SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Driving

Microscopic Traffic Simulation by Cooperative Multi-agent Deep Reinforcement Learning

KiGRAS: Kinematic-Driven Generative Model for Realistic Agent Simulation

Simulating Autonomous Driving in Massive Mixed Urban Traffic

Modeling and Testing Multi-Agent Traffic Rules within Interactive Behavior Planning

TrajGen: Generating Realistic and Diverse Trajectories With Reactive and Feasible Agent Behaviors for Autonomous Driving