Abstract:Interacting with the surrounding road users is crucial for autonomous vehicles (AV). However, the inherent multimodality and uncertainties associated with traffic participants (TP) pose challenges in AVs’ prediction and decision-making (PnD). A primary challenge is adapting predictors trained on static offline datasets to the dynamic, diverse data streams encountered in reality. Secondly, utilizing one single forecast trajectory with the highest probability for decision-making contains potential risks as it neglects that even a small probability represents a subset of TP behaviors. Based on the existing prediction backbone, we propose an online learning approach incorporating pseudo-labels inferred from partial feedback as compensation for conventional methodologies, considering both the commonsense and personalization facets of driving. Drawing inspiration from the second law of thermodynamics, we propose to minimize microscopic traffic entropy as an additional objective in decision-making. This objective aims to reduce the chaos of traffic scenes, thus achieving more predictable future interactions and, conversely, making future decisions easier. Through real-time human-in-the-loop experiments, we quantifiably and comparably reveal that adopting one single trajectory without online learning in PnD is risky. However, this reliability is verified to be significantly improved by our proposed techniques, and the efficacy is further analyzed in a subsequent qualitative study. A static experiment transferring the prediction algorithm trained exclusively on Argoverse 2 to datasets including NGSIM, HighD, RounD, and NuScenes is also conducted, demonstrating that the proposed correction can effectively mitigate the gap between the datasets and real-world scenarios.

Adaptive Visual Interaction Based Multi-Target Future State Prediction For Autonomous Driving Vehicles

Vehicle Motion State Prediction Method Integrating Point Cloud Time Series Multiview Features and Multitarget Interactive Information

VisionNet: A Drivable-space-based Interactive Motion Prediction Network for Autonomous Driving

A Scenario-Adaptive Driving Behavior Prediction Approach to Urban Autonomous Driving

3D Object Visibility Prediction in Autonomous Driving

Driver intention prediction based on multi-dimensional cross-modality information interaction

Multi-Interaction Trajectory Prediction Method With Serial Attention Patterns for Intelligent Vehicles

A multi-modal spatial–temporal model for accurate motion forecasting with visual fusion

A Cognitive-Based Trajectory Prediction Approach for Autonomous Driving

Multitarget Vehicle Tracking and Motion State Estimation Using a Novel Driving Environment Perception System of Intelligent Vehicles

Vision-Guided Forecasting -- Visual Context for Multi-Horizon Time Series Forecasting

A Probabilistic Architecture of Long-Term Vehicle Trajectory Prediction for Autonomous Driving

Multi-Sensor Fusion-Based Highway Vehicle Behavior Prediction and Its Application in Adaptive Cruise Control

Human Visual Attention Prediction Boosts Learning & Performance of Autonomous Driving Agents

Generic Tracking and Probabilistic Prediction Framework and Its Application in Autonomous Driving

AI-TP: Attention-based Interaction-aware Trajectory Prediction for Autonomous Driving

Interactive Prediction and Decision-Making for Autonomous Vehicles: Online Active Learning with Traffic Entropy Minimization

Self-supervised Multi-future Occupancy Forecasting for Autonomous Driving

Self-Aware Trajectory Prediction for Safe Autonomous Driving

Dynamic Occupancy Grid Prediction for Urban Autonomous Driving: A Deep Learning Approach with Fully Automatic Labeling

Efficient Traffic Accident Warning Based on Unsupervised Prediction Framework