Abstract:Motion forecasting for agents in autonomous driving is highly challenging due to the numerous possibilities for each agent's next action and their complex interactions in space and time. In real applications, motion forecasting takes place repeatedly and continuously as the self-driving car moves. However, existing forecasting methods typically process each driving scene within a certain range independently, totally ignoring the situational and contextual relationships between successive driving scenes. This significantly simplifies the forecasting task, making the solutions suboptimal and inefficient to use in practice. To address this fundamental limitation, we propose a novel motion forecasting framework for continuous driving, named RealMotion. It comprises two integral streams both at the scene level: (1) The scene context stream progressively accumulates historical scene information until the present moment, capturing temporal interactive relationships among scene elements. (2) The agent trajectory stream optimizes current forecasting by sequentially relaying past predictions. Besides, a data reorganization strategy is introduced to narrow the gap between existing benchmarks and real-world applications, consistent with our network. These approaches enable exploiting more broadly the situational and progressive insights of dynamic motion across space and time. Extensive experiments on Argoverse series with different settings demonstrate that our RealMotion achieves state-of-the-art performance, along with the advantage of efficient real-world inference. The source code will be available at <a class="link-external link-https" href="https://github.com/fudan-zvg/RealMotion" rel="external noopener nofollow">this https URL</a>.

Conditional Latent ODEs for Motion Prediction in Autonomous Driving

Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

LOPR: Latent Occupancy PRediction using Generative Models

Kinematics-aware Trajectory Generation and Prediction with Latent Stochastic Differential Modeling

DECODE: Domain-aware Continual Domain Expansion for Motion Prediction

Motion Forecasting in Continuous Driving

ReCoAt: A Deep Learning-based Framework for Multi-Modal Motion Prediction in Autonomous Driving Application

Deep learning-based vehicle trajectory prediction based on generative adversarial network for autonomous driving applications

Large Language Models Powered Context-aware Motion Prediction in Autonomous Driving

Language-Enhanced Latent Representations for Out-of-Distribution Detection in Autonomous Driving

EqDrive: Efficient Equivariant Motion Forecasting with Multi-Modality for Autonomous Driving

SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts

Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecasting

Self-supervised Multi-future Occupancy Forecasting for Autonomous Driving

FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field Prediction with Future Context Encoding

GAMMA: A General Agent Motion Model for Autonomous Driving

Adaptive Prediction Ensemble: Improving Out-of-Distribution Generalization of Motion Forecasting

Shared Cross-Modal Trajectory Prediction for Autonomous Driving

Conditional Goal-Oriented Trajectory Prediction for Interacting Vehicles

Lifelong Vehicle Trajectory Prediction Framework Based on Generative Replay

Map-Adaptive Multimodal Trajectory Prediction Using Hierarchical Graph Neural Networks