Abstract:Autonomous Vehicles have wide-ranging applications in off-road environments. Off-road vehicular scenes can be abstracted as multi-agent systems, and trajectory prediction is a critical process for context understanding. Agents compete and cooperate other to pursue their individual targets, which makes trajectories complicated and changeable. Hence, in order to derive precise predictions, it is necessary to reason how agents interact with each other. However, current prediction algorithms lack a unified and appropriatemethod for spatiotemporal reasoning. Previous methods mainly rely on vehicle-lane constraints to capture features, which is only applicable in structured environments. To address this issue, this article proposes a novel off-road multi-agent trajectory prediction framework called SA-LSTM. This framework comprises situation awareness extraction and Long Short Term Memory (LSTM) prediction backbones. Based on the analysis of agents' movement patterns, we decompose actions into the maintenance of previous movements and the strategy variations in response to environment situations. In situation awareness extraction, risk field and pooling layers are applied to filter interpretable awareness. As for prediction backbones, proper LSTM networks are selected to adapt the task features. In short-term predictions, a residual mechanism is used to preserve physical inertia, while for long-term predictions autoregression process is applied. We also establish a multi-agent dataset based on human-manipulated chaseand-run tasks to train and validate the performance of SA-LSTM. Experiments show that compared with the best baseline model at each prediction length, SA-LSTM reduces themean absolute error by 7.27%, 32.99%, and 28.07% at the prediction time of 0.6, 3.0, and 6.0 seconds, respectively, proving better prediction accuracy.

LG-LSTM: Modeling LSTM-Based Interactions for Multi-Agent Trajectory Prediction

Multi-Agent Trajectory Prediction Based on Graph Neural Network

Interactive Trajectory Prediction of Surrounding Road Users for Autonomous Driving Using Structural-LSTM Network

Single-Agent LSTM Encoders Single-Agent LSTM Decoders Output : Multi-Agent Future Trajectories Input 1 : Multi-Agent Past Trajectories Input 2 : Scene Context Image Scene Context Channels Multi-Agent Channels Convolutional Operator : Multi-Agent Tensor Fusion

A Hierarchical LSTM-Based Vehicle Trajectory Prediction Method Considering Interaction Information

Modeling Vehicle Interactions via Modified LSTM Models for Trajectory Prediction

A Hierarchical Hybrid Learning Framework for Multi-Agent Trajectory Prediction

An Enhanced Vehicle Trajectory Prediction Model Leveraging LSTM and Social-Attention Mechanisms

SA-LSTM: A Trajectory Prediction Model for Complex Off-Road Multi-Agent Systems Considering Situation Awareness Based on Risk Field

IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Prediction

ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Driving

Multi-Agent Tensor Fusion for Contextual Trajectory Prediction

Edge-Enriched Graph Transformer for Multiagent Trajectory Prediction With Relative Positional Semantics

Multiple Contextual Cues Integrated Trajectory Prediction for Autonomous Driving

LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Prediction

Goal-Guided and Interaction-Aware State Refinement Graph Attention Network for Multi-Agent Trajectory Prediction

HSTA: A Hierarchical Spatio-Temporal Attention Model for Trajectory Prediction

Spatio-Temporal-Interaction Graph Neural Networks for Multi-Agent Trajectory Prediction

Multi-Vehicle Collaborative Learning for Trajectory Prediction With Spatio-Temporal Tensor Fusion

A Multi-Task Learning Network With a Collision-Aware Graph Transformer for Traffic-Agents Trajectory Prediction