Abstract:Trajectory prediction of agents is crucial for the safety of autonomous vehicles, whereas previous approaches usually rely on sufficiently long-observed trajectory to predict the future trajectory of the agents. However, in real-world scenarios, it is not realistic to collect adequate observed locations for moving agents, leading to the collapse of most prediction models. For instance, when a moving car suddenly appears and is very close to an autonomous vehicle because of the obstruction, it is quite necessary for the autonomous vehicle to quickly and accurately predict the future trajectories of the car with limited observed trajectory locations. In light of this, we focus on investigating the task of instantaneous trajectory prediction, i.e., two observed locations are available during inference. To this end, we propose a general and plug-and-play instantaneous trajectory prediction approach, called ITPNet. Specifically, we propose a backward forecasting mechanism to reversely predict the latent feature representations of unobserved historical trajectories of the agent based on its two observed locations and then leverage them as complementary information for future trajectory prediction. Meanwhile, due to the inevitable existence of noise and redundancy in the predicted latent feature representations, we further devise a Noise Redundancy Reduction Former, aiming at to filter out noise and redundancy from unobserved trajectories and integrate the filtered features and observed features into a compact query for future trajectory predictions. In essence, ITPNet can be naturally compatible with existing trajectory prediction models, enabling them to gracefully handle the case of instantaneous trajectory prediction. Extensive experiments on the Argoverse and nuScenes datasets demonstrate ITPNet outperforms the baselines, and its efficacy with different trajectory prediction models.

RPP-Net: Rigid Constrained Point Cloud Prediction Network

FPPN: Future Pseudo-LiDAR Frame Prediction for Autonomous Driving

Adaptive Recurrent Forward Network for Dense Point Cloud Completion

MoNet: Motion-Based Point Cloud Prediction Network

RFNet - Recurrent Forward Network for Dense Point Cloud Completion.

ATPPNet: Attention based Temporal Point cloud Prediction Network

TPNet: Trajectory Proposal Network for Motion Prediction

Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks

PointRNN: Point Recurrent Neural Network for Moving Point Cloud Processing

PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulation

PCPNet: an Efficient and Semantic-Enhanced Transformer Network for Point Cloud Prediction.

BE-STI: Spatial-Temporal Integrated Network for Class-agnostic Motion Prediction with Bidirectional Enhancement

RCP: Recurrent Closest Point for Point Cloud

ITPNet: Towards Instantaneous Trajectory Prediction for Autonomous Driving

SPRNN: A spatial–temporal recurrent neural network for crowd flow prediction

MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Maps

PointMotionNet: Point-Wise Motion Learning for Large-Scale LiDAR Point Clouds Sequences

PnPNet: End-to-End Perception and Prediction with Tracking in the Loop

Isolated Points Prediction Via Deep Neural Network on Point Cloud Lossless Geometry Compression

MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird’s Eye View Maps

Point Cloud Forecasting as a Proxy for 4D Occupancy Forecasting