Abstract:With the fast development of AI-related techniques, the applications of trajectory prediction are no longer limited to easier scenes and trajectories. More and more heterogeneous trajectories with different representation forms, such as 2D or 3D coordinates, 2D or 3D bounding boxes, and even high-dimensional human skeletons, need to be analyzed and forecasted. Among these heterogeneous trajectories, interactions between different elements within a frame of trajectory, which we call the ``Dimension-Wise Interactions'', would be more complex and challenging. However, most previous approaches focus mainly on a specific form of trajectories, which means these methods could not be used to forecast heterogeneous trajectories, not to mention the dimension-wise interaction. Besides, previous methods mostly treat trajectory prediction as a normal time sequence generation task, indicating that these methods may require more work to directly analyze agents' behaviors and social interactions at different temporal scales. In this paper, we bring a new ``view'' for trajectory prediction to model and forecast trajectories hierarchically according to different frequency portions from the spectral domain to learn to forecast trajectories by considering their frequency responses. Moreover, we try to expand the current trajectory prediction task by introducing the dimension $M$ from ``another view'', thus extending its application scenarios to heterogeneous trajectories vertically. Finally, we adopt the bilinear structure to fuse two factors, including the frequency response and the dimension-wise interaction, to forecast heterogeneous trajectories via spectrums hierarchically in a generic way. Experiments show that the proposed model outperforms most state-of-the-art methods on ETH-UCY, Stanford Drone Dataset and nuScenes with heterogeneous trajectories, including 2D coordinates, 2D and 3D bounding boxes.

Urban Trajectory Timeline Visualization

A User Study on the Capability of Three Geo-Based Features in Analyzing and Locating Trajectories

Variable-Based Spatiotemporal Trajectory Data Visualization Illustrated

Visual Analysis of Trajectory Data

Visual Analysis of Traffic Data Based on Topic Modeling (chinavis 2017).

Evolutive 3D Urban Data Representation through Timeline Design Space

Visual Analytics of Taxi Trajectory Data Via Topical Sub-trajectories.

Timeline Design Space for Immersive Exploration of Time-Varying Spatial 3D Data

Enhanced trajectory data visualization: a dynamic time warping integrated t-SNE approach with real-data applications

Visualizing Large-Scale Spatial Time Series with GeoChron.

Trajectory-based Visualization of Web Video Topics.

Visual Exploration of Sparse Traffic Trajectory Data.

Topology Aware View Path Design for Time-Varying Volume Data

A Tube-and-Droplet-based Approach for Representing and Analyzing Motion Trajectories

Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrums

Spatio-Temporal Trajectory Similarity Measures: A Comprehensive Survey and Quantitative Study

A Comparison of Spatiotemporal Visualizations for 3D Urban Analytics

TripVista: Triple Perspective Visual Trajectory Analytics and Its Application on Microscopic Traffic Data at a Road Intersection

Fuzzy Spatiotemporal Representation Model for Human Trajectory Classification

Spatial-temporal fusion graph framework for trajectory similarity computation