An Adaptive Multimodal Data Vessel Trajectory Prediction Model Based on a Satellite Automatic Identification System and Environmental Data

Ye Xiao,Yupeng Hu,Jizhao Liu,Yi Xiao,Qianzhen Liu

DOI: https://doi.org/10.3390/jmse12030513

IF: 2.744

2024-03-20

Journal of Marine Science and Engineering

Abstract:Ship trajectory prediction is essential for ensuring safe route planning and to have advanced warning of the dangers at sea. With the development of deep learning, most of the current research has explored advanced prediction methods based on historical spatio-temporal Automatic Identification System (AIS) data. However, environmental factors such as sea wind and visibility also affect ship navigation in real-world maritime shipping. Therefore, developing reliable models utilizing multimodal data, such as AIS and environmental data, is challenging. In this research, we design an adaptive multimodal vessel trajectory data prediction model (termed AMD) based on satellite AIS and environmental data. The AMD model mainly consists of an AIS-based extraction network, an environmental-based extraction network, and a fusion block. In particular, this work considers multimodal data such as historical spatio-temporal information and environmental factors. Time stamps and distances are correlated with AIS and environmental data, and a multilayer perceptron and gated recurrent unit networks are used to design multimodal feature extraction networks. Finally, the fusion block realizes the fusion output of multimodal features to improve the reliability of the AMD model. Several quantitative and qualitative experiments are conducted using real-world AIS and multimodal environmental datasets. Numerous experimental results prove that prediction performance using multimodal data can ensure satisfactory accuracy and reliability while exhibiting a positive impact on improving maritime transport services.

oceanography,engineering, marine, ocean

What problem does this paper attempt to address?

The paper primarily focuses on addressing the issue of ship trajectory prediction to enhance maritime navigation safety and transportation efficiency. Specifically, the paper proposes an Adaptive Multimodal Ship Trajectory Prediction Model (AMD model) based on Automatic Identification System (AIS) data and environmental data. Traditional ship trajectory prediction methods often rely solely on historical AIS data, neglecting the impact of environmental factors such as sea wind and visibility on ship navigation. Therefore, the proposed method aims to improve prediction accuracy and reliability by integrating AIS data with environmental data.

The key contributions of the paper include:

1. **Proposing a new multimodal data fusion method**: An AMD model is designed, which includes an AIS data extraction network, an environmental data extraction network, and a fusion module. This model effectively combines the spatiotemporal information from AIS data with environmental data to generate more reliable prediction results.

2. **Using Multilayer Perceptron (MLP) and Gated Recurrent Unit (GRU) networks for feature extraction**: MLP is used to process AIS data, while GRU is applied to handle environmental data. These two network structures can effectively capture features from different modalities of data and integrate them to improve prediction performance.

3. **Empirical study**: The effectiveness of the AMD model is validated through experiments on real-world AIS datasets and environmental datasets. These datasets are sourced from Australian and Argentine waters. The experimental results show that using multimodal data for prediction can significantly improve prediction accuracy and reliability, thereby helping to enhance maritime transportation services.

4. **Data preprocessing**: To effectively associate AIS data with environmental data, the paper details how to achieve the association between the two types of data through the nearest timestamp and shortest distance. Additionally, it describes how to use the min-max normalization method to process the data, eliminating differences between different dimensions.

In summary, the paper aims to improve maritime navigation safety and efficiency by proposing a ship trajectory prediction method that combines AIS data and environmental data.