KUNPENG: An Embodied Large Model for Intelligent Maritime

Naiyao Wang,Tongbang Jiang,Ye Wang,Shaoyang Qiu,Bo Zhang,Xinqiang Xie,Munan Li,Chunliu Wang,Yiyang Wang,Hongxiang Ren,Ruili Wang,Hongjun Shan,Hongbo Liu

2024-07-12

Abstract:Intelligent maritime, as an essential component of smart ocean construction, deeply integrates advanced artificial intelligence technology and data analysis methods, which covers multiple aspects such as smart vessels, route optimization, safe navigation, aiming to enhance the efficiency of ocean resource utilization and the intelligence of transportation networks. However, the complex and dynamic maritime environment, along with diverse and heterogeneous large-scale data sources, present challenges for real-time decision-making in intelligent maritime. In this paper, We propose KUNPENG, the first-ever embodied large model for intelligent maritime in the smart ocean construction, which consists of six systems. The model perceives multi-source heterogeneous data for the cognition of environmental interaction and make autonomous decision strategies, which are used for intelligent vessels to perform navigation behaviors under safety and emergency guarantees and continuously optimize power to achieve embodied intelligence in maritime. In comprehensive maritime task evaluations, KUNPENG has demonstrated excellent performance.

Artificial Intelligence

What problem does this paper attempt to address?

The paper aims to address the real-time decision-making problem in the field of intelligent navigation, particularly the challenges posed by handling large-scale, diverse, and heterogeneous data sources in a complex and ever-changing marine environment. To tackle these issues, the authors propose an intelligent navigation embodied large model named KUNPENG. This model consists of six systems that can perceive multi-source heterogeneous data, achieve cognitive interaction with the environment, and make autonomous decision strategies. This allows intelligent ships to perform navigation behaviors while ensuring safety and emergency protection, continuously optimizing energy utilization, and ultimately achieving embodied intelligent navigation. Specifically, the main contributions of KUNPENG include: 1. Proposing the first intelligent navigation embodied large model KUNPENG, which is used to perceive multi-source heterogeneous data, conduct cognitive interaction with the environment, and make autonomous decisions. This enables intelligent ships to perform complex maritime tasks under safety and emergency protection while continuously optimizing energy use. 2. Proposing an embodied intelligent cycle of "perception-cognition-decision-action" based on a brain-like dual-path model, utilizing the theory of mind and game theory to achieve cross-domain group collaborative intelligent navigation in complex scenarios. 3. Proposing an intelligent navigation method based on ship self-motion imitation learning, enhancing the quality of marine weather forecasts and self-motion navigation data. This allows ships to perceive dynamic navigation environments and combine virtual simulation with physical embodiment to imitate expert navigation decisions and behaviors. 4. Constructing safety navigation rules and standards that meet the needs of intelligent navigation. By building a credit graph in the maritime field, integrating structured and unstructured credit data, deeply exploring the semantic relationships between maritime credit entities, and using maritime laws to achieve compliant and safe navigation.

KUNPENG: An Embodied Large Model for Intelligent Maritime

Ship collision risk analysis: Modeling, visualization and prediction

An AIS-based deep learning model for multi-task in the marine industry

Construction of a large-scale maritime element semantic schema based on knowledge graph models for unmanned automated decision-making

Port Sensing Computation Based on Maritime Big Data

Real-time digital twin of autonomous ships based on virtual-physical mapping model

Intelligent Smart Marine Autonomous Surface Ship Decision System Based on Improved PPO Algorithm

A partially observable multi-ship collision avoidance decision-making model based on deep reinforcement learning

Multi-functional and Practical Adaptive Collision Avoidance Decision-making System for Autonomous Ships

Complex encounter situation modeling and prediction method for unmanned ships based on bounded rational game

Big Data Driven Vessel Trajectory and Navigating State Prediction With Adaptive Learning, Motion Modeling and Particle Filtering Techniques

Generating live commentary for marine traffic scenarios based on multi-model learning

Parallel Ships: an ACP-based Framework for Marine Equipment Testing and Training

An Intelligent Decision-Making Approach for Multi-Ship Traffic Conflict Mitigation from the Perspective of Maritime Surveillance

AI-Empowered Maritime Internet of Things: A Parallel-Network-Driven Approach

Artificial Intelligence in Underwater Digital Twins Sensor Networks

Intelligent collision avoidance decision-making method for unmanned ships based on driving practice

Regional ship behavior and trajectory prediction for maritime traffic management: A social generative adversarial network approach

Dynamic adaptive intelligent navigation decision making method for multi-object situation in open water

Toward the Automated Construction of Probabilistic Knowledge Graphs for the Maritime Domain

Leveraging Large-scale AI Models for Transforming China's Marine Industry: A TOE Framework Analysis