Abstract:The research on decision-making models of ship collision avoidance is confronted with numerous challenges. These challenges encompass inadequate consideration of complex factors, including but not limited to open water scenarios, the absence of static obstacle considerations, and insufficient attention given to avoiding collisions between manned ships and MASSs. A decision model for MASS collision avoidance is proposed to overcome these limitations by integrating the strengths of model-based and model-free methods in reinforcement learning. This model incorporates S-57 chart information, AIS data, and the Dyna framework to improve effectiveness. (1) When the MASS's navigation task is known, a static navigation environment is built based on S-57 chart information, and the Voronoi diagram and improved A* algorithm are used to obtain the energy-saving optimal static path as the planned sea route. (2) Given the small main dimensions of an MASS, which is easily affected by wind and current factors, the motion model of an MASS is established based on the MMG model considering wind and current factors. At the same time, AIS data are used to extract the target ship (manned ship) data. (3) According to the characteristics of the actual navigation of ships at sea, the state space, action space, and reward function of the reinforcement learning algorithm are designed. The MASS collision avoidance decision model based on the Dyna-DQN model is established. Based on the DQN algorithm, the agent (MASS) and the environment interact continuously, and the actual interaction data generated are used for the iterative update of the collision avoidance strategy and the training of the environment model. Then, the environment model is used to generate a series of simulated empirical data to promote the iterative update of the strategy. Using the waters near the South China Sea as the research object for simulation verification, the navigation tasks are divided into three categories: only considering static obstacles, following the planned sea route considering static obstacles, and following the planned sea route considering both static and dynamic obstacles. The results show that through repeated simulation experiments, an MASS can complete the navigation task without colliding with static and dynamic obstacles. Therefore, the proposed method can be used in the intelligent collision avoidance module of MASSs and is an effective MASS collision avoidance method.

Collision avoidance for formation of autonomous ships using separation and recovery mechanism combine artificial potential field method

Formation of MASS Collision Avoidance and Path following Based on Artificial Potential Field in Constrained Environment

Autonomous collision avoidance method for MASSs based on precise potential field modelling and COLREGs constraints in complex sailing environments

Safety-Critical Path Planning and Following of Maritime Autonomous Surface Ships for Automatic Docking

Identification of Complex Multi-Vessel Encounter Scenarios and Collision Avoidance Decision Modeling for MASSs

Collision-avoidance Navigation Systems for Maritime Autonomous Surface Ships: A State of the Art Survey

Research on MASS Collision Avoidance in Complex Waters Based on Deep Reinforcement Learning

Survey on Collision-Avoidance Navigation of Maritime Autonomous Surface Ships

A Distributed Coordinated Path Planning Algorithm for Maritime Autonomous Surface Ship

Environment Potential Field Modeling for Ship Automatic Collision Avoidance in Restricted Waters

A deterministic collision avoidance decision-making system for multi-MASS encounter situation

Research on the Decision-Making and Control System Architecture for Autonomous Berthing of MASS

Collision-free automatic berthing of maritime autonomous surface ships via safety-certified active disturbance rejection control

Multiple Marine Vessels Formation Control with Collision Avoidance

Deep reinforcement learning with dynamic window approach based collision avoidance path planning for maritime autonomous surface ships

Enhanced artificial potential field for MASS's path planning navigation in restricted waterways

Collision avoidance path planning in multi-ship encounter situations

A Real-Time Collision Avoidance Framework of MASS Based on B-Spline and Optimal Decoupling Control

A novel model predictive artificial potential field based ship motion planning method considering COLREGs for complex encounter scenarios

Research on Autonomous Berthing Control of MASS Based on Real Time Kinematic

Safety-certified Constrained Control of Maritime Autonomous Surface Ships for Automatic Berthing