Abstract:Automatic collision avoidance decision making for vessels is a critical challenge in the development of autonomous ships and has become a central point of research in the maritime safety domain. Effective and systematic collision avoidance strategies significantly reduce the risk of vessel collisions, ensuring safe navigation. This study develops a multi-vessel automatic collision avoidance decision-making method based on deep reinforcement learning (DRL) and establishes a vessel behavior decision model. When designing the reward function for continuous action spaces, the criteria of the "Convention on the International Regulations for Preventing Collisions at Sea" (COLREGs) were adhered to, taking into account the vessel's collision risk under various encounter situations, real-world navigation practices, and navigational complexities. Furthermore, to enable the algorithm to precisely differentiate between collision avoidance and the navigation resumption phase in varied vessel encounter situations, this paper incorporated "collision avoidance decision making" and "course recovery decision making" as state parameters in the state set design, from which the respective objective functions were defined. To further enhance the algorithm's performance, techniques such as behavior cloning, residual networks, and CPU-GPU dual-core parallel processing modules were integrated. Through simulation experiments in the enhanced Imazu training environment, the practicality of the method, taking into account the effects of wind and ocean currents, was corroborated. The results demonstrate that the proposed algorithm can perform effective collision avoidance decision making in a range of vessel encounter situations, indicating its efficiency and robust generalization capabilities.

COLREGs-Informed RRT* for Collision Avoidance of Marine Crafts

Grounding-aware RRT* for Path Planning and Safe Navigation of Marine Crafts in Confined Waters

COLREG-Compliant Optimal Path Planning for Real-Time Guidance and Control of Autonomous Ships

VORRT-COLREGs: A Hybrid Velocity Obstacles and RRT Based COLREGs-Compliant Path Planner for Autonomous Surface Vessels

A COLREGs-Compliant Deep Reinforcement Learning Approach

Risk-based implementation of COLREGs for autonomous surface vehicles using deep reinforcement learning

Towards A COLREGs Compliant Autonomous Surface Vessel in a Constrained Channel

Autonomous Navigation in Confined Waters -- A COLREGs Rule 9 Compliant Framework

Stochastic COLREGs Evaluation for Safe Navigation under Uncertainty

COLREGs-abiding hybrid collision avoidance algorithm based on deep reinforcement learning for USVs

A COLREGs-Compliant Motion Planner for Autonomous Maneuvering of Marine Vessels in Complex Environments

A Comparative Study of Rapidly-exploring Random Tree Algorithms Applied to Ship Trajectory Planning and Behavior Generation

COLREGs-Adaptive trajectory planning and decision-making in maritime autonomous surface ships

Collision Avoidance Algorithm Based on COLREGs for Unmanned Surface Vehicle

Exploration of COLREG-relevant parameters from historical AIS-data

Local Collision Avoidance Algorithm for a Unmanned Surface Vehicle Based on Steering Maneuver Considering COLREGs

Grounding hazard considerations in evaluation of COLREGS collision avoidance algorithms

COLREGS-based Path Planning for Ships at Sea Using Velocity Obstacles.

Decentralized Multi-Robot Navigation for Autonomous Surface Vehicles with Distributional Reinforcement Learning

Informed Sampling-based Collision Avoidance with Least Deviation from the Nominal Path

COLREG Scenario classification and Compliance Evaluation with temporal and multi-vessel awareness for collision avoidance systems