Abstract:Abstract Collision avoidance in ships and robotic vehicles exemplifies a complex work process that necessitates effective scenario recognition and precise movement decision-making. Machine learning methods addressing such work processes generally involve learning from scratch, which is not only time-consuming but also demands significant computational resources. Transfer learning emerges as a potent strategy to enhance the efficiency of these engineering work processes by harnessing previously acquired knowledge from analogous tasks, thereby streamlining the learning curve for new challenges. This research delves into two critical questions central to optimizing transfer reinforcement learning for the work process of collision avoidance: (1) Which process features can be successfully transferred across varying work processes? (2) What methodologies support the efficient and effective transfer of these features? Our study employs simulation-based experiments in ship collision avoidance to address these questions, chosen for their intrinsic complexity and the varied feature recognition it demands. We investigate and compare two transfer learning techniques—feature extraction and finetuning—utilizing a lightweight convolutional neural network (CNN) model pretrained on a base case of a comparable work process. Pixel-level visual input is leveraged to cover different numbers of encountering ships and fix the input size for the model. This model adeptly demonstrates the feasibility of transferring essential features to newer work process scenarios. Further, to enhance realism and applicability, we introduce a simplified yet comprehensive ship dynamic model that considers the substantial effects of ship inertia, thereby refining the interaction between the model and its environment. The response time is embedded into the reward function design to be considered for policy training. Experimental outcomes underscore the transferability of diverse process features and evaluate the relative effectiveness of the employed transfer methods across different task settings, offering insights that could be extrapolated to other engineering work processes.

Case Learning in CBR-Based Agent Systems for Ship Collision Avoidance

Case learning for CBR-based collision avoidance systems

Ship collision risk analysis: Modeling, visualization and prediction

A CBR-Based Multiagent Reinforcement Learning Approach

Efficient Reinforcement Learning for Autonomous Ship Collision Avoidance under Learning Experience Reuse

Knowledge transfer enabled reinforcement learning for efficient and safe autonomous ship collision avoidance

CBR Based Collision Avoidance Approach to Reactive Control for Multi-Robot System

Research on CBR System Based on Data Mining

Apply Case-Based Reasoning to Collaborative Commerce

Reinforcement learning-based collision avoidance: impact of reward function and knowledge transfer

Collision avoidance for autonomous ship using deep reinforcement learning and prior-knowledge-based approximate representation

Research of new strategies for improving CBR system

Representing and matching simulation cases: A case-based reasoning approach

A Systematic Approach for Collision Risk Analysis Based on Ais Data

Using cased based reasoning for automated safety risk management in construction industry

Intelligent Q&A System Based on Case Based Reasoning

Developing A Case-Based Reasoning Model for Safety Accident Pre-Control and Decision Making in the Construction Industry

A Hybrid Retrieval Strategy for Case-based Reasoning Using Soft Likelihood Functions

A human-like collision avoidance method for autonomous ship with attention-based deep reinforcement learning

Enhancing Efficiency in Collision Avoidance: A Study on Transfer Reinforcement Learning in Autonomous Ships’ Navigation