Abstract:Traditional network architectures in smart ship communication systems struggle to efficiently manage the integration of heterogeneous sensor data. Additionally, conventional end-to-end transmission algorithms that rely on single-metric and single-path selection are inadequate in fulfilling the high reliability and real-time transmission requirements essential for high-priority service data. This inadequacy results in increased latency and packet loss for critical control information. To address these challenges, this study proposes an innovative ship network framework that synergistically integrates Software-Defined Networking (SDN) and Time-Sensitive Networking (TSN) technologies. Central to this framework is the introduction of a redundant multipath selection algorithm, which leverages Double Dueling Deep Q-Networks (D3QNs) in conjunction with Graph Convolutional Networks (GCNs). Initially, an optimization function encompassing transmission latency, bandwidth utilization, and packet loss rate is formulated within a software-defined time-sensitive network transmission framework tailored for smart ships. The proposed D3QN-GCN-based algorithm effectively identifies optimal working and redundant paths for TSN switches. These dual-path configurations are then disseminated by the SDN controller to the TSN switches, enabling the TSN's inherent reliability redundancy mechanisms to facilitate the simultaneous transmission of critical service flows across multiple paths. Experimental evaluations demonstrate that the proposed algorithm exhibits robust convergence characteristics and significantly outperforms existing algorithms in terms of reducing network latency and packet loss rates. Furthermore, the algorithm enhances bandwidth utilization and promotes balanced network load distribution. This research offers a novel and effective solution for shipboard switch path selection, thereby advancing the reliability and efficiency of smart ship communication systems.

DT-DDQNR: A Digital Twin Assisted Direct-to-Cell Satellite Network Intelligent Routing Algorithm

Research on Multi-Path QoS Routing Strategy for the Satellite Network

Study on Multi-Path QoS Routing Strategy in Satellite Networks

A Qos Routing Based On Heuristic Algorithm For Double-Layered Satellite Networks

SDDRL-SR: A High-Reliability Satellite Routing Algorithm Based on Deep Reinforcement Learning

An Intelligent Routing Algorithm for LEO Satellites Based on Deep Reinforcement Learning

Dynamic Routing Planning Method for Large-Scale Low-Orbit Satellite Networks Based on Location Guided and Multi-Agent DQN Network

DDQN Based Routing Algorithm for IRS-Assisted MANET Without Explicit CSI

Deep Reinforcement Learning-Based Joint Satellite Scheduling and Resource Allocation in Satellite-Terrestrial Integrated Networks

Reinforcement learning based dynamic distributed routing scheme for mega LEO satellite networks

INTERLINK: A Digital Twin-Assisted Storage Strategy for Satellite-Terrestrial Networks

A DRL Empowered Multipath Cooperative Routing for Ultra-Dense LEO Satellite Networks

An Improved Double-Dueling-Deep-Q-Networks-Based Approach

A Distributed Hierarchical Routing Protocol for Non-GEO Satellite Networks

A Sustainable Heuristic QoS Routing Algorithm for Pervasive Multi-Layered Satellite Wireless Networks

Data-Driven Collaborative Scheduling Method for Multi-Satellite Data-Transmission

Routing Heterogeneous Traffic in Delay-Tolerant Satellite Networks

An Intelligent SDWN Routing Algorithm Based on Network Situational Awareness and Deep Reinforcement Learning

A robust routing strategy based on deep reinforcement learning for mega satellite constellations

Digital Twin-Empowered Routing Management for Reliable Multi-Hop Millimeter Wave V2X

On An Intelligent Hierarchical Routing Strategy for Ultra-Dense Free Space Optical Low Earth Orbit Satellite Networks