Abstract:In high-speed railway operational monitoring network systems targeting railway infrastructure as its monitoring objective, there is a wide variety of sensor types with diverse operational requirements. These systems have varying demands on data transmission latency and network lifespan. Most of the previous research focuses only on prolonging network lifetime or reducing data transmission delays when designing or optimizing routing protocols, without co-designing the two. In addition, due to the harsh operating environment of high-speed railways, when the network changes dynamically, the traditional routing algorithm generates unnecessary redesigns and leads to high overhead. Based on the actual needs of high-speed railway operation environment monitoring, this paper proposes a novel Double Q-values adaptive model combined with the existing reinforcement learning method, which considers the energy balance of the network and real-time data transmission, and constructs energy saving and delay. The two-dimensional reward avoids the extra overhead of maintaining a global routing table while capturing network dynamics. In addition, the adaptive weight coefficient is used to ensure the adaptability of the model to each business of the high-speed railway operation environment monitoring system. Finally, simulations and performance evaluations are carried out and compared with previous studies. The results show that the proposed routing algorithm extends the network lifecycle by 33% compared to the comparison algorithm and achieves good real-time data performance. It also saves energy and has fewer delays than the other three routing protocols in different situations.

A Q-routing Based Self-regulated Routing Scheme for Network-on-Chip

A New Congestion Avoidance Scheme:SECN

Adaptive Ant-Based Dynamic Routing Algorithm

Q-adaptive: A Multi-Agent Reinforcement Learning Based Routing on Dragonfly Network

A Learning-Based Approach to Intra-Domain QoS Routing

TTQR: A Traffic- and Thermal-Aware Q-Routing for 3D Network-on-Chip

Packet Routing Against Network Congestion: A Deep Multi-agent Reinforcement Learning Approach

An Intelligent Routing Algorithm Based on Prioritized Replay Double DQN for MANET

A Power-Aware Adaptive Routing Scheme for Network on a Chip

A Query-based Routing Table Update Mechanism for Content-Centric Network

CABSR: Congestion Agent Based Source Routing for Network-on-Chip

An Effective Congestion-Aware Selection Function for Adaptive Routing in Interconnection Networks

Energy-Saving Adaptive Routing for High-Speed Railway Monitoring Network Based on Improved Q Learning

A Fast and High-Performance Global Router with Enhanced Congestion Control

A Performance Analytical Approach Based on Queuing Model for Network-on-Chip

Time-Division-Multiplexer Based Routing Algorithm For Noc System

Study on a Packet Scheduling Algorithm in High Performance Routers

Adaptive Congestion Control for Application Specific Networks-On-Chip

Pre-Allocation Based Flow Control Scheme for Networks-On-Chip

Multi-Agent Q-Learning Aided Backpressure Routing Algorithm for Delay Reduction

A Low Energy Mapping and Routing Approach for Network-on-Chip with QoS Guarantees