Abstract:The Internet of Things (IoT) has shown its presence in applications that require monitoring extreme environments, such as wildfires, military operations, and coastal areas, among others. In these applications, the IoT nodes are deployed in hazardous terrains where humanistic access is hard or not possible. Hence, to ensure reliable data transmission in these applications, novel routing protocols need to be designed due to the multihop nature of communication possessed by the deployed nodes. Currently, most of the routing protocols utilized by IoT nodes follow traditional approaches, which creates congestion and contention in the network. As a result, the network performance is degraded in terms of various communication metrics. To address this problem and improve the communication statistics in extreme environments, we propose a deep-Q-learning-enable-destination-sequenced distance-vector (DQL-DSDV) framework. DQL-DSDV focuses on selecting the next hop during communication. Initially, the DSDV protocol updates routing information for connected nodes. This information is subsequently utilized by the deep-Q-learning (DQL) algorithm to compute the next hop count. This computation is based on reward functions, known as Q-values, which are conceptualized as the distance between connected nodes by taking into account the traffic flow. These distinguishing operational features of DQL and DSDV ensure that DQL-DSDV minimizes the packet lost ratio, congestion, end-to-end delay, and communication cost with improved Quality of Service (QoS). During simulations, we observed significant improvement in these performance metrics, in the presence of the existing schemes. Despite that, we checked the computation complexity of the proposed approach with existing protocols, which demonstrated noteworthy outcomes just like the other metrics.

A ${Q}$ -Learning Based Framework for Congested Link Identification

A Multi-objective Reinforcement Learning Perspective on Internet Congestion Control

Congestion Control Design of Multicast QUIC Based on Reinforcement Learning

Learning-Based Network Boolean Tomography for Identifying Congested Links with Correlations.

A New Deep-Q-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things

Traffic Measurement Optimization Based on Reinforcement Learning in Large-Scale IP Backbone Networks

IQoR-LSE: an Intelligent QoS On-Demand Routing Algorithm with Link State Estimation

Congestion Link Identification under Multipath Routing for Single-source Networks

A Graph Convolutional Network-Based Method for Congested Link Identification

Reinforcement Learning-Enabled Cross-Layer Optimization for Low-Power and Lossy Networks under Heterogeneous Traffic Patterns

QoS-Aware Congestion Control with Online Learning

QCon: A Q-Learning Based Congestion Control Scheme in Named Data Networking

Quantify the Road Link Performance and Capacity Using Deep Learning Models.

A Reinforcement Learning-Based Network Traffic Prediction Mechanism in Intelligent Internet of Things

A Q-Learning-Based Fault-Tolerant and Congestion-Aware Adaptive Routing Algorithm for Networks-on-Chip

Identify Congested Links with Network Tomography under Multipath Routing

Identification of Path Congestion Status for Network Performance Tomography using Deep Spatial-Temporal Learning

Improving TCP Congestion Control with Machine Intelligence

An Improved Congestion-Controlled Routing Protocol for IoT Applications in Extreme Environments

An Energy-Aware Network Routing Algorithm Based on Q-Learning

An efficient solution to locate sparsely congested links by network tomography