Abstract:The rapid expansion of the Internet of Things (IoT) necessitates advanced routing schemes capable of meeting the stringent demands for low latency and high accuracy, which are critical for applications such as autonomous vehicles and telemedicine. Traditional edge computing methods often struggle with elevated latency, rendering them unsuitable for time-sensitive applications. Additionally, many reinforcement learning (RL) algorithms require action space discretization, which can introduce biases and dimensionality challenges. This paper introduces a novel Soft Actor-Critic (SAC)-based distributed routing scheme for edge computing, specifically designed to address these limitations. By integrating RL with Maximum Entropy principles and employing a decentralized approach, the proposed model enhances network performance, reduces delays, and effectively manages multi-optimality criteria. The distributed routing scheme operates independently of a centralized controller, allowing routers to make autonomous decisions and adapt seamlessly to changes in the network. This is accomplished through a Markov Decision Process (MDP) that optimizes routing paths based on various factors, including node depth, energy consumption, and transmission probability. The methodology encompasses local training phases for individual nodes, followed by federated training to refine the model across the network. Experimental results conducted on topologies of varying scales demonstrate the model's efficacy in achieving high accuracy and efficient convergence, particularly in dynamic IoT environments. These findings underscore the potential of the proposed SAC-based distributed routing scheme as a robust solution for enhancing routing efficiency and reliability in the evolving landscape of IoT applications. IMPACT STATEMENT The rapid expansion of Internet of Things (IoT) applications demands advanced routing solutions to ensure low latency and high accuracy, crucial for sectors like autonomous vehicles and telemedicine. Traditional edge computing methods struggle with elevated latency, while many reinforcement learning (RL) algorithms face challenges with action space discretization, leading to biases and dimensionality issues. This study introduces a novel Soft Actor-Critic (SAC)-based distributed routing scheme to address these limitations. Integrating Maximum Entropy principles with RL enhances exploration and decision-making stability. The decentralized approach allows routers to make autonomous, real-time decisions based on local network conditions, optimizing routing paths through a Markov Decision Process (MDP). Experimental results from various simulated IoT network topologies show the model's superior performance in reducing delays and maintaining bandwidth. This research paves the way for more reliable, low-latency IoT applications, significantly enhancing routing efficiency and network adaptability in dynamic IoT environments.

Energy‐efficient routing paradigm for resource‐constrained Internet of Things‐based cognitive smart city

An Energy Efficient Routing Protocol for Wireless Internet-of-Things Sensor Networks

Energy Efficient Optimized Routing Technique With Distributed SDN-AI to Large Scale I-IoT Networks

Optimized Fuzzy Logic Based Energy-Efficient Geographical Data Routing in Internet of Things

An energy‐efficient method using PSO clustering and fuzzy routing to reduce energy consumption in IoT

Sandpiper optimization algorithm with cosine similarity based cross‐layer routing protocol for smart agriculture in wireless sensor network assisted internet of things systems

Dynamic clustering optimization for energy efficient IoT Network: A simple constrastive graph approach

An opportunistic energy‐efficient dynamic self‐configuration clustering algorithm in WSN‐based IoT networks

ESEERP: Enhanced Smart Energy Efficient Routing Protocol for Internet of Things in Wireless Sensor Nodes

Optimizing routing in wireless sensor networks: leveraging pond skater and ant colony optimization algorithms

Energy optimized artificial hummingbird algorithm for routing in IoT‐based software‐defined WSN

EEDC: An Energy Efficient Data Communication Scheme Based on New Routing Approach in Wireless Sensor Networks for Future IoT Applications

An intelligent algorithm for energy efficiency optimization in software-defined wireless sensor networks for 5G communications

Bio-Inspired Energy-Efficient Cluster-Based Routing Protocol for the IoT in Disaster Scenarios

A Multi‐Constrained Green Routing Protocol for IoT‐Based Software‐Defined WSN

Distributed neuro-fuzzy routing for energy-efficient IoT smart city applications in WSN

Optimizing energy efficiency in wireless sensor networks: dynamic routing with capuchin search algorithm

A novel clustering model via optimized fuzzy C‐means algorithm and sandpiper optimization with cycle crossover process in IoT

AI Based Energy Efficient Routing Protocol for Intelligent Transportation System

Routing Optimization Strategy of IoT Awareness Layer Based on Improved Cat Swarm Algorithm

Soft Actor-critic-based Distributed Routing Scheme for Edge Computing Integrated with Dynamic IoT Networks