Reinforcement Learning Based Cluster Formation Algorithm in Wireless Sensor Networks.

Adama Hawa Rahima Fofana,Jianjun Lei
DOI: https://doi.org/10.1145/3654446.3654512
2023-01-01
Abstract:Wireless Sensor Networks (WSNs) play a pivotal role in various domains, offering various applications from environmental monitoring to industrial automation. Clustering is a fundamental technique that facilitates long-distance data transmission with minimal energy loss for energy-constrained sensor nodes. The selection of optimal cluster head (CH) profoundly impacts network performance by efficiently extending the network longevity. This paper presents a holistic clustering and CH selection algorithm for WSNs, which employs K-Means clustering to partition the network into distinct clusters. Moreover, we utilize a Soft Actor-Critic for Discrete Action Space (SAC-D) to dynamically assign CH for the dynamic real-time network. This reinforcement learning based approach optimizes CH selection and enhances the network lifespan. The simulation results show that the proposed algorithm outperforms the Low-Energy Adaptive Clustering Hierarchy (LEACH) and Energy-Aware Multi-Hop Multi-Path Hierarchical (EAMMH) protocols in terms of network lifespan, as indicated by average remaining energy and the number of dying nodes.
What problem does this paper attempt to address?