Reinforcement Learning Empowered Grey System Theory: Advancing Intelligence in Traffic Prediction for Wireless Sensor Networks

Yingzhi Wang,Chengsheng Pan,Feifei Gao,Huaifeng Shi,Jianfeng Shi
DOI: https://doi.org/10.1109/jsen.2023.3329516
IF: 4.3
2024-01-01
IEEE Sensors Journal
Abstract:In wireless sensor networks (WSNs), base stations (BS) or sink nodes (SNs) play a crucial role in receiving, processing, and transmitting data collected from sensors. Therefore, their traffic prediction performance significantly impacts the efficiency of sensor data transmission. While deep learning (DL) models have been widely utilized in WSNs due to their impressive feature extraction capabilities, they still face challenges related to sample size dependency and interpretability. Motivated by these challenges, this paper proposes a reinforcement learning (RL)-based grey prediction method to enhance the intelligence of traffic prediction in BS or SNs. In environment construction, we initially apply the Savitzky-Golay (SG) filter to mitigate the strong burstiness of network traffic. Subsequently, we introduce an enhanced exponential weakening buffer operator (EEWBO) to improve the small sample prediction performance of grey model GM(1,1) by introducing a new parameter, namely the correction factor (CF). Finally, we theoretically reveal the relationship between the fine-tuning strategy of CF and the buffer effect strength of EEWBO, providing interpretability for the agent’s action selection. During agent training, a sliding window is employed to update the state space, and the CF fine-tuning strategy is mapped to the action space. Additionally, a reward function based on prediction accuracy is designed. Experiments on public datasets show that the proposed RL-EEWBO-GM(1,1) exhibits advantages in sample size dependence, interpretability, and prediction performance when compared with classical statistical and DL models.
What problem does this paper attempt to address?