Deadline-Aware Cache Placement Scheme Using Fuzzy Reinforcement Learning in Device-to-Device Mobile Edge Networks
Manoj Kumar Somesula,Anusha Kotte,Sudarshan Chakravarthy Annadanam,Sai Krishna Mothku
DOI: https://doi.org/10.1007/s11036-022-02010-9
2022-07-16
Mobile Networks and Applications
Abstract:Caching the most likely to be requested content at the mobile devices in a cooperative manner can facilitate direct content delivery without fetching content from the remote content server and thus alleviate the user-perceived latency, reduce the burden on backhaul and minimize the duplicated content transmissions. In addition to content popularity, it is also essential to consider the users' dynamic behaviour for real-time applications, which can further improve the communication chances between user devices, leading to efficient content service time. The majority of previous studies consider stationary network topologies, in which all users remain stationary during data transmission, and the user can receive desired content from the corresponding base station. In this work, we study an essential issue: caching content by taking advantage of user mobility and the randomness of user interaction time. In a cooperative caching problem, we consider a realistic scenario with user devices moving at various velocities. We formulate the cache placement problem as maximization of saved delay with capacity and deadline constraints by considering the contact duration and inter-contact time among the user devices. We designed on-policy learning integrated fuzzy logic-based caching scheme to solve the high dimensionality of the proposed Integer linear programming problem. The proposed caching schemes improve the long-term reward and higher convergence rate than the Q-learning mechanism. Extensive simulation results demonstrate that the proposed cooperative caching mechanism significantly improves the performance in terms of reward, acceleration ratio, hit ratio and offloading ratio compared with existing mechanisms.
computer science, information systems,telecommunications, hardware & architecture