Navigating Boundaries in Quantifying Robustness: A DRL Expedition for Non-Linear Energy Harvesting IoT Networks

Ali Asgher Mohammed,Mirza Wasay Baig,Muhammad Abdullah Sohail,Syed Asad Ullah,Haejoon Jung,Syed Ali Hassan
DOI: https://doi.org/10.1109/lcomm.2024.3451702
IF: 3.5529
2024-10-11
IEEE Communications Letters
Abstract:This letter investigates the uplink communication of an energy harvesting (EH)-enabled resource-constrained secondary device (RCSD) coexisting with primary devices in a cognitive radio-aided non-orthogonal multi-access (CR-NOMA) network. Assuming a non-linear EH model in practice, the data rate of the RCSD is maximized using deep reinforcement learning (DRL). We first derive the optimal solutions for the parameters of interest including the time-sharing coefficient and transmit power of the RCSD, using convex optimization and then implement the DRL to address a continuous action spaced optimization problem. To comprehensively assess the agent's performance and adaptability, we implement various DRL algorithms and compare them under non-linear EH, which reveals their suitability in various scenarios, aiding in selecting the most effective approach.
telecommunications
What problem does this paper attempt to address?