Abstract:Providing qualified and sustainable communications is one of the key challenges for the Internet of Underwater Things (IoUT) facing constrained energy supplements, nonstationary environments, and severe communication interference. Owing to spatial separation, several nodes can (and are often required to) make transmissions simultaneously to maximize network capacity. However, existing transmission solutions often face the dilemma between maximizing local capacity and global concurrency. We break this dilemma via UDARMF, an underwater distributed and adaptive resource management framework, which maximizes network capacity by supporting an increased number of communications in the network. It is a distributed deep multiagent reinforcement learning framework that uses an observation encoder and a local utility network to coordinate the collaboration among underwater nodes by adaptively tuning its transmit parameters. We designed experiments to compare UDARMF with baselines in network capacity, concurrency, and energy efficiency. Extensive experiments were conducted to find the appropriate hyperparameters to achieve the optimal network performances. We also analyze the performance of UDARMF and baselines over diverse communication and lifetime requirements, communication environment, and energy storage. Simple closed-form approximations of UDARMF are given to reveal that an energy-constrained network's capacity increases with available energy, following a linear trend on the logarithmic scale. Experimental results demonstrate that compared to other methods, UDARMF achieves a much better tradeoff between network capacity and concurrency, at which the lifetime requirements are satisfied. The proposed framework and the closed-form approximations are likely to become valuable tools in designing and analyzing IoUT.

A Deep MARL-Based Power-Management Strategy for Improving the Fair Reuse of UWSNs

A Scalable and Fair Power Allocation Scheme Based on Deep Multi-Agent Reinforcement Learning in Underwater Wireless Sensor Networks

Achieving Time-Sharing and Spatial-Reuse Underwater Wireless Sensor Networks with Communication Fairness: A Distributed Deep Multi-Agent Reinforcement Learning Approach

A Centralized Cross-Layer Protocol for Joint Power Control, Link Scheduling, and Routing in UWSNs

Distributed Polite Water-Filling for Optimization of MIMO B-MAC Interference Networks

Traffic Load-Aware Resource Management Strategy for Underwater Wireless Sensor Networks

UDARMF: An Underwater Distributed and Adaptive Resource Management Framework

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

Downlink Transmit Power Control in Ultra-Dense UAV Network Based on Mean Field Game and Deep Reinforcement Learning

Achieving Fair-Effective Communications and Robustness in Underwater Acoustic Sensor Networks: A Semi-Cooperative Approach

An end-to-end sensor scheduling method based on D3QN for underwater passive tracking in UWSNs

Joint Link Scheduling and Power Allocation in Imperfect and Energy-Constrained Underwater Wireless Sensor Networks

An Efficient Routing Access Method Based on Multi-Agent Reinforcement Learning in UWSNs

Collaborative Optimization of Wireless Communication and Computing Resource Allocation based on Multi-Agent Federated Weighting Deep Reinforcement Learning

Deep-Reinforcement-Learning-Based Resource Allocation in ultra-dense network.

An Efficient Deployment Scheme with Network Performance Modeling for Underwater Wireless Sensor Networks

Hybrid FPMS: A New Fairness Protocol Management Scheme for Community Wireless Mesh Networks

DC-MAC: A Delay-Aware and Collision-Free MAC Protocol Based on Game Theory for Underwater Wireless Sensor Networks

Joint Power and Time Resource Optimization in Full-Duplex Wireless-Powered Communication Networks.

Routing Protocol Design for Underwater Optical Wireless Sensor Networks: A Multiagent Reinforcement Learning Approach.

Fairness-Aware Resource Allocation in Multi-Hop Wireless Powered Communication Networks with User Cooperation