Abstract:The explosive growth of cellular traffic and its highly dynamic nature often make it prohibitive or even infeasible for a cellular service provider to provision enough cellular resources to support the peak traffic demands. The current best practice is to have the cellular service provider deploy alternative wireless technologies, such as Wi-Fi and Femtocells, on its own to complement the cellular network. However, this is not a viable long-term solution due to its high cost and the problem of wireless interference. We believe a more viable long-term solution is for the service provider to leverage resources from third-party resource owners on demand by buying capacity whenever needed. Measurement studies show that many third-party Wi-Fi hotspots and Femtocells have significant spare capacity even during busy hours. Moreover, when one cellular network is under stress, other cellular service providers in the same area may have spare cellular resources to provide dynamic roaming service. On-demand purchase of such third-party spare resources can potentially lead to a win-win solution: the cellular service provider achieves significant savings by not having to provision for the peak traffic demands; the third-party resource owners gain additional revenue from the otherwise wasted spare capacity; the overall user experience is also improved. In order for this approach to be successful, however, it is essential to have an incentive framework that can effectively foster collaboration while guarding against non-truthful and collusive behaviors. We use reverse auction to approach this problem. This is motivated by the following observations. First, a key challenge in utilizing resources from third-party resource owners is that we do not know their true valuation. Their cost function may be based on multiple considerations, some of which may not be revealed to the cellular service provider. Reverse auctions provide a formal framework for third-party resource owners to express the price they demand and for the cellular service provider to optimize the allocation based on the received bids. Second, by using reverse auctions, the cellular service provider no longer needs to negotiate a long-term bi-lateral agreement with each individual third-party resource owner, which is difficult due to dynamic traffic demands and resource availability. Third, reverse auctions can be incrementally deployed today, yielding savings to the cellular service provider even when only a subset of third-party resource owners participate.

Leveraging Load-Aware Dynamic Pricing for Cell-Level Demand-Supply Equilibrium

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Incentivized Cellular Offloading Via Auctions

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

Wireless Service Pricing Competition under Network Effect, Congestion Effect, and Bounded Rationality

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

A Reinforcement Learning-Based Reverse Auction Enforcing Smart Pricing Policies towards B5G Offloading Strategies

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

A deep reinforcement learning-based D2D spectrum allocation underlaying a cellular network

Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning

ReLeDP: Reinforcement-Learning-Assisted Dynamic Pricing for Wireless Smart Grid

Dynamic Pricing Scheme for Edge Computing Services: A Two-layer Reinforcement Learning Approach

The Cost of Learning: Efficiency vs. Efficacy of Learning-Based RRM for 6G

Dynamic Pricing for Smart Mobile Edge Computing: A Reinforcement Learning Approach

Offline DRL for Price-Based Demand Response: Learning From Suboptimal Data and Beyond

Deep Reinforcement Learning-Based Dynamic Spectrum Access for D2D Communication Underlay Cellular Networks

Dynamic Spectrum Sharing Based on Deep Reinforcement Learning in Mobile Communication Systems

Dynamic RRH-BBU Mapping for C-RAN: A Data-Driven Approach

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

Power Optimization in Device-to-Device Communications: A Deep Reinforcement Learning Approach with Dynamic Reward.

A DRL-Driven Intelligent Optimization Strategy for Resource Allocation in Cloud-Edge-End Cooperation Environments