Abstract:In this paper, we investigate cost-aware joint learning and optimization for multi-channel opportunistic spectrum access in a cognitive radio system. We investigate a discrete time model where the time axis is partitioned into frames. Each frame consists of a sensing phase, followed by a transmission phase. During the sensing phase, the user is able to sense a subset of channels sequentially before it decides to use one of them in the following transmission phase. We assume the channel states alternate between busy and idle according to independent Bernoulli random processes from frame to frame. To capture the inherent uncertainty in channel sensing, we assume the reward of each transmission when the channel is idle is a random variable. We also associate random costs with sensing and transmission actions. Our objective is to understand how the costs and reward of the actions would affect the optimal behavior of the user in both offline and online settings, and design the corresponding opportunistic spectrum access strategies to maximize the expected cumulative net reward (i.e., reward-minus-cost). We start with an offline setting where the statistics of the channel status, costs and reward are known beforehand. We show that the the optimal policy exhibits a recursive double threshold structure, and the user needs to compare the channel statistics with those thresholds sequentially in order to decide its actions. With such insights, we then study the online setting, where the statistical information of the channels, costs and reward are unknown a priori. We judiciously balance exploration and exploitation, and show that the cumulative regret scales in O(log T). We also establish a matched lower bound, which implies that our online algorithm is order-optimal. Simulation results corroborate our theoretical analysis.

Optimal Energy-Delay Tradeoff for Opportunistic Spectrum Access in Cognitive Radio Networks

A POMDP-based optimal spectrum sensing and access scheme for cognitive radio networks with hardware limitation

Joint Spectrum Sensing and Transmission Strategy for Energy-Efficient Cognitive Radio Networks

Opportunistic Spectrum Access for Energy-Constrained Cognitive Radios

Energy-Efficient Delay-Constrained Transmission and Sensing for Cognitive Radio Systems

On Design of Opportunistic Spectrum Access in the Presence of Reactive Primary Users

On energy-optimal cooperation strategy in cognitive radio networks

Energy and Throughput Tradeoff in Hybrid Cognitive Radio Networks Based on POMDP

A Simple Priority Scheme with Spectrum Partition for Multiuser Opportunistic Spectrum Access in Cognitive Radio Networks

Joint Sensing Period and Transmission Time Optimization for Energy-Constrained Cognitive Radios

Partially Observable Markov Decision Process-Based MAC-layer Sensing Optimisation for Cognitive Radios Exploiting Rateless-Coded Spectrum Aggregation.

Sensing-Transmission Tradeoff for Multimedia Transmission in Cognitive Radio Networks

Optimal Spectrum Sensing Policy with Traffic Classification in RF-Powered CRNs

Distributed cooperation based Opportunistic Spectrum Access

Maximizing Social Welfare in Operator-based Cognitive Radio Networks under Spectrum Uncertainty and Sensing Inaccuracy

Machine-Learning-Based Opportunistic Spectrum Access in Cognitive Radio Networks

Delay-optimal Data Transmission in Renewable Energy Aided Cognitive Radio Networks

Joint Sensing Period Optimization And Transmission Time Allocation For Cognitive Radio Networks

An Improved Algorithm of Spectrum Access in OSA

Cost-Aware Learning and Optimization for Opportunistic Spectrum Access

An Energy-Preserving Spectrum Access Strategy In Cognitive Radio Networks