Abstract:In this paper, we investigate cost-aware joint learning and optimization for multi-channel opportunistic spectrum access in a cognitive radio system. We investigate a discrete time model where the time axis is partitioned into frames. Each frame consists of a sensing phase, followed by a transmission phase. During the sensing phase, the user is able to sense a subset of channels sequentially before it decides to use one of them in the following transmission phase. We assume the channel states alternate between busy and idle according to independent Bernoulli random processes from frame to frame. To capture the inherent uncertainty in channel sensing, we assume the reward of each transmission when the channel is idle is a random variable. We also associate random costs with sensing and transmission actions. Our objective is to understand how the costs and reward of the actions would affect the optimal behavior of the user in both offline and online settings, and design the corresponding opportunistic spectrum access strategies to maximize the expected cumulative net reward (i.e., reward-minus-cost). We start with an offline setting where the statistics of the channel status, costs and reward are known beforehand. We show that the the optimal policy exhibits a recursive double threshold structure, and the user needs to compare the channel statistics with those thresholds sequentially in order to decide its actions. With such insights, we then study the online setting, where the statistical information of the channels, costs and reward are unknown a priori. We judiciously balance exploration and exploitation, and show that the cumulative regret scales in O(log T). We also establish a matched lower bound, which implies that our online algorithm is order-optimal. Simulation results corroborate our theoretical analysis.

Learning-based channel selection and system performance of dynamic spectrum access

Cooperative Spectrum Access for Cognitive Radio Network Employing Rateless Code

Sensing Error Aware Delay-Optimal Channel Allocation Scheme for Cognitive Radio Networks.

Queuing Method in Combined Channel Aggregation and Fragmentation Strategy for Dynamic Spectrum Access

A Primary Traffic Aware Opportunistic Spectrum Sensing for Cognitive Radio Networks

Spectrum Prediction and Channel Selection for Sensing-Based Spectrum Sharing Scheme Using Online Learning Techniques.

Hopping-Based Channel Access in Cognitive Radio Systems

Multiple access algorithm based on channel sensing and prediction

Dynamic Channel Allocation-Based Call Admission Control in Cognitive Radio Networks

Q-Learning-Based Spectrum Access for Multimedia Transmission Over Cognitive Radio Networks

Energy-Efficient Spectrum Sensing by Optimal Periodic Scheduling in Cognitive Radio Networks

Exploration Vs Exploitation for Distributed Channel Access in Cognitive Radio Networks: A Multi-User Case Study.

Design and Analysis of Distributed Hopping-Based Channel Access in Multi-Channel Cognitive Radio Systems with Delay Constraints

Adaptive channel access in spectrum database-driven cognitive radio networks

Analysis of cognitive radio spectrum access with finite primary users and infinite secondary users

Almost Optimal Dynamically-Ordered Channel Sensing and Accessing for Cognitive Networks.

Cost-Aware Learning and Optimization for Opportunistic Spectrum Access

Sequential Joint Spectrum Sensing and Channel Estimation for Dynamic Spectrum Access

Modeling and Analysis of an Opportunistic Transmission Scheme Based on Channel Quality Information in Multi-Channel Cognitive Networks

QoS Driven Throughput Performance Analysis of Secondary User in Cognitive Radio Networks

Reciprocal Learning For Cognitive Medium Access