Abstract:Call admission control is one of the key elements in ensuring the quality of service in mobile wireless networks. The traditional trunk reservation policy and its numerous variants give preferential treatment to the handoff calls over new arrivals by reserving a number of radio channels exclusively for handoffs. Such schemes, however, cannot adapt to changes in traffic pattern due to the static nature. This paper introduces a novel stable dynamic call admission control mechanism (SDCA), which can maximize the radio channel utilization subject to a predetermined bound on the call dropping probability. The novelties of the proposed mechanism are: (1) it is adaptive to wide range of system parameters and traffic conditions due to its dynamic nature; (2) the control is stable under overloading traffic conditions, thus can effectively deal with sudden traffic surges; (3) the admission policy is stochastic, thus spreading new arrivals evenly over a control period, and resulting in more effective and accurate control; and (4) the model takes into account the effects of limited channel capacity and time dependence on the call dropping probability, and the influences from nearest and next-nearest neighboring cells, which greatly improve the control precision. In addition, we introduce local control algorithms based on strictly local estimations of the needed traffic parameters, without requiring the status information exchange among different cells, which makes it very appealing in actual implementation. Most of the computational complexities lie in off-line precalculations, except for the nonlinear equation of the acceptance ratio, in which a coarse-grain numerical integration is shown to be sufficient for stochastic control. Extensive simulation results show that our scheme steadily satisfies the hard constraint on call dropping probability while maintaining a high channel throughput.

Continuous-time Markov Decision Processes to Call Admission Control Problem

Admission Control and Channel Allocation for Supporting Real-Time Applications in Cognitive Radio Networks

Delay Sensitive Communications over Cognitive Radio Networks

A Simulation Optimization Algorithm for CTMDPs Based on Randomized Stationary Policies

Parameterized Markov Decision Process and Its Application to Service Rate Control.

Optimal Time-Abstract Schedulers for CTMDPs and Markov Games

A Dynamic Call Admission Policy with Precision QoS Guarantee Using Stochastic Control for Mobile Wireless Networks

Performance Optimization of Continuous-Time Markov Control Processes Based on Performance Potentials

Dynamic Channel Allocation-Based Call Admission Control in Cognitive Radio Networks

Optimal control of probabilistic discrete event systems on Markov decision processes

Admission control in cognitive radio networks with finite queue and user impatience

Optimal Stationary Policies for Semi-Markov Control Processes with Discounted-Cost Criteria

A Real-Time Access Control of Patient Service in the Outpatient Clinic.

The existence of optimal control for continuous-time Markov decision processes in random environments

Performance Optimization for Countable Semi-Markov Decision Processes with Discounted-cost

Perimeter Traffic Flow Control for a Multi-Region Large-Scale Traffic Network With Markov Decision Process

Policy iteration for parameterized Markov decision processes and its application

Continuous Time Markov Decision Processes with Discounted Moment Criterion

Inpatient Overflow Management with Proximal Policy Optimization

Simulation Optimization Algorithm for SMDPs with Parameterized Randomized Stationary Policies

A Probability-Based Adaptive Algorithm for Call Admission Control in Wireless Network