Abstract:In the distributed network service systems such as streaming-media systems and resource-sharing systems with multiple service nodes, admission control (AC) technology is an essential way to enhance performance. Model-based optimization approaches are good ways to be applied to analyze and solve the optimal AC policy. However, due to “the curse of dimensionality”, computing such policy for practical systems is a rather difficult task. In this paper, we consider a general model of the distributed network service systems, and address the problem of designing an optimal AC policy. An analytical model is presented for the system with fixed parameters based on semi-Markov decision process (SMDP). We design an event-driven AC policy, and the stationary randomized policy is taken as the policy structure. To solve the SMDP, both the state aggregation approach and the reinforcement-learning (RL) method with online policy optimization algorithm are applied. Then, we extend the problem by considering the system with time-varying parameters, where the arrival rates of requests at each service node may change over time. In view of this situation, an AC policy switching mechanism is presented. This mechanism allows the system to decide whether to adjust its AC policy according to the policy switching rule. And in order to maximize the gain of system, that is, to obtain the optimal AC policy switching rule, another RL-based algorithm is applied. To assess the effectiveness of SMDP-based AC policy and policy switching mechanism for the system, numerical experiments are presented. We compare the performance of optimal policies obtained by the solutions of proposed methods with other classical AC policies. The simulation results illustrate that higher performance and computational efficiency could be achieved by using the SMDP model and RL-based algorithms proposed in this paper.

Analysis of Admission Control in SDN-based Media Delivery Network

Delay Sensitive Communications over Cognitive Radio Networks

Admission Control and Channel Allocation for Supporting Real-Time Applications in Cognitive Radio Networks

Switching-POMDP Based Admission Control Policies for Service Systems with Distributed Architecture.

Admission Control of Distributed Media Service System Combined with Request Scheduling

Achieving Real-Time Quality of Service with Software Defined Networking

Admission Control For Distributed Vod System With Scalable Videos

Admission Control Scheme for Distributed Service Systems Based on Model and Prediction

Admission control in cognitive radio networks with finite queue and user impatience

SMDP-based Resource Allocation for Video Streaming in Cognitive Vehicular Networks.

Joint Admission Control and Routing Via Neuro-Dynamic Programming for Streaming Video over SDN

Distributed Collaborative Admission Control Model of Video Service

Distributed collaborative admission control model based on Markov switching space

Deep Packet Inspection Based Application-Aware Traffic Control For Software Defined Networks

Semi-Markov Decision Process Approach-based Optimal Admission Control Policy for Flexible Multi-class QoS Requests

A reinforcement-learning approach for admission control in distributed network service systems

A Novel Calling Admission Control Scheme Based on Multi-Priority Delay Reservation

An adaptive call admission policy for broadband wireless multimedia networks using stochastic control

High-efficient Admission Control in Ad Hoc Networks

Admission Control in A Pure Loss Healthcare Network: Mdp and Des Approach