Abstract:In the distributed network service systems such as streaming-media systems and resource-sharing systems with multiple service nodes, admission control (AC) technology is an essential way to enhance performance. Model-based optimization approaches are good ways to be applied to analyze and solve the optimal AC policy. However, due to “the curse of dimensionality”, computing such policy for practical systems is a rather difficult task. In this paper, we consider a general model of the distributed network service systems, and address the problem of designing an optimal AC policy. An analytical model is presented for the system with fixed parameters based on semi-Markov decision process (SMDP). We design an event-driven AC policy, and the stationary randomized policy is taken as the policy structure. To solve the SMDP, both the state aggregation approach and the reinforcement-learning (RL) method with online policy optimization algorithm are applied. Then, we extend the problem by considering the system with time-varying parameters, where the arrival rates of requests at each service node may change over time. In view of this situation, an AC policy switching mechanism is presented. This mechanism allows the system to decide whether to adjust its AC policy according to the policy switching rule. And in order to maximize the gain of system, that is, to obtain the optimal AC policy switching rule, another RL-based algorithm is applied. To assess the effectiveness of SMDP-based AC policy and policy switching mechanism for the system, numerical experiments are presented. We compare the performance of optimal policies obtained by the solutions of proposed methods with other classical AC policies. The simulation results illustrate that higher performance and computational efficiency could be achieved by using the SMDP model and RL-based algorithms proposed in this paper.

Adaptive resource allocation for media services based on semi-Markov decision process

Semi-Persistent Resource Allocation Based on Traffic Prediction for Vehicular Communications

SMDP-based Resource Allocation for Video Streaming in Cognitive Vehicular Networks.

A Decision-Theoretic Approach to Resource Allocation in Wireless Multimedia Networks

Semi-Markov Decision Process Approach-based Optimal Admission Control Policy for Flexible Multi-class QoS Requests

Admission Control of Distributed Media Service System Combined with Request Scheduling

Resource Allocation in Multi-channel Multi-user Relay System with Fairness Constraints

Adaptive Computing Resource Allocation For Mobile Cloud Computing

A Method for Adaptive Resource Adjustment of Dynamic Service Function Chain.

A Channel Allocation Scheme for Priority-Based Services in High-Speed Railway Wireless Communication Networks

Online Resource Allocation in Episodic Markov Decision Processes

Resource Allocation Strategy for Reliability and QoS Guarantee of Mmwave Offloading Using Markov Decision Process.

Stochastic Resource Scheduling Via Bilayer Dynamic Markov Decision Process in Mobile Cloud Networks.

Real-time Service Capacity Allocation with Advance Arrival Information and Instantaneous Services

An SMDP-Based Service Model for Interdomain Resource Allocation in Mobile Cloud Networks.

Sequential Fair Resource Allocation under a Markov Decision Process Framework

Adaptive resource allocation framework for user satisfaction maximization in multi-service wireless networks

A reinforcement-learning approach for admission control in distributed network service systems

Intelligent Multi-Radio Access Based on Markov Decision Process.

An Online Adaptive Bandwidth Allocation Optimization Algorithm for Wireless Multimedia Communication Networks

Service Provisioning and Profit Maximization in Network-Assisted Adaptive HTTP Streaming.