A fast algorithm for nonsmooth penalized clustering

Ruizhi Zhou,Xin Shen,Lingfeng Niu

DOI: https://doi.org/10.1016/j.neucom.2017.08.048

IF: 6

2018-01-17

Neurocomputing

Abstract:

What problem does this paper attempt to address?

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Renlang Huang,Miao Guo,Chaojie Gu,Shibo He,Jiming Chen,Mingyang Sun

DOI: https://doi.org/10.1109/tgcn.2023.3295341

2023-01-01

IEEE Transactions on Green Communications and Networking

Abstract:As an emerging and promising network paradigm, network slicing creates multiple logical networks on shared infrastructure to provide services with customized Quality-of-Service (QoS) for heterogeneous devices and applications. However, network complexity and service heterogeneity pose a huge challenge in achieving optimal performance and ensuring stringent QoS requirements. In this paper, we design a hierarchical deep reinforcement learning based 5G radio access network slicing framework to achieve scalable and efficient resource allocation. By decomposing the resource allocation problem into a slice-level task and several user-level tasks, the proposed framework tackles each task with an agent, thus conquering insufficient exploration and achieving scalable management. Knowledge transfer and progressive learning are employed to improve training efficiency and stability, respectively. We apply collaborative training to eliminate distribution mismatch by refining value approximators and policies of agents alternately. Extensive experiments show that the proposed framework can learn effective resource allocation policies stably and efficiently and outperform other methods in network utility maximization and QoS assurance, which improves the network utility by 25% and 8% compared with the random strategy and the ADMM strategy, respectively. Furthermore, we validate that our framework is more robust to changes in network traffic conditions including network congestion.
Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Ding Ma,Yang Wang,Sai Wu,Wanqiao Wang

DOI: https://doi.org/10.1109/iccc59590.2023.10507505

2023-01-01

Abstract:In recent years, extreme weather has caused unstable power generation on the power side, posing a great need to build a new power load management system to unleash the ability of flexible load regulation for ensuring the balance between power grid sources and loads. The new power load management system needs to monitor and regulate dispersed load resources, thus posing higher requirements for the real-time performance and resource guarantee capabilities of communication networks. Currently, there is no slicing algorithm and communication resource allocation algorithm specifically designed for the new power load management system in 5G communication networks. To address these issues, this paper categorizes the service of the new power load management system and uses 5G slicing to carry it out, establishing a new power load management system 5G radio access net-work(RAN) slicing resource allocation model. The slicing resource allocation problem is transformed into a Markov decision process, and the state space, action space, and reward function are designed. Additionally, a dueling deep Q network(DQN) based 5G RAN slicing resource allocation algorithm is proposed, which learns from the historical resource needs of slices to provide the optimal resource allocation strategy. Simulation results show that the proposed algorithm can meet the communication resource needs of the new power load management system and has very high resource utilization efficiency.
Network Slicing for 5G with UE State Based Allocation and Blockchain Approach

V. Chamola,Vikas Hassija,G. Praveen,D. Niyato

DOI: https://doi.org/10.1109/MNET.011.2000489

IF: 10.294

2021-05-01

IEEE Network

Abstract:5G communications technologies are the backbone of future communications systems in satisfying different heterogeneous requirements of the industry and consumer applications. These systems rely on standardized protocols and heterogeneous architectures to engineer massive scaling of communication devices. Network Slicing (NS) can be incorporated into 5G to cater to the ever increasing needs of smart communications, ranging from Enhanced Mobile Broadband (eMBB) to Ultra-Reliable Low Latency Communications (URLLC). In this article, we present the performance analysis of such a network using real-world deployment and testing scenarios with state based network slice allocation. To account for transparency and security, a Blockchain-based model is integrated within the network operations. In particular, we carefully account for the latency aware operations of Network Slicing along with its UE state based allocation by telecom providers using Blockchain. Furthermore, provisioning the Blockchain in the Network Slice allocations increases the transparency and efficiency of resource handling operations within the network.

Computer Science,Engineering
An Adaptive Sharding-based Blockchain for Network Slicing in 5G

Hai-Anh Tran,V. Tong,Sami Souihi,Quang Huy Do,S. Piergiovanni

DOI: https://doi.org/10.1109/GLOBECOM54140.2023.10437452

2023-12-04

Abstract:Fifth-generation wireless technology, or 5G, promises increased data speeds, lower latency and greater capacity for mobile communications, enabling the growth of the Internet of Things (IoT). Network slicing is an advantageous feature of 5G that enables the creation of multiple virtual networks to meet the performance, security, and reliability needs of different services. This feature, combined with blockchain technology, provides secure and transparent data sharing between devices and networks. In addition, blockchain-enabled network slicing improves 5G network management and creates new business models for industries such as healthcare, transportation, and manufacturing. However, most current blockchain systems are limited in their ability to handle high throughput, which is not equivalent to what 5G can do. Therefore, sharding-based blockchain is proposed as a possible solution to improve the scalability and throughput of blockchain networks. By dividing the network into parts or shards, transactions can be processed simultaneously, allowing for faster transaction verification times and increased network capacity. Although current sharding-based blockchain networks have some limitations, such as static sharding policies that cannot cope with the dynamic blockchain environment, an adaptive sharding blockchain system using Deep Reinforcement Learning (DRL) methods has been proposed to address this situation. The approach allows the system to change or adapt the shard specifications, such as shard size or block size, whenever necessary to ensure maximum throughput while maintaining the security and integrity of the blockchain network.

Engineering,Computer Science
Trade-off Analysis Between Delay and Throughput of RAN Slicing for Smart Grid

Zhi Li,Jiye Wang,Yang Wang,Sachula Meng,Sai Wu,Huixia Ding,Zhihui Wang

DOI: https://doi.org/10.1016/j.comcom.2021.07.004

IF: 5.047

2021-01-01

Computer Communications

Abstract:Emerging power services with massive connections and real-time control have different requirements on delay, rate, reliability, etc. In order to meet the diversified requirements of power services, network slicing can provide guarantee for the wide application of 5G in power. The current research on network slicing adapting power services is still in its infancy. This paper proposes a trade-off analysis method for radio access network (RAN) slice delay and throughput based on dynamic intelligent resource allocation to meet the different QoS requirements of different services in smart grid scenarios. Firstly, clustering analysis is used to classify the communication requirements of smart grid services. A throughput demand model for enhanced mobile broadband (eMBB) slice users based on importance and a delay constraint model for ultra-reliable and low latency communication (uRLLC) slice users are constructed, and a throughput model for slice users based on cell capacity limitation is constructed. Then, the problem model of maximizing the throughput of the eMBB slice by reasonably allocating resource blocks and power under the premise of ensuring the delay of the uRLLC slice is established. The Lyapunov drift plus penalty function method is used to convert the above problem into a tractable form, and then the problem is solved by the active set method. Simulation results show that the different QoS requirements of smart grid services will significantly affect the actual queue length of the uRLLC slice as well as the throughput of the eMBB slice.
Real-Time Resource Slicing for 5G RAN Via Deep Reinforcement Learning

Ranran Xi,Xin Chen,Ying Chen,Zhuo Li

DOI: https://doi.org/10.1109/icpads47876.2019.00094

2019-01-01

Abstract:With the rapid growth of Internet of Things (IoT), network slicing is regarded as an important technology to support the multi-users' needs for 5G mobile network. Network slicing allows network operators to provide services to different users, which can improve the rational utilization of network and hardware resources. In order to ensure the quality of service and build low-cost network infrastructure services, it is a challenging problem to find an appropriate resource allocation mechanism. In this paper, we discuss resource allocation in 5G radio access network (RAN). Considering the real-time resource request of the slice user, we propose a semi-Markov decision system model, which enables the virtual network provider to effectively satisfy the different user demands in real time. Then, we propose a resource slicing algorithm based on deep reinforcement learning (RS-DRL), which aims to improve the long-term benefits of virtual network providers and the utilization of slicing resources. We evaluate the performance of the RS-DRL through evaluations and comparisons. The results show that the proposed RS-DRL algorithm can effectively improve the performance and achieve the long-term benefits quickly.
Analysis of Network Slicing for Management of 5G Networks Using Machine Learning Techniques

Randeep Singh,Abolfazl Mehbodniya,Julian L. Webber,Pankaj Dadheech,G. Pavithra,Mohammed S. Alzaidi,Reynah Akwafo

DOI: https://doi.org/10.1155/2022/9169568

2022-06-03

Wireless Communications and Mobile Computing

Abstract:Consumer expectations and demands for quality of service (QoS) from network service providers have risen as a result of the proliferation of devices, applications, and services. An exceptional study is being conducted by network design and optimization experts. But despite this, the constantly changing network environment continues to provide new issues that today's networks must be dealt with effectively. Increased capacity and coverage are achieved by joining existing networks. Mobility management, according to the researchers, is now being investigated in order to make the previous paradigm more flexible, user-centered, and service-centric. Additionally, 5G networks provide higher availability, extremely high capacity, increased stability, and improved connection, in addition to quicker speeds and less latency. In addition to being able to fulfil stringent application requirements, the network infrastructure must be more dynamic and adaptive than ever before. Network slicing may be able to meet the present stringent application requirements for network design, if done correctly. The current study makes use of sophisticated fuzzy logic to create algorithms for mobility and traffic management that are as flexible as possible while yet maintaining high performance. Ultimately, the purpose of this research is to improve the quality of service provided by current mobility management systems while also optimizing the use of available network resources. Building SDN (Software-Defined Networking) and NFV (Network Function Virtualization) technologies is essential. Network slicing is an architectural framework for 5G networks that is intended to accommodate a variety of different networks. In order to fully meet the needs of various use cases on the network, network slicing is becoming more important due to the increasing demand for data rates, bandwidth capacity, and low latency.

computer science, information systems,telecommunications,engineering, electrical & electronic
Deep Reinforcement Learning for Network Slicing with Heterogeneous Resource Requirements and Time Varying Traffic Dynamics

Jaehoon Koo,Veena B. Mendiratta,Muntasir Raihan Rahman,Anwar Walid

DOI: https://doi.org/10.23919/cnsm46954.2019.9012702

2019-10-01

Abstract:Efficient network slicing is vital to deal with the highly variable and dynamic characteristics of traffic in 5G networks. Network slicing addresses a challenging dynamic network resource allocation problem where a single network infrastructure is divided into (virtual) multiple slices to meet the demands of different users with varying requirements, the main challenges being — the traffic arrival characteristics and the job resource requirements (e.g., compute, memory and bandwidth resources) for each slice can be highly dynamic. Traditional model-based optimization or queueing theoretic modeling becomes intractable with the high reliability, and stringent bandwidth and latency requirements imposed by 5G. We propose a deep reinforcement learning approach to address this dynamic coupled resource allocation problem. Model evaluation using synthetic and real workload data demonstrates that our deep reinforcement learning solution improves overall resource utilization, latency performance, and demands satisfied as compared to a baseline equal slicing strategy.
Data-Driven Network Slicing From Core to RAN for 5G Broadcasting Services

Hui Yang,Ao Yu,Jie Zhang,Jingwen Nan,Bowen Bao,Qiuyan Yao,Mohamed Cheriet

DOI: https://doi.org/10.1109/tbc.2020.3031742

IF: 4.5

2021-03-01

IEEE Transactions on Broadcasting

Abstract:Network slicing is a widely discussed technology for 5G broadcasting services, as it allows the operators to create end-to-end virtual slices across the 5G core (5GC) and the 5G radio access network (RAN). The joint network slicing is necessary for 5GC and 5G RAN in a bid to enhance the overall resource utilization and quality of service. Nevertheless, as the dimension of network resource and user demand increase, the computational complexity of slice status update goes up as well. To overcome this scalability problem, we propose a data driven approach to realize joint slice reconfiguration from 5GC to 5G RAN in real-time. Our design shortens significantly the time of slice status update by mapping the resource status to a two-dimensional vector graph. In addition, we also introduce a corresponding slice reconfiguration algorithm to balance the load of each slice in 5GC and 5G RAN. Simulation results justify that our proposed approach can greatly reduce the cost of slice status update and achieve desirable slice reconfiguration performance.

telecommunications,engineering, electrical & electronic
Intelligent and Collaborative Orchestration of Network Slices

Ying Wang,Naling Li,Peng Yu,Wenjing Li,Xuesong Qiu,Shangguang Wang,Mohamed Cheriet

DOI: https://doi.org/10.1109/tsc.2022.3180831

IF: 11.019

2023-04-12

IEEE Transactions on Services Computing

Abstract:5G and beyond network will support vertical industry applications, and the resource requirements of each service vary widely. The introduction of network slices provides great flexibility to the network, which can realize the differentiated customization requirements of service. However, while determining how to intelligently orchestrate the network slices is an important challenge, current solutions rarely treat multiple customized requirements of delay, bandwidth, load balancing, and slice isolation. In this article, network slice orchestration is considered from the perspective of slice isolation and cloud-edge collaboration. First, differentiated isolation level requirements are restricted to constraints, the customized isolation is realized. Second, bandwidth is saved and network latency is reduced via the collaboration of cloud and edge data centers. In addition, exclusive orchestration optimization objectives that match various service needs are proposed to distinguish the specific requirements of different slices. Finally, two deep reinforcement learning-based algorithms are proposed. The experimental results demonstrate that the proposed algorithms can optimize the objectives while ensuring differentiated isolation levels. For typical slices, the proposed algorithms respectively reduce bandwidth consumption by about 29% and 64%, reduce slice delay by about 14% and 70%, and optimize load balancing by about 17% and 23%.

computer science, information systems, software engineering
Slice Management Mechanism based on Dynamic Weights for Service Guarantees in Smart Grid

Zhihui Wang,Sachula Meng,Lili Sun,Huixia Ding,Sai Wu,Delong Yang,Liang Li,Xue Wang,Linhan Xi

DOI: https://doi.org/10.1109/ICIST.2019.8836942

2019-01-01

Abstract:With the rapid development of the power grid, the variety of power services has become more and more diverse, resulting in different service needs. As one of the important technologies of 5G, network slicing aims to accommodate different services over the same physical network. In this paper, after briefly analyzing the background of smart grid, we investigate the related research of network slicing. Each kind of services in smart grid has its own bandwidth, reliability and delay tolerance requirements. Therefore, for the purpose of service guarantees in smart grid, we propose a slice management mechanism for resource allocation based on 5G network slicing technology. Due to the good self-learning and adaptive capabilities, we use BP(back-propagation) neural network to train the appropriate weights. Correspondingly, a heuristic algorithm for dynamic weights based on BP neural network to solve the optimization problem is proposed. Finally, simulation results demonstrate the effectiveness of our algorithm within the mechanism.
Reinforcement Learning for Dynamic Resource Optimization in 5G Radio Access Network Slicing

Yi Shi,Yalin E. Sagduyu,Tugba Erpek

DOI: https://doi.org/10.48550/arXiv.2009.06579

2020-09-15

Abstract:The paper presents a reinforcement learning solution to dynamic resource allocation for 5G radio access network slicing. Available communication resources (frequency-time blocks and transmit powers) and computational resources (processor usage) are allocated to stochastic arrivals of network slice requests. Each request arrives with priority (weight), throughput, computational resource, and latency (deadline) requirements, and if feasible, it is served with available communication and computational resources allocated over its requested duration. As each decision of resource allocation makes some of the resources temporarily unavailable for future, the myopic solution that can optimize only the current resource allocation becomes ineffective for network slicing. Therefore, a Q-learning solution is presented to maximize the network utility in terms of the total weight of granted network slicing requests over a time horizon subject to communication and computational constraints. Results show that reinforcement learning provides major improvements in the 5G network utility relative to myopic, random, and first come first served solutions. While reinforcement learning sustains scalable performance as the number of served users increases, it can also be effectively used to assign resources to network slices when 5G needs to share the spectrum with incumbent users that may dynamically occupy some of the frequency-time blocks.

Networking and Internet Architecture,Machine Learning
RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning

Hao Zhou,Medhat Elsayed,Melike Erol-Kantarci

DOI: https://doi.org/10.48550/arXiv.2107.01018

2021-06-24

Abstract:5G is regarded as a revolutionary mobile network, which is expected to satisfy a vast number of novel services, ranging from remote health care to smart cities. However, heterogeneous Quality of Service (QoS) requirements of different services and limited spectrum make the radio resource allocation a challenging problem in 5G. In this paper, we propose a multi-agent reinforcement learning (MARL) method for radio resource slicing in 5G. We model each slice as an intelligent agent that competes for limited radio resources, and the correlated Q-learning is applied for inter-slice resource block (RB) allocation. The proposed correlated Q-learning based interslice RB allocation (COQRA) scheme is compared with Nash Q-learning (NQL), Latency-Reliability-Throughput Q-learning (LRTQ) methods, and the priority proportional fairness (PPF) algorithm. Our simulation results show that the proposed COQRA achieves 32.4% lower latency and 6.3% higher throughput when compared with LRTQ, and 5.8% lower latency and 5.9% higher throughput than NQL. Significantly higher throughput and lower packet drop rate (PDR) is observed in comparison to PPF.

Networking and Internet Architecture,Systems and Control
Toward an Efficient and Dynamic Allocation of Radio Access Network Slicing Resources for 5G Era

Xiaolei Chang,Tian Ji,Runsu Zhu,Zhenzhou Wu,Chenxi Li,Yong Jiang

DOI: https://doi.org/10.1109/ACCESS.2023.3309294

IF: 3.9

2023-01-01

IEEE Access

Abstract:With the development of 5G technology and Internet of Things (IoT), more and more devices are connected through 5G wirelessly. Radio access network (RAN) slicing, as a key feature of 5G, enables a flexible bandwidth resource allocation policy, and facilitates various types of services to operate on different network slices. However, RAN slicing resources is scarce, thus effective management of wireless bandwidth resources in RAN slicing becomes indispensable to improve user satisfaction. Extensive research has investigated into RAN slicing, but they do not take user mobility into consideration. While RAN slicing allocation has a great impact on user experience in mobile 5G scenarios, user mobility poses great challenges to network management and causing unsatisfaction of users. In this paper, we propose a new RAN slicing allocation strategy based on machine learning, to maximize spectrum efficiency while guaranteeing the Service Satisfaction Ratio (SSR) of various slicing services. To further alleviate the SSR fluctuation brought by user mobility, we study into the temporal characteristics of user mobility and preprocess the state sequences using Long Short-Term Memory (LSTM) networks. Finally, these sequences are taken as the input of an Advantage Actor Critic (A2C) reinforcement learning network to develop a RAN slicing allocation policy. We conduct comprehensive simulations, and the results show that the performance of the proposed mechanism outperforms the traditional mechanism in ensuring SSR and enhancing the spectrum efficiency.
Generalizable Resource Scaling of 5G Slices using Constrained Reinforcement Learning

Muhammad Sulaiman,Mahdieh Ahmadi,Mohammad A. Salahuddin,Raouf Boutaba,Aladdin Saleh

2023-06-16

Abstract:Network slicing is a key enabler for 5G to support various applications. Slices requested by service providers (SPs) have heterogeneous quality of service (QoS) requirements, such as latency, throughput, and jitter. It is imperative that the 5G infrastructure provider (InP) allocates the right amount of resources depending on the slice's traffic, such that the specified QoS levels are maintained during the slice's lifetime while maximizing resource efficiency. However, there is a non-trivial relationship between the QoS and resource allocation. In this paper, this relationship is learned using a regression-based model. We also leverage a risk-constrained reinforcement learning agent that is trained offline using this model and domain randomization for dynamically scaling slice resources while maintaining the desired QoS level. Our novel approach reduces the effects of network modeling errors since it is model-free and does not require QoS metrics to be mathematically formulated in terms of traffic. In addition, it provides robustness against uncertain network conditions, generalizes to different real-world traffic patterns, and caters to various QoS metrics. The results show that the state-of-the-art approaches can lead to QoS degradation as high as 44.5% when tested on previously unseen traffic. On the other hand, our approach maintains the QoS degradation below a preset 10% threshold on such traffic, while minimizing the allocated resources. Additionally, we demonstrate that the proposed approach is robust against varying network conditions and inaccurate traffic predictions.

Networking and Internet Architecture,Machine Learning
Network Slicing Based 5G and Future Mobile Networks: Mobility, Resource Management, and Challenges

H. Zhang,N. Liu,X. Chu,K. Long,A. Aghvami,V. C. M. Leung

DOI: https://doi.org/10.48550/arXiv.1704.07038

2017-04-24

Abstract:The fifth-generation (5G) networks are expected to be able to satisfy users' different quality-of-service (QoS) requirements. Network slicing is a promising technology for 5G networks to provide services tailored for users' specific QoS demands. Driven by the increased massive wireless data traffic from different application scenarios, efficient resource allocation schemes should be exploited to improve the flexibility of network resource allocation and capacity of 5G networks based on network slicing. Due to the diversity of 5G application scenarios, new mobility management schemes are greatly needed to guarantee seamless handover in network slicing based 5G systems. In this article, we introduce a logical architecture for network slicing based 5G systems, and present a scheme for managing mobility between different access networks, as well as a joint power and subchannel allocation scheme in spectrum-sharing two-tier systems based on network slicing, where both the co-tier interference and cross-tier interference are taken into account. Simulation results demonstrate that the proposed resource allocation scheme can flexibly allocate network resources between different slices in 5G systems. Finally, several open issues and challenges in network slicing based 5G networks are discussed, including network reconstruction, network slicing management and cooperation with other 5G technologies.

Information Theory
Fast and Scalable Network Slicing by Integrating Deep Learning with Lagrangian Methods

Tianlun Hu,Qi Liao,Qiang Liu,Antonio Massaro,Georg Carle

2024-01-22

Abstract:Network slicing is a key technique in 5G and beyond for efficiently supporting diverse services. Many network slicing solutions rely on deep learning to manage complex and high-dimensional resource allocation problems. However, deep learning models suffer limited generalization and adaptability to dynamic slicing configurations. In this paper, we propose a novel framework that integrates constrained optimization methods and deep learning models, resulting in strong generalization and superior approximation capability. Based on the proposed framework, we design a new neural-assisted algorithm to allocate radio resources to slices to maximize the network utility under inter-slice resource constraints. The algorithm exhibits high scalability, accommodating varying numbers of slices and slice configurations with ease. We implement the proposed solution in a system-level network simulator and evaluate its performance extensively by comparing it to state-of-the-art solutions including deep reinforcement learning approaches. The numerical results show that our solution obtains near-optimal quality-of-service satisfaction and promising generalization performance under different network slicing scenarios.

Networking and Internet Architecture,Artificial Intelligence,Machine Learning
Slice Allocation Management Model in 5G Networks for IoT Services with Reliable Low Latency

Mohammed Dighriri,Abayomi Otebolaku,Ali Alfoudi,Gyu Myoung Lee

DOI: https://doi.org/10.20944/preprints202007.0536.v1

2020-07-23

Abstract:Network slicing is a promising technology for 5G networks in which operators can sell customized services to different tenants at various prices and Quality of Services (QoS) demands. Thus, the latest 4th Generation (4G) and upcoming 5th Generation (5G) mobile technologies are expected to offer massive connectivity and management of high volume of data traffic in the presence of immense interferences from mobile networks of IoT devices. Further, it will face challenges of congestion and overload of data traffic due to the humongous number of IoT devices. Nevertheless, these devices are likely to demand high throughput, low latency, and high level of reliability especially for critical real-time applications such as in Vehicular Communication System (VCS). To address these issues in 5G mobile networks, this paper proposes a Slice Allocation Management (SAM) Model based on the critical services of smart systems such as VCS to satisfy QoS demands. The proposed model aims at providing dedicated slices on the basis of service requirements such as expected throughput and latency for VCS. To ensure such performance and provide data traffic priorities of IoT devices in the uplink of Relay Nodes (RNs) cells in the 5G mobile networks, we have sliced the Radio Access Networks (RAN), along with the assignment of the nearest Mobile Edge Computing (MEC) with isolated slices based on the priorities for each IoT nodes to reduce latency level. The proposed model was simulated and validated using the OPNET simulator. The results obtained demonstrate that SAM Model is able to achieve improvement of end to end delays and uplink throughputs of the networks in high-density networks of IoT devices.
Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing

Hao Zhou,Melike Erol-Kantarci,Vincent Poor

DOI: https://doi.org/10.48550/arXiv.2109.07999

2022-09-01

Abstract:Network slicing is a critical technique for 5G communications that covers radio access network (RAN), edge, transport and core <a class="link-external link-http" href="http://slicing.The" rel="external noopener nofollow">this http URL</a> evolving network architecture requires the orchestration of multiple network resources such as radio and cache resources. In recent years, machine learning (ML) techniques have been widely applied for network management. However, most existing works do not take advantage of the knowledge transfer capability in ML. In this paper, we propose a deep transfer reinforcement learning (DTRL) scheme for joint radio and cache resource allocation to serve 5G RAN slicing. We first define a hierarchical architecture for joint resource allocation. Then we propose two DTRL algorithms: Q-value-based deep transfer reinforcement learning (QDTRL) and action selection-based deep transfer reinforcement learning (ADTRL). In the proposed schemes, learner agents utilize expert agents' knowledge to improve their performance on current tasks. The proposed algorithms are compared with both the model-free exploration bonus deep Q-learning (EB-DQN) and the model-based priority proportional fairness and time-to-live (PPF-TTL) algorithms. Compared with EB-DQN, our proposed DTRL-based method presents 21.4% lower delay for Ultra Reliable Low Latency Communications (URLLC) slice and 22.4% higher throughput for enhanced Mobile Broad Band (eMBB) slice, while achieving significantly faster convergence than EB-DQN. Moreover, 40.8% lower URLLC delay and 59.8% higher eMBB throughput are observed with respect to PPF-TTL.

Systems and Control,Networking and Internet Architecture,Signal Processing
Research on User Access Selection Mechanism Based on Maximum Throughput for 5G Network Slicing.

Yangguang Lu,Xin Chen,Ranran Xi,Ying Chen

DOI: https://doi.org/10.1109/icccn52240.2021.9522146

2021-01-01

Abstract:With the development of Internet of Things (IoT) and network technologies, traditional networks cannot cope with the growth of network traffic and the changes in service requirements. The 5-th Generation Mobile Communication (5G) technology improves network transmission performance. In the communication network, 5G combines Software Defined Network (SDN) and Network Function Virtualization (NFV), through the deployment of end-to-end network slicing, to meet the challenge of differentiated service requirements in the complex environment. In the mobile network, users need to choose appropriate slices for access. Its performance is related to the quality of service and determines the efficiency of system resources utilization. We research the problem of slice re-access and slice resource scheduling caused by user mobility in 5G network slicing architecture and propose a slice access mechanism based on maximum throughput. A slice access selection algorithm based on genetic algorithm (GA) is proposed. Related simulations and comparative tests are carried out to prove the effectiveness and superiority of the algorithm.

A fast algorithm for nonsmooth penalized clustering

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Network Slicing for 5G with UE State Based Allocation and Blockchain Approach

An Adaptive Sharding-based Blockchain for Network Slicing in 5G

Trade-off Analysis Between Delay and Throughput of RAN Slicing for Smart Grid

Real-Time Resource Slicing for 5G RAN Via Deep Reinforcement Learning

Analysis of Network Slicing for Management of 5G Networks Using Machine Learning Techniques

Deep Reinforcement Learning for Network Slicing with Heterogeneous Resource Requirements and Time Varying Traffic Dynamics

Data-Driven Network Slicing From Core to RAN for 5G Broadcasting Services

Intelligent and Collaborative Orchestration of Network Slices

Slice Management Mechanism based on Dynamic Weights for Service Guarantees in Smart Grid

Reinforcement Learning for Dynamic Resource Optimization in 5G Radio Access Network Slicing

RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning

Toward an Efficient and Dynamic Allocation of Radio Access Network Slicing Resources for 5G Era

Generalizable Resource Scaling of 5G Slices using Constrained Reinforcement Learning

Network Slicing Based 5G and Future Mobile Networks: Mobility, Resource Management, and Challenges

Fast and Scalable Network Slicing by Integrating Deep Learning with Lagrangian Methods

Slice Allocation Management Model in 5G Networks for IoT Services with Reliable Low Latency

Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing

Research on User Access Selection Mechanism Based on Maximum Throughput for 5G Network Slicing.