Abstract:Network virtualization is a highly effective technology for resource sharing within data centers, enabling the coexistence of multiple heterogeneous virtual networks in a shared substrate network, thus achieving resource multiplexing. The efficient embedding of a virtual network onto a substrate network, known as the virtual network embedding (VNE) problem, has been proven to be NP-hard. In response to this challenge, this paper introduces a novel method, named PPO-VNE, which leverages deep reinforcement learning for virtual network embedding. PPO-VNE employs the Proximal Policy Optimization (PPO) algorithm to generate policies and efficiently coordinate node and link mapping. Furthermore, it adopts a hybrid feature extraction approach that combines handcrafted features with features extracted using graph convolutional networks. The proposed reward function takes multiple objectives into account, guiding the learning process. We implemented a prototype of PPO-VNE and conducted experiments based on the simulation environment, in which the substrate network has 100 nodes, with a probability of 0.1 generating edges between any two node, and eventually there will be about 500 physical links. We evaluate the performance of our PPO-VNE approach from the perspective of overall acceptance rate, overall revenue, revenue-to-cost ratio, maximum energy consumption per unit time and revenue-energy consumption coefficient. Comprehensive simulation results in different scenarios show that our PPO-VNE approach achieves the superior performance on most metrics compared with the existing state-of-the-art approaches, where the overall acceptance rate, overall revenue, revenue-energy consumption coefficient are increased by up to 6.4%, 21.3% and 41.4%, respectively, and the maximum energy consumption per unit time are reduced by up to 22.1%.

Virtual Network Embedding Using Node Multiple Metrics Based on Simplified ELECTRE Method

A virtual network mapping algorithm based on time

An Efficient Virtual Network Embedding Algorithm with Delay Constraints

Modeling and solving for virtual network embedding problem with synchronous node and link mapping

Embedding Algorithm for Virtualizing Content-Centric Networks in a Shared Substrate

Incorporating Energy and Load Balance into Virtual Network Embedding Process

Virtual Network Mapping Algorithm With Node Repeatable Embedding and Link Splitting

Virtual network embedding through topology-aware node ranking

Topology-aware virtual network embedding through the degree

Virtual Network Embedding Based on Node’ s Multiple Attributes Ranking

Node-Fusion: Topology-aware Virtual Network Embedding Algorithm for Repeatable Virtual Network Mapping over Substrate Nodes

Virtual Network Embedding Based on the Degree and Clustering Coefficient Information.

Toward profit-seeking virtual network embedding algorithm via global resource capacity

A load balancing algorithm for solving multi‐objective virtual network embedding

Virtual network embedding algorithm based on improved sub-graph isomorphism search

Multi-Objective Virtual Network Embedding Algorithm Based On Global Resource Capacity

Towards Learning-Based Energy-Efficient Online Coordinated Virtual Network Embedding Framework

Topology Based Reliable Virtual Network Embedding from a QoE Perspective

A Virtual Network Embedding Algorithm Based On Graph Theory

Revenue-driven virtual network embedding based on global resource information.

Nodes Clustering and Dynamic Service Balance Awareness Based Virtual Network Embedding