Abstract:Network virtualization is a highly effective technology for resource sharing within data centers, enabling the coexistence of multiple heterogeneous virtual networks in a shared substrate network, thus achieving resource multiplexing. The efficient embedding of a virtual network onto a substrate network, known as the virtual network embedding (VNE) problem, has been proven to be NP-hard. In response to this challenge, this paper introduces a novel method, named PPO-VNE, which leverages deep reinforcement learning for virtual network embedding. PPO-VNE employs the Proximal Policy Optimization (PPO) algorithm to generate policies and efficiently coordinate node and link mapping. Furthermore, it adopts a hybrid feature extraction approach that combines handcrafted features with features extracted using graph convolutional networks. The proposed reward function takes multiple objectives into account, guiding the learning process. We implemented a prototype of PPO-VNE and conducted experiments based on the simulation environment, in which the substrate network has 100 nodes, with a probability of 0.1 generating edges between any two node, and eventually there will be about 500 physical links. We evaluate the performance of our PPO-VNE approach from the perspective of overall acceptance rate, overall revenue, revenue-to-cost ratio, maximum energy consumption per unit time and revenue-energy consumption coefficient. Comprehensive simulation results in different scenarios show that our PPO-VNE approach achieves the superior performance on most metrics compared with the existing state-of-the-art approaches, where the overall acceptance rate, overall revenue, revenue-energy consumption coefficient are increased by up to 6.4%, 21.3% and 41.4%, respectively, and the maximum energy consumption per unit time are reduced by up to 22.1%.

An Enhanced Node Repeatable Virtual Network Embedding Algorithm Based PSO Solution.

Repeatable optimization algorithm based discrete PSO for virtual network embedding

An Efficient Virtual Network Embedding Algorithm with Delay Constraints

A virtual network mapping algorithm based on time

A Unified Enhanced Particle Swarm Optimization-Based Virtual Network Embedding Algorithm.

A Constructive Particle Swarm Optimizer for Virtual Network Embedding.

Virtual Network Embedding Based on Particle Swarm Optimization

A Virtual Network Embedding Algorithm Based On Hybrid Particle Swarm Optimization

VNE-HPSO: Virtual Network Embedding Algorithm Based on Hybrid Particle Swarm Optimization

A Novel Method for Virtual Network Embedding with Incentive Convergence Mechanism

One-stage and Dual-heuristic Particle Swarm Optimization for Virtual Network Embedding.

A DPSO-Based Load Balancing Virtual Network Embedding Algorithm with Particle Initialization Strategy.

Fair virtual network embedding algorithm with repeatable pre-configuration mechanism

Virtual Network Embedding with Virtual Topology Pre-Pruning

Multi-Objective Virtual Network Embedding Algorithm Based On Global Resource Capacity

A Fair Virtual Network Embedding Algorithm

Virtual Network Embedding Through Node Connectivity

Fair Virtual Network Embedding Algorithm with Topology Pre-Configuration

A Coordinated Two-Stages Virtual Network Embedding Algorithm Based on Reinforcement Learning

Towards Learning-Based Energy-Efficient Online Coordinated Virtual Network Embedding Framework

An Ant Colony System Based Virtual Network Embedding Algorithm.