Abstract:With the increasing sophistication and heterogeneity of network infrastructures, the need for Virtual Network Embedding (VNE) is becoming more critical than ever. VNE consists of mapping virtual networks on top of the physical infrastructure to optimize network resource use and improve overall network performance. Considered as one of the most important bricks of network slicing, it has been proven to be an NP-hard problem with no exact solution. Several heuristics and meta-heuristics were proposed to solve it. As heuristics do not provide satisfactory solutions, meta-heuristics allow a good exploration of the solutions' space, though they require testing several solutions, which is generally unfeasible in a real world environment. Other methods relying on deep reinforcement learning (DRL) and combined with heuristics yield better performance without revealing issues such as sticking at local minima or poor space exploration limits. Nevertheless, these algorithms present varied performances according to the employed approach and the problem to be treated, resulting in robustness problems. To overcome these limits, we propose a robust placement approach based on the Algorithm Selection paradigm. The main idea is to dynamically select the best algorithm from a set of learning strategies regarding reward and sample efficiency at each time step. The proposed strategy acts as a meta-algorithm that brings more robustness to the network since it dynamically selects the best solution for a specific scenario. We propose two selection algorithms. First, we consider an offline selection in which the placement strategies are updated outside the selection period. In the second algorithm, the different agents are updated simultaneously with the selection process, which we call an online selection. Both solutions proved their efficiency and managed to dynamically select the best algorithm regarding acceptance ratio of the deployed services. Besides, the proposed solutions succeed in commuting to the best placement strategy depending on the strategies' strengths while outperforming all standalone algorithms.

Software Agents Interaction Algorithms in Virtual Learning Environment

Effective Communication and Migration Algorithm for Mobile Agent on Virtual Organization

Performance Analysis of a Mobile Agent Prototype System Based on VIRGO P2P Protocols.

Simulating a Finite State Mobile Agent System

The design of distance learning system based on multi-agent

VirtualOffshore: an Interactive 3D Offshore Environment for Embodied Agents

Study on Agent-Based Technique for Distributed Virtual GIS

The Study of Robot Interaction Algorithms Using Intelligent Simulation Agents

Smart places: Multi-agent based smart mobile virtual community management system

Software Agent-Virtualized Application Mobility in Pervasive Environments

Learning Repository Adaptibility in an Agent-Based University Environment

Design and implementation of the multi-agent system in education

Agent-based Behavior Modeling in Virtual Environment

Verification & Validation of Agent Based Simulations using the VOMAS (Virtual Overlay Multi-agent System) approach

Multi-Agent Cooperative Reinforcement Learning in 3d Virtual World

Developing Multiagent E-Learning System-Based Machine Learning and Feature Selection Techniques

Learning to Communicate in Multi-Agent Reinforcement Learning : A Review

Algorithms of Integrated Student Modeling in Online Virtual Educational Community

A dynamic AI-based algorithm selection for Virtual Network Embedding

Provisional Access of Workflow Scheduling With Mobile Agents in Agricultural Application

Dynamic neighbourhood optimisation for task allocation using multi-agent