LLM-based policy generation for intent-based management of applications

Kristina Dzeparoska,Jieyu Lin,Ali Tizghadam,Alberto Leon-Garcia

DOI: https://doi.org/10.23919/CNSM59352.2023.10327837

2024-01-22

Abstract:Automated management requires decomposing high-level user requests, such as intents, to an abstraction that the system can understand and execute. This is challenging because even a simple intent requires performing a number of ordered steps. And the task of identifying and adapting these steps (as conditions change) requires a decomposition approach that cannot be exactly pre-defined beforehand. To tackle these challenges and support automated intent decomposition and execution, we explore the few-shot capability of Large Language Models (LLMs). We propose a pipeline that progressively decomposes intents by generating the required actions using a policy-based abstraction. This allows us to automate the policy execution by creating a closed control loop for the intent deployment. To do so, we generate and map the policies to APIs and form application management loops that perform the necessary monitoring, analysis, planning and execution. We evaluate our proposal with a use-case to fulfill and assure an application service chain of virtual network functions. Using our approach, we can generalize and generate the necessary steps to realize intents, thereby enabling intent automation for application management.

Distributed, Parallel, and Cluster Computing,Artificial Intelligence,Formal Languages and Automata Theory,Human-Computer Interaction,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to decompose users' high - level requests (i.e., intents) into specific operation sequences that the system can understand and execute in automated management. Specifically, the author proposes a method based on large - language models (LLMs) to achieve this goal through few - shot learning. This method can automatically generate the strategies required to realize users' intents and map them to APIs, thus forming an application management loop and completing the necessary monitoring, analysis, planning and execution steps. In addition, the paper also explores how to use these strategies to ensure the continuous satisfaction of intents throughout their life cycle, i.e., intent assurance. The main contributions of the paper include: - Proposing to use large - language models with few - shot learning capabilities to gradually decompose user intents and generate corresponding strategies to support intent - based application management. - Evaluating the proposed system on a cloud - testing platform, demonstrating its effectiveness in realizing and assuring intents. - Discussing the application opportunities of general large - language models in intent - based management.

LLM-based policy generation for intent-based management of applications

Code as Policies: Language Model Programs for Embodied Control

Intent Assurance using LLMs guided by Intent Drift

LLM+Reasoning+Planning for supporting incomplete user queries in presence of APIs

Natural Language as Policies: Reasoning for Coordinate-Level Embodied Control with LLMs

Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents

From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems

Exploring Critical Testing Scenarios for Decision-Making Policies: An LLM Approach

Practical Considerations for Agentic LLM Systems

Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Search

On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS)

LLM-based Frameworks for Power Engineering from Routine to Novel Tasks

AI Policy Projector: Grounding LLM Policy Design in Iterative Mapmaking

Large Language Models: A New Approach for Privacy Policy Analysis at Scale

Automatic Behavior Tree Expansion with LLMs for Robotic Manipulation

LLM-for-X: Application-agnostic Integration of Large Language Models to Support Personal Writing Workflows

Privacy Policy Analysis through Prompt Engineering for LLMs

MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents

Towards Natural Language-Driven Assembly Using Foundation Models

Large Language Models as Commonsense Knowledge for Large-Scale Task Planning