Abstract:Large Language Models (LLMs) have become widely adopted recently. Research explores their use both as autonomous agents and as tools for software engineering. LLM-integrated applications, on the other hand, are software systems that leverage an LLM to perform tasks that would otherwise be impossible or require significant coding effort. While LLM-integrated application engineering is emerging as new discipline, its terminology, concepts and methods need to be established. This study provides a taxonomy for LLM-integrated applications, offering a framework for analyzing and describing these systems. It also demonstrates various ways to utilize LLMs in applications, as well as options for implementing such integrations. Following established methods, we analyze a sample of recent LLM-integrated applications to identify relevant dimensions. We evaluate the taxonomy by applying it to additional cases. This review shows that applications integrate LLMs in numerous ways for various purposes. Frequently, they comprise multiple LLM integrations, which we term ``LLM components''. To gain a clear understanding of an application's architecture, we examine each LLM component separately. We identify thirteen dimensions along which to characterize an LLM component, including the LLM skills leveraged, the format of the output, and more. LLM-integrated applications are described as combinations of their LLM components. We suggest a concise representation using feature vectors for visualization. The taxonomy is effective for describing LLM-integrated applications. It can contribute to theory building in the nascent field of LLM-integrated application engineering and aid in developing such systems. Researchers and practitioners explore numerous creative ways to leverage LLMs in applications. Though challenges persist, integrating LLMs may revolutionize the way software systems are built.

Lightweight Multilingual Software Analysis

Towards Lakosian Multilingual Software Design Principles

MLSmellHound: A Context-Aware Code Analysis Tool

Challenges of Multilingual Program Specification and Analysis

S3LLM: Large-Scale Scientific Software Understanding with LLMs using Source, Metadata, and Document

Program Decomposition and Translation with Static Analysis

The Emergence of Large Language Models in Static Analysis: A First Look through Micro-Benchmarks

Large Language Models for Code Analysis: Do LLMs Really Do Their Job?

LMs: Understanding Code Syntax and Semantics for Code Analysis

Experimenting a New Programming Practice with LLMs

Together We Go Further: LLMs and IDE Static Analysis for Extract Method Refactoring

A Layered Architecture for Developing and Enhancing Capabilities in Large Language Model-based Software Systems

Multi-Programming Language Sandbox for LLMs

Requirements are All You Need: From Requirements to Code with LLMs

Large Language Models for Software Engineering: Survey and Open Problems

The Hitchhiker's Guide to Program Analysis: A Journey with Large Language Models

Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applications

MTLLM: LLMs are Meaning-Typed Code Constructs

Multilingual Code Co-Evolution Using Large Language Models

Semantic-Enhanced Indirect Call Analysis with Large Language Models

Multilingual Crowd-Based Requirements Engineering Using Large Language Models