Abstract:Software Engineering (SE) is the systematic design, development, and maintenance of software applications, underpinning the digital infrastructure of our modern mainworld. Very recently, the SE community has seen a rapidly increasing number of techniques employing Large Language Models (LLMs) to automate a broad range of SE tasks. Nevertheless, existing information of the applications, effects, and possible limitations of LLMs within SE is still not well-studied. In this paper, we provide a systematic survey to summarize the current state-of-the-art research in the LLM-based SE community. We summarize 30 representative LLMs of Source Code across three model architectures, 15 pre-training objectives across four categories, and 16 downstream tasks across five categories. We then present a detailed summarization of the recent SE studies for which LLMs are commonly utilized, including 155 studies for 43 specific code-related tasks across four crucial phases within the SE workflow. Besides, we summarize existing attempts to empirically evaluate LLMs in SE, such as benchmarks, empirical studies, and exploration of SE education. We also discuss several critical aspects of optimization and applications of LLMs in SE, such as security attacks, model tuning, and model compression. Finally, we highlight several challenges and potential opportunities on applying LLMs for future SE studies, such as exploring domain LLMs and constructing clean evaluation datasets. Overall, our work can help researchers gain a comprehensive understanding about the achievements of the existing LLM-based SE studies and promote the practical application of these techniques. Our artifacts are publicly available and will continuously updated at the living repository: \url{https://github.com/iSEngLab/AwesomeLLM4SE}.

Software Development in the Age of Intelligence: Embracing Large Language Models with the Right Approach

A systematic study in intelligent software engineering based on Large Language Model

Towards an Understanding of Large Language Models in Software Engineering Tasks

The Current Challenges of Software Engineering in the Era of Large Language Models

Software Service Engineering in the Era of Large Language Models

A Layered Architecture for Developing and Enhancing Capabilities in Large Language Model-based Software Systems

Large Language Models for Software Engineering: Survey and Open Problems

Large Language Models for Software Engineering: A Systematic Literature Review

Applying Large Language Models for Intelligent Industrial Automation

Software Testing with Large Language Models: Survey, Landscape, and Vision

A Systematic Survey on Large Language Models for Algorithm Design

Requirements are All You Need: From Requirements to Code with LLMs

Beyond the Comfort Zone: Emerging Solutions to Overcome Challenges in Integrating LLMs into Software Products

A Survey on Large Language Models for Software Engineering

Applications and Challenges for Large Language Models: from Data Management Perspective

From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future

Insights into the Development Trends of Industrial Large Language Models

Impact of Large Language Models on Generating Software Specifications

A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models

Large Language Model Empowered by Domain-Specific Knowledge Base for Industrial Equipment Operation and Maintenance