Abstract:Context: Large Language Models (LLMs) and Generative Pre-trained Transformers (GPTs) have transformed the field of Software Engineering (SE). Existing LLM-based multi-agent models have successfully addressed basic dialogue tasks. However, the potential of LLMs for more challenging tasks, such as automated code generation for large and complex projects, has been investigated in only a few existing works. Objective: This paper aims to investigate the potential of LLM-based agents in the software industry, particularly in enhancing productivity and reducing time-to-market for complex software solutions. Our primary objective is to gain insights into how these agents can fundamentally transform the development of large-scale software. Methods: We introduce CodePori, a novel system designed to automate code generation for large and complex software projects based on functional and non-functional requirements defined by stakeholders. To assess the proposed system performance, we utilized the HumanEval benchmark and manually tested the CodePori model, providing 20 different project descriptions as input and then evaluated the code accuracy by manually executing the code. Results: CodePori is able to generate running code for large-scale projects, aligned with the typical software development process. The HumanEval benchmark results indicate that CodePori improves code accuracy by 89%. A manual assessment conducted by the first author shows that the CodePori system achieved an accuracy rate of 85%. Conclusion: Based on the results, our conclusion is that proposed system demonstrates the transformative potential of LLM-based agents in SE, highlighting their practical applications and opening new opportunities for broader adoption in both industry and academia. Our project is publicly available at <a class="link-external link-https" href="https://github.com/GPT-Laboratory/CodePori" rel="external noopener nofollow">this https URL</a>.

MapCoder: Multi-Agent Code Generation for Competitive Problem Solving

AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation

A Pair Programming Framework for Code Generation Via Multi-Plan Exploration and Feedback-Driven Refinement

CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis

CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges

VisionCoder: Empowering Multi-Agent Auto-Programming for Image Processing with Hybrid LLMs

ProgAI: Enhancing Code Generation with LLMs For Real World Challenges

AceCoder : An Effective Prompting Technique Specialized in Code Generation

CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules

RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis

UniCoder: Scaling Code Large Language Model via Universal Code

CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology

Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation

CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning

Multi-Programming Language Ensemble for Code Generation in Large Language Model

AutoSafeCoder: A Multi-Agent Framework for Securing LLM Code Generation through Static Analysis and Fuzz Testing

Multi-modal program inference: a marriage of pre-trained language models and component-based synthesis

SynCode: LLM Generation with Grammar Augmentation

Demo2Code: From Summarizing Demonstrations to Synthesizing Code via Extended Chain-of-Thought

Compilation-based Solvers for Multi-Agent Path Finding: a Survey, Discussion, and Future Opportunities