Abstract:Automatic Program Repair (APR) endeavors to autonomously rectify issues within specific projects, which generally encompasses three categories of tasks: bug resolution, new feature development, and feature enhancement. Despite extensive research proposing various methodologies, their efficacy in addressing real issues remains unsatisfactory. It's worth noting that, typically, engineers have design rationales (DR) on solution-planed solutions and a set of underlying reasons-before they start patching code. In open-source projects, these DRs are frequently captured in issue logs through project management tools like Jira. This raises a compelling question: How can we leverage DR scattered across the issue logs to efficiently enhance APR? To investigate this premise, we introduce DRCodePilot, an approach designed to augment GPT-4-Turbo's APR capabilities by incorporating DR into the prompt instruction. Furthermore, given GPT-4's constraints in fully grasping the broader project context and occasional shortcomings in generating precise identifiers, we have devised a feedback-based self-reflective framework, in which we prompt GPT-4 to reconsider and refine its outputs by referencing a provided patch and suggested identifiers. We have established a benchmark comprising 938 issue-patch pairs sourced from two open-source repositories hosted on GitHub and Jira. Our experimental results are impressive: DRCodePilot achieves a full-match ratio that is a remarkable 4.7x higher than when GPT-4 is utilized directly. Additionally, the CodeBLEU scores also exhibit promising enhancements. Moreover, our findings reveal that the standalone application of DR can yield promising increase in the full-match ratio across CodeLlama, GPT-3.5, and GPT-4 within our benchmark suite. We believe that our DRCodePilot initiative heralds a novel human-in-the-loop avenue for advancing the field of APR.

CodeR: Issue Resolving with Multi-Agent and Task Graphs

Dual Analysis for Recommending Developers to Resolve Bugs

Recommending Code Reviewers for Proprietary Software Projects: A Large Scale Study

Code Reviewer Recommendation in Tencent

AutoCodeRover: Autonomous Program Improvement

RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graph

SWE-bench-java: A GitHub Issue Resolving Benchmark for Java

MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolution

Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue Complexity in Real-World GitHub Scenarios

CodeS: Natural Language to Code Repository via Multi-Layer Sketch

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Code Reviewer Recommendation in Tencent: Practice, Challenge, and Direction*

SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents

MarsCode Agent: AI-native Automated Bug Fixing

Enhancing Automated Program Repair with Solution Design

SpecRover: Code Intent Extraction via LLMs

LLMs as Continuous Learners: Improving the Reproduction of Defective Code in Software Issues

An Empirical Study on LLM-based Agents for Automated Bug Fixing

A Unified Debugging Approach via LLM-Based Multi-Agent Synergy

CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges

CodeRepoQA: A Large-scale Benchmark for Software Engineering Question Answering