Abstract:Test smells arise from poor design practices and insufficient domain knowledge, which can lower the quality of test code and make it harder to maintain and update. Manually refactoring test smells is time-consuming and error-prone, highlighting the necessity for automated approaches. Current rule-based refactoring methods often struggle in scenarios not covered by predefined rules and lack the flexibility needed to handle diverse cases effectively. In this paper, we propose a novel approach called UTRefactor, a context-enhanced, LLM-based framework for automatic test refactoring in Java projects. UTRefactor extracts relevant context from test code and leverages an external knowledge base that includes test smell definitions, descriptions, and DSL-based refactoring rules. By simulating the manual refactoring process through a chain-of-thought approach, UTRefactor guides the LLM to eliminate test smells in a step-by-step process, ensuring both accuracy and consistency throughout the refactoring. Additionally, we implement a checkpoint mechanism to facilitate comprehensive refactoring, particularly when multiple smells are present. We evaluate UTRefactor on 879 tests from six open-source Java projects, reducing the number of test smells from 2,375 to 265, achieving an 89% reduction. UTRefactor outperforms direct LLM-based refactoring methods by 61.82% in smell elimination and significantly surpasses the performance of a rule-based test smell refactoring tool. Our results demonstrate the effectiveness of UTRefactor in enhancing test code quality while minimizing manual involvement.

Automated Refactoring of Nested-if Formulae in Spreadsheets

On the Refinement of Spreadsheet Smells by means of Structure Information

A Spreadsheet Auditing Tool Evaluated in an Industrial Context

Combining Spreadsheet Smells for Improved Fault Prediction

Detecting table clones and smells in spreadsheets.

Custodes: Automatic Spreadsheet Cell Clustering and Smell Detection Using Strong and Weak Features

Improving Feedback from Automated Reviews of Student Spreadsheets

NL2Formula: Generating Spreadsheet Formulas from Natural Language Queries

WARDER: Towards Effective Spreadsheet Defect Detection by Validity-Based Cell Cluster Refinements

SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation

Excel Spreadsheet Analyzer

CACheck: Detecting and Repairing Cell Arrays in Spreadsheets

To Abstract or Not to Abstract? A Comparative Study Evaluating the User Experience of Spreadsheet Programming with Sheet-Defined Functional Abstractions

Now You're Thinking With Structures: A Concept for Structure-based Interactions with Spreadsheets

Context-Enhanced LLM-Based Framework for Automatic Test Refactoring

FLAME: A small language model for spreadsheet formulas

Spreadsheet quality assurance: a literature review

Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representations

Requirements for Automated Assessment of Spreadsheet Maintainability

WARDER: Refining Cell Clustering for Effective Spreadsheet Defect Detection via Validity Properties

AUTOMATIC SOFTWARE REFACTORING TOWARDS THE OPTIMIZATION OF DESIGN HIERARCHY