Abstract:Nowadays, we are witnessing an increasing adoption of Artificial Intelligence (AI) to develop techniques aimed at improving the reliability, effectiveness, and overall quality of software systems. Deep reinforcement learning (DRL) has recently been successfully used for automation in complex tasks such as game testing and solving the job-shop scheduling problem. However, these specialized DRL agents, trained from scratch on specific tasks, suffer from a lack of generalizability to other tasks and they need substantial time to be developed and re-trained effectively. Recently, DRL researchers have begun to develop generalist agents, able to learn a policy from various environments and capable of achieving performances similar to or better than specialist agents in new tasks. In the Natural Language Processing or Computer Vision domain, these generalist agents are showing promising adaptation capabilities to never-before-seen tasks after a light fine-tuning phase and achieving high performance. This paper investigates the potential of generalist agents for solving SE tasks. Specifically, we conduct an empirical study aimed at assessing the performance of two generalist agents on two important SE tasks: the detection of bugs in games (for two games) and the minimization of makespan in a scheduling task, to solve the job-shop scheduling problem (for two instances). Our results show that the generalist agents outperform the specialist agents with very little effort for fine-tuning, achieving a 20% reduction of the makespan over specialized agent performance on task-based scheduling. In the context of game testing, some generalist agent configurations detect 85% more bugs than the specialist agents. Building on our analysis, we provide recommendations for researchers and practitioners looking to select generalist agents for SE tasks, to ensure that they perform effectively.

REGENT: A Retrieval-Augmented Generalist Agent That Can Act In-Context in New Environments

Adapting to Non-Stationary Environments: Multi-Armed Bandit Enhanced Retrieval-Augmented Generation on Knowledge Graphs

Retrieval-Augmented Embodied Agents

Diffusion Augmented Agents: A Framework for Efficient Exploration and Transfer Learning

RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking

Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoning

Automatic Data Augmentation for Generalization in Deep Reinforcement Learning

Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents

Harnessing Pre-trained Generalist Agents for Software Engineering Tasks

Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulation

Off-Agent Trust Region Policy Optimization

Stronger Generalization Guarantees for Robot Learning by Combining Generative Models and Real-World Data

A Generalist Agent

Generalization Properties of Retrieval-based Models

Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generation

AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agents

A Versatile Agent for Fast Learning from Human Instructors

Learning Generative Interactive Environments By Trained Agent Exploration

ERAGent: Enhancing Retrieval-Augmented Language Models with Improved Accuracy, Efficiency, and Personalization

Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization

Automatic Data Augmentation for Generalization in Reinforcement Learning