RECOVER: Toward the Automatic Requirements Generation from Stakeholders' Conversations

Gianmario Voria,Francesco Casillo,Carmine Gravino,Gemma Catolino,Fabio Palomba

2024-11-29

Abstract:Stakeholders' conversations in requirements elicitation meetings contain valuable information, but manually extracting system requirements from these discussions is a time-consuming and labor-intensive task, and there is a risk of errors and the introduction of biases. While current methods assist in summarizing conversations and classifying requirements based on their nature, there is a noticeable lack of approaches capable of both identifying requirements within these conversations and generating corresponding system requirements. These approaches would significantly reduce the burden on requirements engineers, reducing the time and effort required. They would also support the production of accurate and consistent requirements documentation. To address this gap, this paper introduces RECOVER (Requirements EliCitation frOm conVERsations), a novel requirements engineering approach that leverages NLP and foundation models to automatically extract system requirements from stakeholder interactions. The approach is evaluated using a mixed-method research design that combines statistical performance analysis with a user study involving requirements engineers. First, at the conversation turn level, the evaluation measures RECOVER's accuracy in identifying requirements-relevant dialogue and the quality of generated requirements in terms of correctness, completeness, and actionability. Second, at the entire conversation level, the evaluation assesses the overall usefulness and effectiveness of RECOVER in synthesizing comprehensive system requirements from full stakeholder discussions. The evaluation shows promising results regarding the performance of RECOVER, as the generated requirements exhibit satisfactory quality in their correctness, completeness, and actionability. Moreover, the results show the potential usefulness of automating the process of eliciting requirements from conversation.

Software Engineering

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: an automated method for automatically generating system requirements from stakeholder conversations. Specifically, although existing methods can help summarize stakeholder conversations and classify requirements, they lack the ability to simultaneously identify requirements in conversations and generate corresponding system requirements. This leads to the fact that requirement engineers still need to spend a great deal of time and energy on manual analysis during the requirement collection process, and there is a risk of introducing errors and biases.

To address this challenge, this paper proposes RECOVER (Requirements EliCitation frOm conVERsations), a new conversation - based requirements engineering method that uses natural language processing and fundamental models to automatically extract system requirements from stakeholder conversations. RECOVER achieves this goal by analyzing each conversation turn, thereby reducing the workload of requirement engineers and improving the accuracy and consistency of requirement documents.

### Main problem decomposition:
1. **Inefficiency of manual requirement extraction**:
- Manually extracting requirements from conversations is a time - consuming and labor - intensive task.
- Due to human factors, there may be errors and prejudices.

2. **Limitations of existing methods**:
- The current state - of - the - art methods can only help summarize conversations and classify requirements, but cannot simultaneously identify and generate requirements.
- There is a lack of a method that can comprehensively handle conversations and generate high - quality requirements.

3. **Accuracy and consistency of requirement documents**:
- Automated requirement extraction can reduce human errors, improve the quality and consistency of requirement documents, and provide a reliable basis for subsequent requirement analysis.

### Specific goals of RECOVER:
- **Automated requirement identification and generation**: Automatically extract and generate system requirements from conversations through natural language processing and large - language models (LLMs).
- **Improve efficiency and accuracy**: Reduce the time and energy input of requirement engineers and ensure that the generated requirement documents are accurate, complete and actionable.
- **Support multi - level evaluation**: Evaluate the performance of RECOVER at the single - conversation - turn and the entire - conversation levels through a mixed - research design to ensure its effectiveness and practicality.

In summary, this paper aims to solve the problem of automatically generating system requirements from stakeholder conversations by proposing the RECOVER method, thereby improving the efficiency and quality of requirements engineering.