Abstract:By virtue of being prevalently written in natural language (NL), requirements are prone to various defects, e.g., inconsistency and incompleteness. As such, requirements are frequently subject to quality assurance processes. These processes, when carried out entirely manually, are tedious and may further overlook important quality issues due to time and budget pressures. In this paper, we propose QAssist -- a question-answering (QA) approach that provides automated assistance to stakeholders, including requirements engineers, during the analysis of NL requirements. Posing a question and getting an instant answer is beneficial in various quality-assurance scenarios, e.g., incompleteness detection. Answering requirements-related questions automatically is challenging since the scope of the search for answers can go beyond the given requirements specification. To that end, QAssist provides support for mining external domain-knowledge resources. Our work is one of the first initiatives to bring together QA and external domain knowledge for addressing requirements engineering challenges. We evaluate QAssist on a dataset covering three application domains and containing a total of 387 question-answer pairs. We experiment with state-of-the-art QA methods, based primarily on recent large-scale language models. In our empirical study, QAssist localizes the answer to a question to three passages within the requirements specification and within the external domain-knowledge resource with an average recall of 90.1% and 96.5%, respectively. QAssist extracts the actual answer to the posed question with an average accuracy of 84.2%. Keywords: Natural-language Requirements, Question Answering (QA), Language Models, Natural Language Processing (NLP), Natural Language Generation (NLG), BERT, T5.

Building Optimal Question Answering System Automatically Using Configuration Space Exploration (CSE) for QA4MRE 2013 Tasks.

Building optimal information systems automatically: configuration space exploration for biomedical information systems.

CFMatch: Aligning Automated Answer Equivalence Evaluation with Expert Judgments For Open-Domain Question Answering

A Robust Computerized Adaptive Testing Approach in Educational Question Retrieval

Learning to Answer Biomedical Factoid & List Questions: OAQA at BioASQ 3B

Intelligent Question Answering System Based on Machine Reading Comprehension

Question Answering for Complex Electronic Health Records Database using Unified Encoder-Decoder Architecture

An Automated Question-Answering Framework Based on Evolution Algorithm

A Semi-supervised learning approach to enhance health care Community-based Question Answering: A case study in alcoholism

Question Answering System Based on Community QA

AI-based Question Answering Assistance for Analyzing Natural-language Requirements

Enhanced Answer Selection in CQA Using Multi-Dimensional Features Combination

A Chinese Question Answering System in Medical Domain

Optimal Answerer Ranking for New Questions in Community Question Answering

Detect, Retrieve, Comprehend: A Flexible Framework for Zero-Shot Document-Level Question Answering

Answering Science Exam Questions Using Query Rewriting with Background Knowledge

ECNU: Using Multiple Sources of CQA-based Information for Answers Selection and YES/NO Response Inference.

A New Question Analysis Approach for Community Question Answering System.

A Health QA with Enhanced User Interfaces

A Maximum Entropy Model Based Confidence Scoring Algorithm for QA

CT2C-QA: Multimodal Question Answering over Chinese Text, Table and Chart