Abstract:By virtue of being prevalently written in natural language (NL), requirements are prone to various defects, e.g., inconsistency and incompleteness. As such, requirements are frequently subject to quality assurance processes. These processes, when carried out entirely manually, are tedious and may further overlook important quality issues due to time and budget pressures. In this paper, we propose QAssist -- a question-answering (QA) approach that provides automated assistance to stakeholders, including requirements engineers, during the analysis of NL requirements. Posing a question and getting an instant answer is beneficial in various quality-assurance scenarios, e.g., incompleteness detection. Answering requirements-related questions automatically is challenging since the scope of the search for answers can go beyond the given requirements specification. To that end, QAssist provides support for mining external domain-knowledge resources. Our work is one of the first initiatives to bring together QA and external domain knowledge for addressing requirements engineering challenges. We evaluate QAssist on a dataset covering three application domains and containing a total of 387 question-answer pairs. We experiment with state-of-the-art QA methods, based primarily on recent large-scale language models. In our empirical study, QAssist localizes the answer to a question to three passages within the requirements specification and within the external domain-knowledge resource with an average recall of 90.1% and 96.5%, respectively. QAssist extracts the actual answer to the posed question with an average accuracy of 84.2%. Keywords: Natural-language Requirements, Question Answering (QA), Language Models, Natural Language Processing (NLP), Natural Language Generation (NLG), BERT, T5.

An assisted learning platform like social network based on automatic question answering

A Chinese Intelligent Question Answering System Based on Domain Ontology and Sentence Templates

Automatic Question-Answering Based on Wikipedia Data Extraction

Automatic Question Generation for Repeated Testing to Improve Student Learning Outcome

Using A User-Interactive Qa System For Personalized E-Learning

Design and Research of Artificial Intelligence in Multimedia Intelligent Question-Answering System and Self-Test System

Adaptive Artificial Intelligent Q&A Platform

AI-TA: Towards an Intelligent Question-Answer Teaching Assistant using Open-Source LLMs

Constructing a Hybrid Automatic Q&A System Integrating Knowledge Graph and Information Retrieval Technologies

Question Answering System Based on Community QA

Integrating Social Question-Answer sites in learning management system

Community-Based Question Answering Via Heterogeneous Social Network Learning

Design and Implementation of E-Learning-based Intelligent Answer-question System

Exploring the Interplay Between Question-Answering Systems and Communication with Instructors in Facilitating Learning.

An Intelligent Question Answering Platform for Graduate Enrollment

Research on English Online Test Platform Based on Real-Time Web Communication Technology

Design and Research of Intelligent Question-Answering(Q&A) System Based on High School Course Knowledge Graph

A Chinese Question Answering System For Specific Domain

AI-based Question Answering Assistance for Analyzing Natural-language Requirements

SOQAS: Distributively Finding High-Quality Answerers in Dynamic Social Networks.