Abstract:Machine reading comprehension not only involves reading unstructured text but also understanding it. Compared to questions of a simpler kind, this job calls for more sophisticated reading comprehension, such as logical reasoning, summarizing, and computation. They demand the intelligent system's ability to understand human language, making it an essential tool for testing its capabilities. We used unstructured corpora such as ARC corpora and Aristo mini corpora as contexts to answer multiple choice questions, which are indexed using ElasticSearch API. To answer multiple choice questions, we assigned questions from subjects such as Chemistry, and Biology; The goal is to target science-related questions instead of general questions, as they are clearly more difficult to answer. We have developed an automated multiple choice question answering template that is deployed on localhost using the Flask framework; the model accepts a question followed by a series of answer choices, and there is a PDF file upload function where the user can also upload a PDF file containing a question or a set of questions followed by a pair of candidate answers options. Searching the corpus for the appropriate context for each question is an important part of answering the question, using discriminators such as the answer discriminator and the document discriminator, because it was found that the TF-IDF score alone does not always provide the result. The best possible documents to answer the question in hand. UnifiedQA was used for modeling and a model without discriminators was also made to compare the results, and it was found that with discriminators, better performance was achieved at the expense of computational speed. A current increase of up to 7% was observed, which is huge, so better context has been shown to improve model performance and accuracy.

Automated Multi-Choice Question Answering System using Natural Language Processing

Leveraging Large Language Models for Multiple Choice Question Answering

Long-Span Question-Answering: Automatic Question Generation and QA-System Ranking via Side-by-Side Evaluation

Multiple-Choice Question Generation: Towards an Automated Assessment Framework

Multi-Matching Network for Multiple Choice Reading Comprehension

Detect, Retrieve, Comprehend: A Flexible Framework for Zero-Shot Document-Level Question Answering

Answering Science Exam Questions Using Query Rewriting with Background Knowledge

Long-Form Open-Domain Question-Answering System Architecture

Building Optimal Question Answering System Automatically Using Configuration Space Exploration (CSE) for QA4MRE 2013 Tasks.

Intelligent Question Answering System Based on Machine Reading Comprehension

Learning to Answer Multilingual and Code-Mixed Questions

Medical Exam Question Answering with Large-scale Reading Comprehension

How Many Answers Should I Give? an Empirical Study of Multi-Answer Reading Comprehension.

A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension.

Automated Question and Answer Generation from Texts using Text-to-Text Transformers

A Neural Question Answering Model Based on Semi-Structured Tables

ADMUS: A Progressive Question Answering Framework Adaptable to Multiple Knowledge Sources

Declarative Question Answering over Knowledge Bases Containing Natural Language Text with Answer Set Programming

Evaluation of Question Answering Systems: Complexity of judging a natural language

Question-Answering of UGC

Question Classification Using Multiple Classifiers.