Abstract:Open-domain question answering (QA) is an important problem in AI and NLP that is emerging as a bellwether for progress on the generalizability of AI methods and techniques. Much of the progress in open-domain QA systems has been realized through advances in information retrieval methods and corpus construction. In this paper, we focus on the recently introduced ARC Challenge dataset, which contains 2,590 multiple choice questions authored for grade-school science exams. These questions are selected to be the most challenging for current QA systems, and current state of the art performance is only slightly better than random chance. We present a system that rewrites a given question into queries that are used to retrieve supporting text from a large corpus of science-related text. Our rewriter is able to incorporate background knowledge from ConceptNet and -- in tandem with a generic textual entailment system trained on SciTail that identifies support in the retrieved results -- outperforms several strong baselines on the end-to-end QA task despite only being trained to identify essential terms in the original source question. We use a generalizable decision methodology over the retrieved evidence and answer candidates to select the best answer. By combining query rewriting, background knowledge, and textual entailment our system is able to outperform several strong baselines on the ARC dataset.

Is Sluice Resolution really just Question Answering?

Ellipsis Resolution as Question Answering: An Evaluation

What Do You Mean `Why?': Resolving Sluices in Conversations

Overcoming Language Priors In Vqa Via Decomposed Linguistic Representations

Question Answering As Programming for Solving Time-Sensitive Questions

Bridging Anaphora Resolution as Question Answering

Investigating Answerability of LLMs for Long-Form Question Answering

Which questions should I answer? Salience Prediction of Inquisitive Questions

Subjacency Versus Grammatical Extraction in Chinese Focused Cleft Wh-Questions: L1 Understanding and L2 Performance

Model Analysis & Evaluation for Ambiguous Question Answering

Co-VQA : Answering by Interactive Sub Question Sequence

Answering Science Exam Questions Using Query Rewriting with Background Knowledge

Elaborative Simplification as Implicit Questions Under Discussion

I've got the "Answer"! Interpretation of LLMs Hidden States in Question Answering

Interactive Language Learning by Question Answering

Can Question Rewriting Help Conversational Question Answering?

Getting Closer to AI Complete Question Answering: A Set of Prerequisite Real Tasks

How Do We Answer Complex Questions: Discourse Structure of Long-form Answers

DRS: Deep Question Reformulation With Structured Output

Question-Answering of UGC

Incremental structure building in the processing of ellipsis