Abstract:The task of Question Answering (QA) has attracted significant research interest for long. Its relevance to language understanding and knowledge retrieval tasks, along with the simple setting makes the task of QA crucial for strong AI systems. Recent success on simple QA tasks has shifted the focus to more complex settings. Among these, Multi-Hop QA (MHQA) is one of the most researched tasks over the recent years. In broad terms, MHQA is the task of answering natural language questions that involve extracting and combining multiple pieces of information and doing multiple steps of reasoning. An example of a multi-hop question would be "The Argentine PGA Championship record holder has won how many tournaments worldwide?". Answering the question would need two pieces of information: "Who is the record holder for Argentine PGA Championship tournaments?" and "How many tournaments did [Answer of Sub Q1] win?". The ability to answer multi-hop questions and perform multi step reasoning can significantly improve the utility of NLP systems. Consequently, the field has seen a surge with high quality datasets, models and evaluation strategies. The notion of 'multiple hops' is somewhat abstract which results in a large variety of tasks that require multi-hop reasoning. This leads to different datasets and models that differ significantly from each other and makes the field challenging to generalize and survey. We aim to provide a general and formal definition of the MHQA task, and organize and summarize existing MHQA frameworks. We also outline some best practices for building MHQA datasets. This book provides a systematic and thorough introduction as well as the structuring of the existing attempts to this highly interesting, yet quite challenging task.

Getting Closer to AI Complete Question Answering: A Set of Prerequisite Real Tasks

Towards ai-complete question answering: A set of prerequisite toy tasks

Interactive Language Learning by Question Answering

QuAC: Question answering in context

Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Answering Science Exam Questions Using Query Rewriting with Background Knowledge

Do great minds think alike? Investigating Human-AI Complementarity in Question Answering with CAIMIRA

Reasoning-Driven Question-Answering for Natural Language Understanding

SCAI-QReCC Shared Task on Conversational Question Answering

ConditionalQA: A Complex Reading Comprehension Dataset with Conditional Answers

QuALITY: Question Answering with Long Input Texts, Yes!

Applying Deep Learning to Answer Selection: A Study and an Open Task.

A Question-Entailment Approach to Question Answering

Careful Selection of Knowledge to solve Open Book Question Answering

BDIQA: A New Dataset for Video Question Answering to Explore Cognitive Reasoning through Theory of Mind

CIKQA: Learning Commonsense Inference with a Unified Knowledge-in-the-loop QA Paradigm

Multi-hop Question Answering

CRT-QA: A Dataset of Complex Reasoning Question Answering over Tabular Data

A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge

CLEAR: A Dataset for Compositional Language and Elementary Acoustic Reasoning

AmazonQA: A Review-Based Question Answering Task