Abstract:We propose a new setting for question answering in which users can query the system using both natural language and direct interactions within a graphical user interface that displays multiple time series associated with an entity of interest. The user interacts with the interface in order to understand the entity's state and behavior, entailing sequences of actions and questions whose answers may depend on previous factual or navigational interactions. We describe a pipeline implementation where spoken questions are first transcribed into text which is then semantically parsed into logical forms that can be used to automatically extract the answer from the underlying database. The speech recognition module is implemented by adapting a pre-trained LSTM-based architecture to the user's speech, whereas for the semantic parsing component we introduce an LSTM-based encoder-decoder architecture that models context dependency through copying mechanisms and multiple levels of attention over inputs and previous outputs. When evaluated separately, with and without data augmentation, both models are shown to substantially outperform several strong baselines. Furthermore, the full pipeline evaluation shows only a small degradation in semantic parsing accuracy, demonstrating that the semantic parser is robust to mistakes in the speech recognition output. The new question answering paradigm proposed in this paper has the potential to improve the presentation and navigation of the large amounts of sensor data and life events that are generated in many areas of medicine.

Question Answering via Phrasal Semantic Parsing

Answering Natural Language Questions via Phrasal Semantic Parsing.

Knowledge Base Question Answering: A Semantic Parsing Perspective

A Semantic Parsing Pipeline for Context-Dependent Question Answering over Temporally Structured Data

SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Bases.

Semantic Parsing for Question Answering over Knowledge Graphs

Improving Complex Knowledge Base Question Answering Via Structural Information Learning

Question Answering over Knowledge Graphs via Structural Query Patterns

Coarse-to-Careful: Seeking Semantic-related Knowledge for Open-domain Commonsense Question Answering

Semantic Parsing with Candidate Expressions for Knowledge Base Question Answering

Unseen Entity Handling in Complex Question Answering over Knowledge Base Via Language Generation

Answering Natural Language Questions by Subgraph Matching over Knowledge Graphs

Deep question answering for single documents with lexical chains

Automatic Understanding of Natural Language Questions for Querying Chinese Knowledge Bases

Towards a Question Answering System over the Semantic Web

Hybrid Question Answering over Knowledge Base and Free Text.

Semantic Structure based Query Graph Prediction for Question Answering over Knowledge Graph

Structured Knowledge Grounding for Question Answering

Open Domain Question Answering Via Semantic Enrichment

What Is The Longest River In The Usa? Semantic Parsing For Aggregation Questions

Crake: Causal-Enhanced Table-Filler for Question Answering over Large Scale Knowledge Base.