Abstract:We propose a new setting for question answering in which users can query the system using both natural language and direct interactions within a graphical user interface that displays multiple time series associated with an entity of interest. The user interacts with the interface in order to understand the entity's state and behavior, entailing sequences of actions and questions whose answers may depend on previous factual or navigational interactions. We describe a pipeline implementation where spoken questions are first transcribed into text which is then semantically parsed into logical forms that can be used to automatically extract the answer from the underlying database. The speech recognition module is implemented by adapting a pre-trained LSTM-based architecture to the user's speech, whereas for the semantic parsing component we introduce an LSTM-based encoder-decoder architecture that models context dependency through copying mechanisms and multiple levels of attention over inputs and previous outputs. When evaluated separately, with and without data augmentation, both models are shown to substantially outperform several strong baselines. Furthermore, the full pipeline evaluation shows only a small degradation in semantic parsing accuracy, demonstrating that the semantic parser is robust to mistakes in the speech recognition output. The new question answering paradigm proposed in this paper has the potential to improve the presentation and navigation of the large amounts of sensor data and life events that are generated in many areas of medicine.

Answering Natural Language Questions via Phrasal Semantic Parsing.

Question Answering via Phrasal Semantic Parsing

Automatic Understanding of Natural Language Questions for Querying Chinese Knowledge Bases

Knowledge Base Question Answering: A Semantic Parsing Perspective

Answering Natural Language Questions by Subgraph Matching over Knowledge Graphs

SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Bases.

A Semantic Parsing Pipeline for Context-Dependent Question Answering over Temporally Structured Data

What Is The Longest River In The Usa? Semantic Parsing For Aggregation Questions

Understanding the Semantic Intent of Natural Language Query.

Question Answering over Knowledge Graphs via Structural Query Patterns

Natural Language Question Answering Over Rdf - A Graph Data Driven Approach

Bridging the Gap Between Synthetic and Natural Questions Via Sentence Decomposition for Semantic Parsing

Query Understanding Enhanced by Hierarchical Parsing Structures

Coarse-to-Careful: Seeking Semantic-related Knowledge for Open-domain Commonsense Question Answering

Semantic Parsing for Question Answering over Knowledge Graphs

Interactive Natural Language Question Answering over Knowledge Graphs

Deep question answering for single documents with lexical chains

Semantic Parsing with Candidate Expressions for Knowledge Base Question Answering

Semantic Structure based Query Graph Prediction for Question Answering over Knowledge Graph

Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQA

Open Domain Question Answering Via Semantic Enrichment