Abstract:We propose a new setting for question answering in which users can query the system using both natural language and direct interactions within a graphical user interface that displays multiple time series associated with an entity of interest. The user interacts with the interface in order to understand the entity's state and behavior, entailing sequences of actions and questions whose answers may depend on previous factual or navigational interactions. We describe a pipeline implementation where spoken questions are first transcribed into text which is then semantically parsed into logical forms that can be used to automatically extract the answer from the underlying database. The speech recognition module is implemented by adapting a pre-trained LSTM-based architecture to the user's speech, whereas for the semantic parsing component we introduce an LSTM-based encoder-decoder architecture that models context dependency through copying mechanisms and multiple levels of attention over inputs and previous outputs. When evaluated separately, with and without data augmentation, both models are shown to substantially outperform several strong baselines. Furthermore, the full pipeline evaluation shows only a small degradation in semantic parsing accuracy, demonstrating that the semantic parser is robust to mistakes in the speech recognition output. The new question answering paradigm proposed in this paper has the potential to improve the presentation and navigation of the large amounts of sensor data and life events that are generated in many areas of medicine.

Semantic Parsing Using Hierarchical Concept Base.

Complex Question Decomposition for Semantic Parsing

Semantic Parsing Using Construction Categorization.

Deep Hierarchical Human Semantic Parsing

SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Bases.

Syntactic Parsing with Hierarchical Modeling

Hierarchical Human Semantic Parsing With Comprehensive Part-Relation Modeling

A Semantic Parsing Pipeline for Context-Dependent Question Answering over Temporally Structured Data

Pose-Guided Hierarchical Semantic Decomposition and Composition for Human Parsing

Hierarchical Human Parsing with Typed Part-Relation Reasoning

Semantic Parsing for Question Answering over Knowledge Graphs

Bridging the Gap Between Synthetic and Natural Questions Via Sentence Decomposition for Semantic Parsing

Neural Semantic Parsing with Extremely Rich Symbolic Meaning Representations

Query Understanding Enhanced by Hierarchical Parsing Structures

A Supervised Semantic Parsing with Lexicon Extension and Syntactic Constraint.

Knowledge Base Question Answering: A Semantic Parsing Perspective

Enhancing Unsupervised Semantic Parsing with Distributed Contextual Representations

A Survey on Semantic Parsing from the perspective of Compositionality

Semantic Parsing with Candidate Expressions for Knowledge Base Question Answering

A Hybrid Semantic Parsing Approach for Tabular Data Analysis

A Seq2seq-Based Approach to Question Answering over Knowledge Bases