Abstract:We propose a new setting for question answering in which users can query the system using both natural language and direct interactions within a graphical user interface that displays multiple time series associated with an entity of interest. The user interacts with the interface in order to understand the entity's state and behavior, entailing sequences of actions and questions whose answers may depend on previous factual or navigational interactions. We describe a pipeline implementation where spoken questions are first transcribed into text which is then semantically parsed into logical forms that can be used to automatically extract the answer from the underlying database. The speech recognition module is implemented by adapting a pre-trained LSTM-based architecture to the user's speech, whereas for the semantic parsing component we introduce an LSTM-based encoder-decoder architecture that models context dependency through copying mechanisms and multiple levels of attention over inputs and previous outputs. When evaluated separately, with and without data augmentation, both models are shown to substantially outperform several strong baselines. Furthermore, the full pipeline evaluation shows only a small degradation in semantic parsing accuracy, demonstrating that the semantic parser is robust to mistakes in the speech recognition output. The new question answering paradigm proposed in this paper has the potential to improve the presentation and navigation of the large amounts of sensor data and life events that are generated in many areas of medicine.

What Is The Longest River In The Usa? Semantic Parsing For Aggregation Questions

Answering Natural Language Questions via Phrasal Semantic Parsing.

Question Answering via Phrasal Semantic Parsing

Knowledge Base Question Answering: A Semantic Parsing Perspective

SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Bases.

Bridging the Gap Between Synthetic and Natural Questions Via Sentence Decomposition for Semantic Parsing

Semantic Parsing for Question Answering over Knowledge Graphs

Program Transfer and Ontology Awareness for Semantic Parsing in KBQA

A Semantic Parsing Pipeline for Context-Dependent Question Answering over Temporally Structured Data

Semantic Parsing with Candidate Expressions for Knowledge Base Question Answering

A Hybrid Semantic Parsing Approach for Tabular Data Analysis

Semantic Dependency Graph Parsing of Financial Domain Questions Based on Deep Learning

SPAGHETTI: Open-Domain Question Answering from Heterogeneous Data Sources with Retrieval and Semantic Parsing

Crake: Causal-Enhanced Table-Filler for Question Answering over Large Scale Knowledge Base.

BeamAggR: Beam Aggregation Reasoning over Multi-source Knowledge for Multi-hop Question Answering

Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models

Knowledge-Aware Conversational Semantic Parsing Over Web Tables

Deep question answering for single documents with lexical chains

Open Domain Question Answering Via Semantic Enrichment

Retrieval-Augmented Chain-of-Thought in Semi-structured Domains

Answering Natural Language Questions by Subgraph Matching over Knowledge Graphs