Abstract:Despite the great success of word embedding, sentence embedding remains a not-well-solved problem. In this paper, we present a supervised learning framework to exploit sentence embedding for the medical question answering task. The learning framework consists of two main parts: 1) a sentence embedding producing module, and 2) a scoring module. The former is developed with contextual self-attention and multi-scale techniques to encode a sentence into an embedding tensor. This module is shortly called Contextual self-Attention Multi-scale Sentence Embedding (CAMSE). The latter employs two scoring strategies: Semantic Matching Scoring (SMS) and Semantic Association Scoring (SAS). SMS measures similarity while SAS captures association between sentence pairs: a medical question concatenated with a candidate choice, and a piece of corresponding supportive evidence. The proposed framework is examined by two Medical Question Answering(MedicalQA) datasets which are collected from real-world applications: medical exam and clinical diagnosis based on electronic medical records (EMR). The comparison results show that our proposed framework achieved significant improvements compared to competitive baseline approaches. Additionally, a series of controlled experiments are also conducted to illustrate that the multi-scale strategy and the contextual self-attention layer play important roles for producing effective sentence embedding, and the two kinds of scoring strategies are highly complementary to each other for question answering problems.

Semi-Supervised Few-Shot Learning for Dual Question-Answer Extraction

A Semantic-based Method for Unsupervised Commonsense Question Answering

Coarse-to-Careful: Seeking Semantic-related Knowledge for Open-domain Commonsense Question Answering

What the Role is Vs. What Plays the Role: Semi-Supervised Event Argument Extraction Via Dual Question Answering

Unsupervised Candidate Answer Extraction through Differentiable Masker-Reconstructor Model

Denoising Distantly Supervised Open-Domain Question Answering

Semi-supervised Question Classification with Jointly Learning Question and Answer Representations

Few-Shot Learning with Self-supervised Classifier for Complex Knowledge Base Question Answering.

Exploiting Sentence Embedding for Medical Question Answering

Reinforced Self-Supervised Training for Few-Shot Learning

Bi-directional Long Short-Term Memory Model with Semantic Positional Attention for the Question Answering System

QAID: Question Answering Inspired Few-shot Intent Detection

SEMQA: Semi-Extractive Multi-Source Question Answering

An Unsupervised Model with Attention Autoencoders for Question Retrieval

elBERto: Self-supervised commonsense learning for question answering

Dual Learning for Semi-Supervised Natural Language Understanding

Question-Guided Semantic Dual-Graph Visual Reasoning with Novel Answers.

Unsupervised Deep Learning based Multiple Choices Question Answering: Start Learning from Basic Knowledge

Multi-view Semantic Matching of Question retrieval using Fine-grained Semantic Representations

Unsupervised multiple choices question answering via universal corpus

Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answering