Abstract:Answer selection is a crucial subtask in the question answering (QA) system. Conventional avenues for this task mainly concentrate on developing linguistic tools that are limited in both performance and practicability. Answer selection approaches based on deep learning have been well investigated with the tremendous success of deep learning in natural language processing. However, the traditional neural networks employed in existing answer selection models, i.e., recursive neural network or convolutional neural network, typically suffer from obtaining the global text information due to their operating mechanisms. The recent Transformer neural network is considered to be good at extracting the global information by employing only self-attention mechanism. Thus, in this paper, we design a Transformer-based neural network for answer selection, where we deploy a bidirectional long short-term memory (BiLSTM) behind the Transformer to acquire both global information and sequential features in the question or answer sentence. Different from the original Transformer, our Transformer-based network focuses on sentence embedding rather than the seq2seq task. In addition, we employ a BiLSTM rather than utilizing the position encoding to incorporate sequential features as the universal Transformer does. Furthermore, we apply three aggregated strategies to generate sentence embeddings for question and answer, i.e., the weighted mean pooling, the max pooling, and the attentive pooling, leading to three corresponding Transformer-based models, i.e., QA-TF WP , QA-TF MP , and QA-TF AP , respectively. Finally, we evaluate our proposals on a popular QA dataset WikiQA. The experimental results demonstrate that our proposed Transformer-based answer selection models can produce a better performance compared with several competitive baselines. In detail, our best model outperforms the state-of-the-art baseline by up to 2.37%, 2.83%, and 3.79% in terms of MAP, MRR, and accuracy, respectively.

Multi-strategies Method for Cold-Start Stage Question Matching of rQA Task

A BERT-Based Semantic Matching Ranker for Open-Domain Question Answering

Chinese Sentence Semantic Matching Based on Multi-Level Relevance Extraction and Aggregation for Intelligent Human–robot Interaction

Multi-level Retrieval with Semantic Axiomatic Fuzzy Set Clustering for Question Answering

Concession-First Learning and Coarse-to-Fine Retrieval for Open-Domain Conversational Question Answering

L2R-QA: An Open-Domain Question Answering Framework

Applying Deep Learning to Answer Selection: A Study and an Open Task.

IARNN-Based Semantic-Containing Double-Level Embedding Bi-LSTM for Question-and-Answer Matching

A Two-Domain Coordinated Sentence Similarity Scheme for Question-Answering Robots Regarding Unpredictable Outliers and Non-Orthogonal Categories.

DSDR: Dynamic Semantic Discard Reader for Open-Domain Question Answering

SS-BERT: A Semantic Information Selecting Approach for Open-Domain Question Answering

R-3: Reinforced Ranker-Reader for Open-Domain Question Answering

A Local Self-Attention Sentence Model for Answer Selection Task in CQA Systems

A Hybrid Approach to DBQA

UnitedQA: A Hybrid Approach for Open Domain Question Answering

From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answering.

Open Domain Question Answering with Character-Level Deep Learning Models.

Deep Learning Approaches to Semantic Relevance Modeling for Chinese Question-Answer Pairs.

Simple yet Effective Bridge Reasoning for Open-Domain Multi-Hop Question Answering

Transformer-Based Neural Network for Answer Selection in Question Answering

Combine Multi-Features with Deep Learning for Answer Selection