Abstract:Answer selection is a crucial subtask in the question answering (QA) system. Conventional avenues for this task mainly concentrate on developing linguistic tools that are limited in both performance and practicability. Answer selection approaches based on deep learning have been well investigated with the tremendous success of deep learning in natural language processing. However, the traditional neural networks employed in existing answer selection models, i.e., recursive neural network or convolutional neural network, typically suffer from obtaining the global text information due to their operating mechanisms. The recent Transformer neural network is considered to be good at extracting the global information by employing only self-attention mechanism. Thus, in this paper, we design a Transformer-based neural network for answer selection, where we deploy a bidirectional long short-term memory (BiLSTM) behind the Transformer to acquire both global information and sequential features in the question or answer sentence. Different from the original Transformer, our Transformer-based network focuses on sentence embedding rather than the seq2seq task. In addition, we employ a BiLSTM rather than utilizing the position encoding to incorporate sequential features as the universal Transformer does. Furthermore, we apply three aggregated strategies to generate sentence embeddings for question and answer, i.e., the weighted mean pooling, the max pooling, and the attentive pooling, leading to three corresponding Transformer-based models, i.e., QA-TF WP , QA-TF MP , and QA-TF AP , respectively. Finally, we evaluate our proposals on a popular QA dataset WikiQA. The experimental results demonstrate that our proposed Transformer-based answer selection models can produce a better performance compared with several competitive baselines. In detail, our best model outperforms the state-of-the-art baseline by up to 2.37%, 2.83%, and 3.79% in terms of MAP, MRR, and accuracy, respectively.

A Convolutional Neural Network Model for Non-Factoid Chinese Answer Selection

An Enhanced Convolutional Neural Network Model for Answer Selection.

Recurrent Convolutional Neural Network for Answer Selection in Community Question Answering.

Answer Selection in Community Question Answering Via Attentive Neural Networks.

Predicting Best Answerers for New Questions: An Approach Leveraging Convolution Neural Networks in Community Question Answering.

Attentive Interactive Neural Networks for Answer Selection in Community Question Answering.

Question Condensing Networks for Answer Selection in Community Question Answering.

Convolutional Neural Networks for Expert Recommendation in Community Question Answering.

Attention-based Recurrent Convolutional Neural Network for Automatic Essay Scoring.

Multi-Scale Deformable CNN for Answer Selection.

Transformer-Based Neural Network for Answer Selection in Question Answering

Heterogeneous Community Question Answering via Social-Aware Multi-Modal Co-Attention Convolutional Matching

Collaborative Learning for Answer Selection in Question Answering

Static Correlative Filter Based Convolutional Neural Network for Visual Question Answering

Enhanced Answer Selection in CQA Using Multi-Dimensional Features Combination

Joint Learning of Answer Selection and Answer Summary Generation in Community Question Answering.

Incorporating Label Dependency for Answer Quality Tagging in Community Question Answering Via CNN-LSTM-CRF.

Bi-directional Capsule Network Model for Chinese Biomedical Community Question Answering

Abircnn With Neural Tensor Network For Answer Selection

Using Convolution Control Block for Chinese Sentiment Analysis

YNUDLG at IJCNLP-2017 Task 5: A CNN-LSTM Model with Attention for Multi-choice Question Answering in Examinations.