Abstract:Answer selection is a crucial subtask in the question answering (QA) system. Conventional avenues for this task mainly concentrate on developing linguistic tools that are limited in both performance and practicability. Answer selection approaches based on deep learning have been well investigated with the tremendous success of deep learning in natural language processing. However, the traditional neural networks employed in existing answer selection models, i.e., recursive neural network or convolutional neural network, typically suffer from obtaining the global text information due to their operating mechanisms. The recent Transformer neural network is considered to be good at extracting the global information by employing only self-attention mechanism. Thus, in this paper, we design a Transformer-based neural network for answer selection, where we deploy a bidirectional long short-term memory (BiLSTM) behind the Transformer to acquire both global information and sequential features in the question or answer sentence. Different from the original Transformer, our Transformer-based network focuses on sentence embedding rather than the seq2seq task. In addition, we employ a BiLSTM rather than utilizing the position encoding to incorporate sequential features as the universal Transformer does. Furthermore, we apply three aggregated strategies to generate sentence embeddings for question and answer, i.e., the weighted mean pooling, the max pooling, and the attentive pooling, leading to three corresponding Transformer-based models, i.e., QA-TF WP , QA-TF MP , and QA-TF AP , respectively. Finally, we evaluate our proposals on a popular QA dataset WikiQA. The experimental results demonstrate that our proposed Transformer-based answer selection models can produce a better performance compared with several competitive baselines. In detail, our best model outperforms the state-of-the-art baseline by up to 2.37%, 2.83%, and 3.79% in terms of MAP, MRR, and accuracy, respectively.

Multi-granular Interactive Inference Based Answer Selection

Multi-granularity Interaction Fusion for Neural Answer Source Selection

BertHANK: Hierarchical Attention Networks with Enhanced Knowledge and Pre-Trained Model for Answer Selection

Multi-Granularity Interaction and Integration Network for Video Question Answering

MGRE: A Multi-Granularity Representation Enhancement Method in Multiple-Choice Question Answering.

A Multi-Size Neural Network with Attention Mechanism for Answer Selection

Multi-granularity Hierarchical Feature Extraction for Question-Answering Understanding

Multi-Task Learning with Language Modeling for Question Generation

Transformer-Based Neural Network for Answer Selection in Question Answering

Answer Selection Method Based on BERT and Parallel Multi-Channel Convolution.

Enhancing Answer Selection in Community Question Answering with Pre-trained and Large Language Models

Combine Multi-Features with Deep Learning for Answer Selection

Two-Step Multi-Factor Attention Neural Network For Answer Selection

Word-level Dual Channel with Multi-Head Semantic Attention Interaction for Community Question Answering

Chinese Knowledge Base Question Answering by Attention-Based Multi-Granularity Model

MGRC: an End-to-End Multigranularity Reading Comprehension Model for Question Answering

BERT-BC: A Unified Alignment and Interaction Model over Hierarchical BERT for Response Selection

Multiple Fragment-Level Interactive Networks for Answer Selection.

Attentive Interactive Neural Networks for Answer Selection in Community Question Answering.

Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources

Research on Multi-granularity Sentence Interaction Natural Language Inference Based on At-tention Mechanism