Abstract:Answer selection is a crucial subtask in the question answering (QA) system. Conventional avenues for this task mainly concentrate on developing linguistic tools that are limited in both performance and practicability. Answer selection approaches based on deep learning have been well investigated with the tremendous success of deep learning in natural language processing. However, the traditional neural networks employed in existing answer selection models, i.e., recursive neural network or convolutional neural network, typically suffer from obtaining the global text information due to their operating mechanisms. The recent Transformer neural network is considered to be good at extracting the global information by employing only self-attention mechanism. Thus, in this paper, we design a Transformer-based neural network for answer selection, where we deploy a bidirectional long short-term memory (BiLSTM) behind the Transformer to acquire both global information and sequential features in the question or answer sentence. Different from the original Transformer, our Transformer-based network focuses on sentence embedding rather than the seq2seq task. In addition, we employ a BiLSTM rather than utilizing the position encoding to incorporate sequential features as the universal Transformer does. Furthermore, we apply three aggregated strategies to generate sentence embeddings for question and answer, i.e., the weighted mean pooling, the max pooling, and the attentive pooling, leading to three corresponding Transformer-based models, i.e., QA-TF WP , QA-TF MP , and QA-TF AP , respectively. Finally, we evaluate our proposals on a popular QA dataset WikiQA. The experimental results demonstrate that our proposed Transformer-based answer selection models can produce a better performance compared with several competitive baselines. In detail, our best model outperforms the state-of-the-art baseline by up to 2.37%, 2.83%, and 3.79% in terms of MAP, MRR, and accuracy, respectively.

Narrow Down Before Selection: A Dynamic Exclusion Model for Multiple-Choice QA

Differentiating Choices via Commonality for Multiple-Choice Question Answering

Modeling Extractive Question Answering Using Encoder-Decoder Models with Constrained Decoding and Evaluation-Based Reinforcement Learning

Attention-based Encoder-Decoder Model for Answer Selection in Question Answering

Clues Before Answers: Generation-Enhanced Multiple-Choice QA.

Leveraging Large Language Models for Multiple Choice Question Answering

LLMs May Perform MCQA by Selecting the Least Incorrect Option

An Enhanced Convolutional Neural Network Model for Answer Selection.

Counterfactual Variable Control for Robust and Interpretable Question Answering

Beyond the Answers: Reviewing the Rationality of Multiple Choice Question Answering for the Evaluation of Large Language Models

Examine Before You Answer: Multi-task Learning with Adaptive-attentions for Multiple-choice VQA.

Less is more: Data-efficient complex question answering over knowledge bases

Dual Head-wise Coattention Network for Machine Comprehension with Multiple-Choice Questions

Transfer Learning Enhanced Single-choice Decision for Multi-choice Question Answering

Winnowing Knowledge for Multi-choice Question Answering

Read, Attend, and Exclude: Multi-Choice Reading Comprehension by Mimicking Human Reasoning Process

KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering

Transformer-Based Neural Network for Answer Selection in Question Answering

On Large Language Models' Selection Bias in Multi-Choice Questions

Context Filtering with Reward Modeling in Question Answering

Large Language Models Are Not Robust Multiple Choice Selectors.