Abstract:Query rewriting is a crucial technique for passage retrieval in open-domain conversational question answering (CQA). It decontexualizes conversational queries into self-contained questions suitable for off-the-shelf retrievers. Existing methods attempt to incorporate retriever's preference during the training of rewriting models. However, these approaches typically rely on extensive annotations such as in-domain rewrites and/or relevant passage labels, limiting the models' generalization and adaptation capabilities. In this paper, we introduce AdaQR ($\textbf{Ada}$ptive $\textbf{Q}$uery $\textbf{R}$ewriting), a framework for training query rewriting models with limited rewrite annotations from seed datasets and completely no passage label. Our approach begins by fine-tuning compact large language models using only ~$10\%$ of rewrite annotations from the seed dataset training split. The models are then utilized to generate rewrite candidates for each query instance. A novel approach is then proposed to assess retriever's preference for these candidates by the probability of answers conditioned on the conversational query by marginalizing the Top-$K$ passages. This serves as the reward for optimizing the rewriter further using Direct Preference Optimization (DPO), a process free of rewrite and retrieval annotations. Experimental results on four open-domain CQA datasets demonstrate that AdaQR not only enhances the in-domain capabilities of the rewriter with limited annotation requirement, but also adapts effectively to out-of-domain datasets.

Answer-Supervised Question Reformulation for Enhancing Conversational Machine Comprehension

S2M: Converting Single-Turn to Multi-Turn Datasets for Conversational Question Answering

QAVidCap: Enhancing Video Captioning Through Question Answering Techniques

Can Question Rewriting Help Conversational Question Answering?

MSReNet: Multi-step Reformulation for Open-Domain Question Answering.

Conversational Question Reformulation via Sequence-to-Sequence Architectures and Pretrained Language Models

AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignment

Interactive Language Learning by Question Answering

Supervised Contrastive Learned Deep Model for Question Continuation Evaluation.

CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning

Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space

Exploring Question Understanding and Adaptation in Neural-Network-Based Question Answering

Knowledge-augmented Self-training of A Question Rewriter for Conversational Knowledge Base Question Answering.

Conversational Query Rewriting with Self-supervised Learning

Generative Question Refinement with Deep Reinforcement Learning in Retrieval-based QA System.

Modeling Extractive Question Answering Using Encoder-Decoder Models with Constrained Decoding and Evaluation-Based Reinforcement Learning

LARQ: Learning to Ask and Rewrite Questions for Community Question Answering

Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers

Interview Evaluation: A Novel Approach for Automatic Evaluation of Conversational Question Answering Models

Ditch the Gold Standard: Re-evaluating Conversational Question Answering

Conversational Question Answering with Reformulations over Knowledge Graph