Abstract:Misunderstandings arise not only in interpersonal communication but also between humans and Large Language Models (LLMs). Such discrepancies can make LLMs interpret seemingly unambiguous questions in unexpected ways, yielding incorrect responses. While it is widely acknowledged that the quality of a prompt, such as a question, significantly impacts the quality of the response provided by LLMs, a systematic method for crafting questions that LLMs can better comprehend is still underdeveloped. In this paper, we present a method named `Rephrase and Respond' (RaR), which allows LLMs to rephrase and expand questions posed by humans and provide responses in a single prompt. This approach serves as a simple yet effective prompting method for improving performance. We also introduce a two-step variant of RaR, where a rephrasing LLM first rephrases the question and then passes the original and rephrased questions together to a different responding LLM. This facilitates the effective utilization of rephrased questions generated by one LLM with another. Our experiments demonstrate that our methods significantly improve the performance of different models across a wide range to tasks. We further provide a comprehensive comparison between RaR and the popular Chain-of-Thought (CoT) methods, both theoretically and empirically. We show that RaR is complementary to CoT and can be combined with CoT to achieve even better performance. Our work not only contributes to enhancing LLM performance efficiently and effectively but also sheds light on a fair evaluation of LLM capabilities. Data and codes are available at <a class="link-external link-https" href="https://github.com/uclaml/Rephrase-and-Respond" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the existence of misunderstandings in the communication between humans and large language models (LLMs). Specifically, when humans ask questions to LLMs, due to the vagueness or unclearness of the question formulations, LLMs may interpret these seemingly clear questions in unexpected ways, resulting in wrong answers. Although it is known that the quality of questions has a significant impact on the quality of LLMs' answers, currently there is a lack of a systematic method to construct questions that LLMs can better understand. Therefore, this paper proposes a method named "Rephrase and Respond (RaR)", aiming to improve the performance of LLMs by having LLMs re - phrase and expand the questions raised by humans and then provide answers in the same prompt. In addition, this paper also introduces a two - step RaR variant, that is, first, one LLM rephrases the question, and then the original question and the rephrased question are passed together to another LLM for answering. This method not only improves the performance of different models in a wide range of tasks, but also shows that the RaR method can be used complementarily with the popular Chain - of - Thought (CoT) method to achieve better performance. Overall, this work not only effectively enhances the performance of LLMs, but also provides a new perspective for fairly evaluating the capabilities of LLMs.

Rephrase and Respond: Let Large Language Models Ask Better Questions for Themselves

Re-Reading Improves Reasoning in Large Language Models

Putting People in LLMs' Shoes: Generating Better Answers via Question Rewriter

Leveraging Large Language Models for Multiple Choice Question Answering

Prompting Large Language Models with Rationale Heuristics for Knowledge-based Visual Question Answering

Learning to Paraphrase for Alignment with LLM Preference

Rephrase and Contrast: Fine-Tuning Language Models for Enhanced Understanding of Communication and Computer Networks

RefuteBench: Evaluating Refuting Instruction-Following for Large Language Models

Enhancing LLM Problem Solving with REAP: Reflection, Explicit Problem Deconstruction, and Advanced Prompting

Enhancing the Capability and Robustness of Large Language Models through Reinforcement Learning-Driven Query Refinement

Large Language Models are Good Multi-lingual Learners : When LLMs Meet Cross-lingual Prompts

Large Language Models are Contrastive Reasoners

R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models

APEER: Automatic Prompt Engineering Enhances Large Language Model Reranking

Refiner: Restructure Retrieval Content Efficiently to Advance Question-Answering Capabilities

Meta Reasoning for Large Language Models

Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach

Large Language Models Might Not Care What You Are Saying: Prompt Format Beats Descriptions

Active Prompting with Chain-of-Thought for Large Language Models

Empowering Language Models with Active Inquiry for Deeper Understanding

Rewriting Conversational Utterances with Instructed Large Language Models