Abstract:When provided with sufficient explanatory context, smaller Language Models have been shown to exhibit strong reasoning ability on challenging short-answer question-answering tasks where the questions are unseen in training. We evaluate two methods for further improvement in this setting. Both methods focus on combining rationales generated by a larger Language Model with longer contexts created from a multi-hop dense retrieval system. The first method ($\textit{RR}$) involves training a Rationale Ranking model to score both generated rationales and retrieved contexts with respect to relevance and truthfulness. We then use the scores to derive combined contexts from both knowledge sources using a number of combinatory strategies. For the second method ($\textit{RATD}$) we utilise retrieval-augmented training datasets developed by Hartill et al. 2023 to train a smaller Reasoning model such that it becomes proficient at utilising relevant information from longer text sequences that may be only partially evidential and frequently contain many irrelevant sentences. We find that both methods significantly improve results. Our single best Reasoning model materially improves upon strong comparable prior baselines for unseen evaluation datasets (StrategyQA 58.9 $\rightarrow$ 61.7 acc., CommonsenseQA 63.6 $\rightarrow$ 72.7 acc., ARC-DA 31.6 $\rightarrow$ 52.1 F1, IIRC 25.5 $\rightarrow$ 27.3 F1) and a version utilising our prior knowledge of each type of question in selecting a context combination strategy does even better. Our proposed models also generally outperform direct prompts against much larger models (BLOOM 175B and StableVicuna 13B) in both few-shot chain-of-thought and standard few-shot settings.

RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation

Improving Retrieval Augmented Language Model with Self-Reasoning

Rethinking with Retrieval: Faithful Large Language Model Inference

An Empirical Study of Retrieval Augmented Generation with Chain-of-Thought

Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generation

Retrieval Augmented Thought Process for Private Data Handling in Healthcare

RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback

Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy

CoTAR: Chain-of-Thought Attribution Reasoning with Multi-level Granularity

Think-then-Act: A Dual-Angle Evaluated Retrieval-Augmented Generation

RARE: Retrieval-Augmented Reasoning Enhancement for Large Language Models

Metacognitive Retrieval-Augmented Large Language Models

MoT: Memory-of-Thought Enables ChatGPT to Self-Improve

Retrieving, Rethinking and Revising: The Chain-of-Verification Can Improve Retrieval Augmented Generation

Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts

Retrieval-augmented Multi-modal Chain-of-Thoughts Reasoning for Large Language Models

Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Models

Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection

RATT: A Thought Structure for Coherent and Correct LLM Reasoning

Answering Unseen Questions With Smaller Language Models Using Rationale Generation and Dense Retrieval

Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance