Abstract:We evaluate how well Large Language Models (LLMs) latently recall and compose facts to answer multi-hop queries like "In the year Scarlett Johansson was born, the Summer Olympics were hosted in the country of". One major challenge in evaluating this ability is that LLMs may have developed shortcuts by encounters of the head entity "Scarlett Johansson" and the answer entity "United States" in the same training sequences or merely guess the answer based on frequency-based priors. To prevent shortcuts, we exclude test queries where the head and answer entities co-appear in pretraining corpora. Through careful selection of relations and facts and systematic removal of cases where models might guess answers or exploit partial matches, we construct an evaluation dataset SOCRATES (ShOrtCut-fRee lATent rEaSoning). We observe that LLMs demonstrate promising latent multi-hop reasoning abilities without exploiting shortcuts, but only for certain types of queries. For queries requiring latent recall of countries as the intermediate answer, the best models achieve 80% latent composability, but this drops to just 5% for the recall of years. Comparisons with Chain-of-Thought composability highlight a significant gap between the ability of models to reason latently versus explicitly. Analysis reveals that latent representations of the intermediate answer are constructed more often in queries with higher latent composability, and shows the emergence of latent multi-hop reasoning during pretraining.
What problem does this paper attempt to address?
### Problems the paper attempts to solve
The paper aims to evaluate the ability of large language models (LLMs) to perform latent multi - hop reasoning without exploiting shortcuts. Specifically, the researchers focus on how LLMs can answer multi - hop queries by implicitly recalling and combining single - hop facts without having direct access to relevant entity pairs or relationship patterns. For example, a typical multi - hop query might be: "In the year Scarlett Johansson was born, which country hosted the Summer Olympics?" Such questions require the model to be able to implicitly recall and combine single - hop facts, such as "Scarlett Johansson's birth year" and "the host country of the 1984 Summer Olympics".
### Main challenges
1. **Shortcut problem**: LLMs may develop shortcuts due to the frequent occurrence of certain head entities (such as "Scarlett Johansson") and answer entities (such as "the United States") in the training data, and thus correctly answer questions without performing true reasoning.
2. **Frequency bias**: LLMs may guess the answer based on frequency priors rather than through reasoning.
3. **Difficulty in evaluation**: Since the pre - training data of most LLMs is inaccessible, it is difficult to directly check the co - occurrence of entities.
### Solutions
To overcome these challenges, the researchers proposed the following methods:
1. **Construct an evaluation dataset without shortcuts**:
- **Exclude co - occurring entity pairs**: By using a proxy corpus (about 480 million unique documents), screen out test cases where the head entity and the answer entity have never appeared in the same document.
- **Reduce relation - object shortcuts**: Exclude those queries where the model may be able to guess the answer when only part of the information is given.
- **Carefully select relationship types**: Avoid selecting relationship types from which the answer can be easily inferred from the substrings of the head entity.
2. **Evaluation process**:
- **Implicit reasoning**: Require the model to directly answer multi - hop queries without generating intermediate answers (i.e., bridging entities).
- **Exclude explicit reasoning**: Exclude cases where the model performs chain - of - thought (CoT).
### Experimental results
By evaluating 41 LLMs from 9 families, the researchers found:
- **Different types of bridging entities**: For queries with countries as bridging entities, the state - of - the - art models show an implicit combination ability of over 80%; while for queries with years as bridging entities, this proportion drops to about 6%.
- **Impact of model scale**: Models that know more single - hop facts are generally better at implicit reasoning, but this ability improves marginally as the model scale increases.
- **Comparison with chain - of - thought**: The combination ability of chain - of - thought is significantly higher than the implicit combination ability, and effectively improves as the number of known single - hop facts and the model scale increase, and is more consistent across different types of bridging entities.
### Conclusion
The paper successfully constructs an evaluation dataset named SOCRATES for evaluating the ability of LLMs to perform latent multi - hop reasoning without exploiting shortcuts by proposing shortcut - free evaluation criteria and methods. The experimental results show that although LLMs show strong implicit reasoning abilities in some types of queries, this ability varies significantly across different types of bridging entities. These findings emphasize the importance of considering the distribution of relationship combination types when evaluating the implicit reasoning ability of LLMs.