Abstract:Large language models (LLMs) have demonstrated strong capabilities in text understanding and generation. However, they often lack factuality, producing a mixture of true and false information, especially in long-form generation. In this work, we investigates the factuality of long-form text generation across various large language models (LLMs), including GPT-4, Gemini-1.5-Pro, Claude-3-Opus, Llama-3-70B, and Mistral. Our analysis reveals that factuality scores tend to decline in later sentences of the generated text, accompanied by a rise in the number of unsupported claims. Furthermore, we explore the effectiveness of different evaluation settings to assess whether LLMs can accurately judge the correctness of their own outputs: Self-Known (the percentage of supported atomic claims, decomposed from LLM outputs, that the corresponding LLMs judge as correct) and Self-Unknown (the percentage of unsupported atomic claims that the corresponding LLMs judge as incorrect). The results indicate that even advanced models like GPT-4 and Gemini-1.5-Pro fail to achieve perfect Self-Known scores, while their Self-Unknown scores remain notably above zero, reflecting ongoing uncertainty in their self-assessments. Moreover, we find a correlation between higher Self-Known scores and improved factuality, while higher Self-Unknown scores are associated with lower factuality. Interestingly, even without significant changes in the models' self-judgment (Self-Known and Self-Unknown), the number of unsupported claims can increases, likely as an artifact of long-form generation. These findings show the limitations of current LLMs in long-form generation, and provide valuable insights for improving factuality in long-form text generation.

Multi-FAct: Assessing Factuality of Multilingual LLMs using FActScore

Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity

An Analysis of Multilingual FActScore

Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs

FELM: Benchmarking Factuality Evaluation of Large Language Models

FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation

Long-form factuality in large language models

Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs

Merging Facts, Crafting Fallacies: Evaluating the Contradictory Nature of Aggregated Factual Claims in Long-Form Generations

Investigating Factuality in Long-Form Text Generation: The Roles of Self-Known and Self-Unknown

Factuality of Large Language Models: A Survey

Towards a Holistic Evaluation of LLMs on Factual Knowledge Recall

The Factuality of Large Language Models in the Legal Domain

LLM Factoscope: Uncovering LLMs' Factual Discernment through Inner States Analysis

Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-OASIS

FactAlign: Long-form Factuality Alignment of Large Language Models

Factual Confidence of LLMs: on Reliability and Robustness of Current Estimators

UFO: a Unified and Flexible Framework for Evaluating Factuality of Large Language Models

An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation

Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators

Statistical Knowledge Assessment for Large Language Models