Abstract:The proliferation of open-source Large Language Models (LLMs) from various institutions has highlighted the urgent need for comprehensive evaluation methods. However, current evaluation platforms, such as the widely recognized HuggingFace open LLM leaderboard, neglect a crucial aspect -- uncertainty, which is vital for thoroughly assessing LLMs. To bridge this gap, we introduce a new benchmarking approach for LLMs that integrates uncertainty quantification. Our examination involves nine LLMs (LLM series) spanning five representative natural language processing tasks. Our findings reveal that: I) LLMs with higher accuracy may exhibit lower certainty; II) Larger-scale LLMs may display greater uncertainty compared to their smaller counterparts; and III) Instruction-finetuning tends to increase the uncertainty of LLMs. These results underscore the significance of incorporating uncertainty in the evaluation of LLMs.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the lack of consideration of uncertainty in current large - language - model (LLM) evaluation methods. Existing evaluation platforms, such as the widely recognized HuggingFace Open LLM Leaderboard, mainly focus on the accuracy of models while ignoring the crucial factor of uncertainty. This results in that even if two LLMs perform identically in terms of accuracy, their degrees of uncertainty when facing problems may be completely different. This is similar to two students choosing the same answers in a multiple - choice exam but having different levels of understanding or uncertainty regarding the questions. Therefore, the paper proposes a new benchmarking method to comprehensively evaluate the performance of LLMs by introducing uncertainty quantification. Specifically, the paper proposes using conformal prediction as a method to quantify the uncertainty of LLMs. Compared with other methods (such as Bayesian variational inference), conformal prediction has the advantages of simple implementation, high efficiency, no need for specific distribution assumptions, and being able to provide statistically rigorous uncertainty estimates. Through this method, researchers can more comprehensively evaluate the performance of LLMs, especially their performance in terms of uncertainty. In the paper, the authors conducted benchmark tests on nine open - source LLMs (covering five typical natural - language - processing tasks: question answering, reading comprehension, common - sense reasoning, dialogue response selection, and document summarization) and obtained the following main findings: 1. LLMs with higher accuracy may exhibit lower certainty; 2. Larger - scale LLMs may show greater uncertainty than smaller - scale LLMs; 3. Instruction fine - tuning tends to increase the uncertainty of LLMs. These findings emphasize the importance of considering uncertainty when evaluating LLMs.

Benchmarking LLMs via Uncertainty Quantification

A Survey of Uncertainty Estimation in LLMs: Theory Meets Practice

Towards Reproducible LLM Evaluation: Quantifying Uncertainty in LLM Benchmark Scores

Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models

Black-box Uncertainty Quantification Method for LLM-as-a-Judge

UBENCH: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions

Shifting Attention to Relevance: Towards the Uncertainty Estimation of Large Language Models

Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraph

Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge

Can LLMs Learn Uncertainty on Their Own? Expressing Uncertainty Effectively in A Self-Training Manner

Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs

Generating with Confidence: Uncertainty Quantification for Black-box Large Language Models

Uncertainty in Language Models: Assessment through Rank-Calibration

SPUQ: Perturbation-Based Uncertainty Quantification for Large Language Models

Uncertainty-Aware Evaluation for Vision-Language Models

Assessing Hidden Risks of LLMs: An Empirical Study on Robustness, Consistency, and Credibility

Uncertainty Estimation and Quantification for LLMs: A Simple Supervised Approach

Do LLMs estimate uncertainty well in instruction-following?

A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions

MAQA: Evaluating Uncertainty Quantification in LLMs Regarding Data Uncertainty