Abstract:While Large Language Models (LLMs) have demonstrated remarkable potential in natural language generation and instruction following, a persistent challenge lies in their susceptibility to "hallucinations", which erodes trust in their outputs. Although Uncertainty Quantification (UQ) presents a promising solution, its accurate implementation within the context of LLMs remains a significant hurdle. To address this critical roadblock, our research originates from a fundamental heuristic insight: tokens within auto-regressive LLM-generated text do not equally reflect the underlying meaning. Some tokens carry greater relevance and representativeness than others, owing to the phenomenon of "linguistic redundancy", wherein a select few keywords suffice to convey the essence of lengthy sentences. Regrettably, existing methodologies treat all tokens with equal importance when estimating uncertainty, disregarding these inherent generative inequalities. Our analysis reveals a significant issue with state-of-the-art: numerous tokens (and sentences) of limited semantic significance receive equal or even excessive weighting during uncertainty estimation. To rectify this bias, we propose to jointly Shifting Attention to more Relevant (SAR) components, at both the token- and the sentence-levels for accurate uncertainty estimation. We conduct extensive experiments involving a range of popular "off-the-shelf" LLMs, including instruction-tuned LLMs such as Vicuna, WizardLM, and LLaMA-2-chat, as well as pretrained LLMs like OPT and LLaMA, with model sizes extending up to 33B parameters. We carry out evaluation across various free-form question-answering tasks, encompassing domains such as reading comprehension, science Q&A, and medical Q&A. Our experimental results demonstrate the superior performance of SAR in addressing the challenges of uncertainty estimation within the realm of LLMs.

Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging

Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models

Uncertainty in Natural Language Generation: From Theory to Applications

Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression

On Uncertainty In Natural Language Processing

SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient

Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation

On the Importance of Uncertainty in Decision-Making with Large Language Models

Shifting Attention to Relevance: Towards the Uncertainty Estimation of Large Language Models

What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability

An improved uncertainty decoding scheme with weighted samples for DNN-HMM hybrid systems

Adaptive Stochastic Weight Averaging

Towards Uncertainty-Aware Language Agent

Improving Uncertainty Quantification in Large Language Models via Semantic Embeddings

Calibration and Uncertainty Quantification of Bayesian Convolutional Neural Networks for Geophysical Applications

STUaNet: Understanding uncertainty in spatiotemporal collective human mobility

Perceptions of Linguistic Uncertainty by Language Models and Humans

Uncertainty-Aware Evaluation for Vision-Language Models

A Comprehensive Study of Calibration and Uncertainty Quantification for Bayesian Convolutional Neural Networks - An Application to Seismic Data

Quantifying Uncertainties in Natural Language Processing Tasks

Label-Confidence-Aware Uncertainty Estimation in Natural Language Generation