Abstract:Large Language Models (LLMs) have demonstrated exceptional capabilities across various machine learning (ML) tasks. Given the high costs of creating annotated datasets for supervised learning, LLMs offer a valuable alternative by enabling effective few-shot in-context learning. However, these models can produce hallucinations, particularly in domains with incomplete knowledge. Additionally, current methods for knowledge distillation using LLMs often struggle to enhance the effectiveness of both teacher and student models. To address these challenges, we introduce DualChecker, an innovative framework designed to mitigate hallucinations and improve the performance of both teacher and student models during knowledge distillation. DualChecker employs ContextAligner to ensure that the context provided by teacher models aligns with human labeling standards. It also features a dynamic checker system that enhances model interaction: one component re-prompts teacher models with more detailed content when they show low confidence, and another identifies borderline cases from student models to refine the teaching templates. This interactive process promotes continuous improvement and effective knowledge transfer between the models. We evaluate DualChecker using a green innovation textual dataset that includes binary, multiclass, and token classification tasks. The experimental results show that DualChecker significantly outperforms existing state-of-the-art methods, achieving up to a 17% improvement in F1 score for teacher models and 10% for student models. Notably, student models fine-tuned with LLM predictions perform comparably to those fine-tuned with actual data, even in a challenging domain. We make all datasets, models, and code from this research publicly available.

What problem does this paper attempt to address?

The paper primarily aims to address the hallucination problem that occurs during the knowledge distillation process of large language models (LLMs) and to improve the performance of both teacher and student models. Specifically, the paper addresses the following key issues: 1. **Hallucination Problem**: LLMs may produce hallucinations when handling tasks, manifesting as factual inaccuracies or inconsistent responses, which limits their reliability in practical applications. This issue is particularly severe in domains where the LLMs' knowledge is incomplete. 2. **Effectiveness of Knowledge Distillation**: Existing knowledge distillation methods often struggle to simultaneously improve the performance of both teacher and student models. Additionally, these methods typically require extra knowledge bases or pre-training or fine-tuning of the models to achieve high accuracy, which is both time-consuming and costly. To address the above issues, the paper proposes a new framework called DualChecker. DualChecker operates in the following ways: - **Hallucination Mitigation**: It employs ContextAligner to ensure that the model outputs are consistent with human annotation standards and enhances model interaction through a dynamic checking system, effectively reducing the occurrence of hallucinations. - **Improving Knowledge Distillation Performance**: Experimental results show that DualChecker significantly improves the performance of both teacher and student models during the knowledge distillation process, especially in the challenging domain of green innovation. - **Open Source Contribution**: To promote transparency and collaboration in the research field, the authors publicly release all datasets, models, and code. The paper also details the workflow of DualChecker, the definition of related tasks, as well as its experimental setup and result analysis. Experimental results indicate that DualChecker achieves significant performance improvements over other baseline methods across multiple tasks, particularly in few-shot settings. Additionally, the paper explores the impact of different numbers of examples (i.e., "shot" numbers) on DualChecker's performance and how it can enhance the student model's performance through the teacher model's predictions.

Interactive DualChecker for Mitigating Hallucinations in Distilling Large Language Models

Knowledge-Centric Hallucination Detection

RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models

Iter-AHMCL: Alleviate Hallucination for Large Language Model via Iterative Model-level Contrastive Learning

Improving Factuality in Large Language Models via Decoding-Time Hallucinatory and Truthful Comparators

Cost-Effective Hallucination Detection for LLMs

HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data

Lower Layer Matters: Alleviating Hallucination via Multi-Layer Fusion Contrastive Decoding with Truthfulness Refocused

Detecting Hallucinations in Large Language Model Generation: A Token Probability Approach

Self-Improving Teacher Cultivates Better Student: Distillation Calibration for Multimodal Large Language Models

Alleviating Hallucinations of Large Language Models through Induced Hallucinations

Zero-Resource Hallucination Prevention for Large Language Models

Constructing Benchmarks and Interventions for Combating Hallucinations in LLMs

Towards Mitigating Hallucination in Large Language Models via Self-Reflection

Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework

ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models

Detecting and Mitigating Hallucination in Large Vision Language Models via Fine-Grained AI Feedback

Distinguishing Ignorance from Error in LLM Hallucinations

ANAH-v2: Scaling Analytical Hallucination Annotation of Large Language Models

FactCheckmate: Preemptively Detecting and Mitigating Hallucinations in LMs

A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generation