Abstract:LLMs (large language models) such as ChatGPT have shown remarkable language understanding and generation capabilities. Although reference-free evaluators based on LLMs show better human alignment than traditional reference-based evaluators, there are many challenges in using reference-free evaluators based on LLMs. Reference-free evaluators are more suitable for open-ended examples with different semantics responses. But not all examples are open-ended. For closed-ended examples with unique correct semantic response, reference-free evaluators will still consider it high quality when giving a response that is inconsistent with the facts and the semantic of reference. In order to comprehensively evaluate the reliability of evaluators based on LLMs, we construct two adversarial meta-evaluation dialogue generation datasets KdConv-ADV and DSTC7-ADV based on KdConv and DSTC7-AVSD, respectively. Compared to previous meta-evaluation benchmarks, KdConv-ADV and DSTC7-ADV are much more challenging since they requires evaluators to be able to reasonably evaluate closed-ended examples with the help of external knowledge or even its own knowledge. Empirical results show that the ability of LLMs to identify unreasonable responses is insufficient. There are risks in using eference-free evaluators based on LLMs to evaluate the quality of dialogue responses.

Uncertainty-aware Automatic Evaluation Method for Open-domain Dialogue Systems

REAM$\sharp$: An Enhancement Approach to Reference-based Evaluation Metrics for Open-domain Dialog Generation

Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References

RUBER: an Unsupervised Method for Automatic Evaluation of Open-Domain Dialog Systems

Evaluating Dialogue Generation Systems via Response Selection

Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue Systems

How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation

Rethinking Response Evaluation from Interlocutor's Eye for Open-Domain Dialogue Systems

PONE: A Novel Automatic Evaluation Metric for Open-domain Generative Dialogue Systems

Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses

FineD-Eval: Fine-grained Automatic Dialogue-Level Evaluation

On the Use of Linguistic Features for the Evaluation of Generative Dialogue Systems

USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation

FFAEval: Evaluating Dialogue System Via Free-For-All Ranking

Predictive Engagement: An Efficient Metric For Automatic Evaluation of Open-Domain Dialogue Systems

Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents

SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics

Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach

Evaluate What You Can't Evaluate: Unassessable Quality for Generated Response

PairEval: Open-domain Dialogue Evaluation with Pairwise Comparison

Enhancing the Open-Domain Dialogue Evaluation in Latent Space