Abstract:Large language models (LLMs) have demonstrated remarkable capabilities across a broad spectrum of tasks. They have attracted significant attention and been deployed in numerous downstream applications. Nevertheless, akin to a double-edged sword, LLMs also present potential risks. They could suffer from private data leaks or yield inappropriate, harmful, or misleading content. Additionally, the rapid progress of LLMs raises concerns about the potential emergence of superintelligent systems without adequate safeguards. To effectively capitalize on LLM capacities as well as ensure their safe and beneficial development, it is critical to conduct a rigorous and comprehensive evaluation of LLMs. This survey endeavors to offer a panoramic perspective on the evaluation of LLMs. We categorize the evaluation of LLMs into three major groups: knowledge and capability evaluation, alignment evaluation and safety evaluation. In addition to the comprehensive review on the evaluation methodologies and benchmarks on these three aspects, we collate a compendium of evaluations pertaining to LLMs' performance in specialized domains, and discuss the construction of comprehensive evaluation platforms that cover LLM evaluations on capabilities, alignment, safety, and applicability. We hope that this comprehensive overview will stimulate further research interests in the evaluation of LLMs, with the ultimate goal of making evaluation serve as a cornerstone in guiding the responsible development of LLMs. We envision that this will channel their evolution into a direction that maximizes societal benefit while minimizing potential risks. A curated list of related papers has been publicly available at <a class="link-external link-https" href="https://github.com/tjunlp-lab/Awesome-LLMs-Evaluation-Papers" rel="external noopener nofollow">this https URL</a>.

Classification of Safety Events at Nuclear Sites using Large Language Models

A Knowledge-Informed Large Language Model Framework for U.S. Nuclear Power Plant Shutdown Initiating Event Classification for Probabilistic Risk Assessment

SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Tasks

Exploring the role of large language models in radiation emergency response

Evaluating Large Language Models: A Comprehensive Survey

MLLMGuard: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Models

Safeguarding Large Language Models: A Survey

Exploring Advanced Methodologies in Security Evaluation for LLMs

SafeLLM: Domain-Specific Safety Monitoring for Large Language Models: A Case Study of Offshore Wind Maintenance

LLMSecCode: Evaluating Large Language Models for Secure Coding

ALERT: A Comprehensive Benchmark for Assessing Large Language Models' Safety through Red Teaming

Safety of Multimodal Large Language Models on Images and Texts

SLM as Guardian: Pioneering AI Safety with Small Language Models

Enhancing Traffic Incident Management with Large Language Models: A Hybrid Machine Learning Approach for Severity Classification

Automatically Identifying Event Reports of Workplace Violence and Communication Failures using Large Language Models

LLMs for Multi-Modal Knowledge Extraction and Analysis in Intelligence/Safety-Critical Applications

SafeBench: A Safety Evaluation Framework for Multimodal Large Language Models

Challenges in Guardrailing Large Language Models for Science

MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models

CFSafety: Comprehensive Fine-grained Safety Assessment for LLMs

Large language models for generating rules, yay or nay?