Yue Huang,Lichao Sun,Haoran Wang,Siyuan Wu,Qihui Zhang,Yuan Li,Chujie Gao,Yixin Huang,Wenhan Lyu,Yixuan Zhang,Xiner Li,Hanchi Sun,Zhengliang Liu,Yixin Liu,Yijue Wang,Zhikun Zhang,Bertie Vidgen,Bhavya Kailkhura,Caiming Xiong,Chaowei Xiao,Chunyuan Li,Eric Xing,Furong Huang,Hao Liu,Heng Ji,Hongyi Wang,Huan Zhang,Huaxiu Yao,Manolis Kellis,Marinka Zitnik,Meng Jiang,Mohit Bansal,James Zou,Jian Pei,Jian Liu,Jianfeng Gao,Jiawei Han,Jieyu Zhao,Jiliang Tang,Jindong Wang,Joaquin Vanschoren,John Mitchell,Kai Shu,Kaidi Xu,Kai-Wei Chang,Lifang He,Lifu Huang,Michael Backes,Neil Gong,Philip Yu,Pin-Yu Chen,Quanquan Gu,Ran Xu,ZHITAO YING,Shuiwang Ji,Suman Jana,Tianlong Chen,Tianming Liu,Tianyi Zhou,William Wang,Xiang Li,Xiangliang Zhang,Xiao Wang,Xing Xie,Xun Chen,Xuyu Wang,Yan Liu,Yanfang Ye,Yinzhi Cao,Yong Chen,Yue Zhao

Abstract:Large language models (LLMs) have gained considerable attention for their excellent natural language processing capabilities. Nonetheless, these LLMs present many challenges, particularly in the realm of trustworthiness. This paper introduces TrustLLM, a comprehensive study of trustworthiness in LLMs, including principles for different dimensions of trustworthiness, established benchmark, evaluation, and analysis of trustworthiness for mainstream LLMs, and discussion of open challenges and future directions. Specifically, we first propose a set of principles for trustworthy LLMs that span eight different dimensions. Based on these principles, we further establish a benchmark across six dimensions including truthfulness, safety, fairness, robustness, privacy, and machine ethics. We then present a study evaluating 16 mainstream LLMs in TrustLLM, consisting of over 30 datasets. Our findings firstly show that in general trustworthiness and capability (i.e., functional effectiveness) are positively related. Secondly, our observations reveal that proprietary LLMs generally outperform most open-source counterparts in terms of trustworthiness, raising concerns about the potential risks of widely accessible open-source LLMs. However, a few open-source LLMs come very close to proprietary ones, suggesting that open-source models can achieve high levels of trustworthiness without additional mechanisms likemoderator, offering valuable insights for developers in this field. Thirdly, it is important to note that some LLMs may be overly calibrated towards exhibiting trustworthiness, to the extent that they compromise their utility by mistakenly treating benign prompts as harmful and consequently not responding. Besides these observations, we've uncovered key insights into the multifaceted trustworthiness in LLMs. We emphasize the importance of ensuring transparency not only in the models themselves but also in the technologies that underpin trustworthiness. We advocate that the establishment of an AI alliance between industry, academia, the open-source community to foster collaboration is imperative to advance the trustworthiness of LLMs.

An LLM Maturity Model for Reliable and Transparent Text-to-Query

Assessing Hidden Risks of LLMs: An Empirical Study on Robustness, Consistency, and Credibility

Know where to go: Make LLM a relevant, responsible, and trustworthy searchers

Know Where to Go: Make LLM a Relevant, Responsible, and Trustworthy Searcher

How Reliable are LLMs as Knowledge Bases? Re-thinking Facutality and Consistency

T-RAG: Lessons from the LLM Trenches

Large Language Models are legal but they are not: Making the case for a powerful LegalLLM

Enhancing the Capability and Robustness of Large Language Models through Reinforcement Learning-Driven Query Refinement

Large language models for automated Q&A involving legal documents: a survey on algorithms, frameworks and applications

Can LLMs faithfully generate their layperson-understandable 'self'?: A Case Study in High-Stakes Domains

CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models

Enhancing Trust in LLMs: Algorithms for Comparing and Interpreting LLMs

Exploring the Best Practices of Query Expansion with Large Language Models

Enhancing LLM Fine-tuning for Text-to-SQLs by SQL Quality Measurement

Position: TrustLLM: Trustworthiness in Large Language Models

Exploring the Nexus of Large Language Models and Legal Systems: A Short Survey

SecureLLM: Using Compositionality to Build Provably Secure Language Models for Private, Sensitive, and Secret Data

Can LLMs be Fooled? Investigating Vulnerabilities in LLMs

QuickLLaMA: Query-aware Inference Acceleration for Large Language Models

QUILL: Query Intent with Large Language Models using Retrieval Augmentation and Multi-stage Distillation

LUQ: Long-text Uncertainty Quantification for LLMs