Abstract:Background: Surrogates, proxies, and clinicians making shared treatment decisions for patients who have lost decision-making capacity often fail to honor patients' wishes, due to stress, time pressures, misunderstanding patient values, and projecting personal biases. Advance directives intend to align care with patient values but are limited by low completion rates and application to only a subset of medical decisions. Here, we investigate the potential of large language models (LLMs) to incorporate patient values in supporting critical care clinical decision-making for incapacitated patients in a proof-of-concept study. Methods: We simulated text-based scenarios for 50 decisionally incapacitated patients for whom a medical condition required imminent clinical decisions regarding specific interventions. For each patient, we also simulated five unique value profiles captured using alternative formats: numeric ranking questionnaires, text-based questionnaires, and free-text narratives. We used pre-trained generative LLMs for two tasks: 1) text extraction of the treatments under consideration and 2) prompt-based question-answering to generate a recommendation in response to the scenario information, extracted treatment, and patient value profiles. Model outputs were compared with adjudications by three domain experts who independently evaluated each scenario and decision. Results and conclusions: Automated extractions of the treatment in question were accurate for 88% (n = 44/50) of scenarios. LLM treatment recommendations received an average Likert score by the adjudicators of 3.92 of 5.00 (five being best) across all patients for being medically plausible and reasonable treatment recommendations, and 3.58 of 5.00 for reflecting the documented values of the patient. Scores were highest when patient values were captured as short, unstructured, and free-text narratives based on simulated patient profiles. This proof-of-concept study demonstrates the potential for LLMs to function as support tools for surrogates, proxies, and clinicians aiming to honor the wishes and values of decisionally incapacitated patients.

An Overview of Self-Commutating Converters and Their Application in Transmission and Distribution

Embedded values-like shape ethical reasoning of large language models on primary care ethical dilemmas

Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approaches

Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Values

Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Value

Strong and weak alignment of large language models with human values

Probing Pre-Trained Language Models for Cross-Cultural Differences in Values

CValues: Measuring the Values of Chinese Large Language Models from Safety to Responsibility

The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models

Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages?

Measuring Spiritual Values and Bias of Large Language Models

Incorporating Patient Values in Large Language Model Recommendations for Surrogate and Proxy Decisions

Do Large Language Models Align with Core Mental Health Counseling Competencies?

Can Language Models Reason about Individualistic Human Values and Preferences?

Heterogeneous Value Alignment Evaluation for Large Language Models

Assessing LLMs for Moral Value Pluralism

ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models

The benefits, risks and bounds of personalizing the alignment of large language models to individuals

Do LLMs have Consistent Values?