Abstract:The rapid advancement of Large Language Models (LLMs) and their potential integration into autonomous driving systems necessitates understanding their moral decision-making capabilities. While our previous study examined four prominent LLMs using the Moral Machine experimental framework, the dynamic landscape of LLM development demands a more comprehensive analysis. Here, we evaluate moral judgments across 51 different LLMs, including multiple versions of proprietary models (GPT, Claude, Gemini) and open-source alternatives (Llama, Gemma), to assess their alignment with human moral preferences in autonomous driving scenarios. Using a conjoint analysis framework, we evaluated how closely LLM responses aligned with human preferences in ethical dilemmas and examined the effects of model size, updates, and architecture. Results showed that proprietary models and open-source models exceeding 10 billion parameters demonstrated relatively close alignment with human judgments, with a significant negative correlation between model size and distance from human judgments in open-source models. However, model updates did not consistently improve alignment with human preferences, and many LLMs showed excessive emphasis on specific ethical principles. These findings suggest that while increasing model size may naturally lead to more human-like moral judgments, practical implementation in autonomous driving systems requires careful consideration of the trade-off between judgment quality and computational efficiency. Our comprehensive analysis provides crucial insights for the ethical design of autonomous systems and highlights the importance of considering cultural contexts in AI moral decision-making.

Shadows of wisdom: Classifying meta-cognitive and morally grounded narrative content via large language models

Are Large Language Models Moral Hypocrites? A Study Based on Moral Foundations

Exploring the psychology of LLMs' Moral and Legal Reasoning

Exploring and steering the moral compass of Large Language Models

Moral Foundations of Large Language Models

MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks

Potential Benefits of Employing Large Language Models in Research in Moral Education and Development

Evaluating Large Language Models in Analysing Classroom Dialogue

Large-scale moral machine experiment on large language models

The moral machine experiment on large language models

Evaluating Moral Beliefs across LLMs through a Pluralistic Framework

Humanlike Cognitive Patterns as Emergent Phenomena in Large Language Models

From Voices to Validity: Leveraging Large Language Models (LLMs) for Textual Analysis of Policy Stakeholder Interviews

ClarityEthic: Explainable Moral Judgment Utilizing Contrastive Ethical Insights from Large Language Models

Language Model Alignment in Multilingual Trolley Problems

Probing the Robustness of Theory of Mind in Large Language Models

A Comprehensive Analysis of the Effectiveness of Large Language Models As Automatic Dialogue Evaluators

Thinking Fast and Slow in Large Language Models

PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits