Abstract:Many social interactions rely on the premise of mutual trust, but deception violates trust and poses risk. Empirically examining trust and deception, particularly in high-stakes situations, is challenging but essential for improving the research realism and generalizability. To address this difficulty, we study trusting and deceptive behaviors in a high-stakes situation by using a novel dataset created from an American game show, Friend or Foe (FoF). In the show, a contestant's reward was determined through a trust game modified from the prisoner's dilemma. We explore how numerous human behaviors including facial expressions, gaze, head pose, body motion, language, and socio-demographic attributes, were related to a contestant's trusting or deceptive decision. Using a data-driven approach, we find that the deceivers' (contestants who chose Foe ) behavior featured a neutralized face, negative facial emotions, enhanced upper body motion, and language with a lower sense of immediacy and agreeableness. The contestants who chose to trust (chose Friend ) exhibited opposite behavioral patterns. Socio-demographic factors such as age, height, and facial attractiveness were also associated with a contestant's choice. Combining multimodal information, machine learning classifiers could predict the contestant's choice with an accuracy about 25% greater than earlier reported human accuracy. We contribute to both trust and deception literature by examining the generalizability of trusting and deceptive behaviors to a new high-stakes scenario. We also add to the decision support literature by showing the superior predictive performances of combining behavioral and socio-demographic features. Furthermore, we contribute to the academic community by introducing the FoF dataset.

Trust and deception with high stakes: Evidence from the friend or foe dataset

Gender difference in spontaneous deception: A hyperscanning study using functional near-infrared spectroscopy

Trust or doubt? Neural resonance based on facial expressions in a deception game reflected by frontal EEG activities.

An EEG Dataset of Neural Signatures in a Competitive Two-Player Game Encouraging Deceptive Behavior

Nothing but lies: improving the validity of neural predictors of deception

Can lies be faked? Comparing low-stakes and high-stakes deception video datasets from a Machine Learning perspective

An empirical evaluation of interpersonal deception theory in a real-world, high-stakes environment

Automatic Long-Term Deception Detection in Group Interaction Videos

Neural Alignment During Face-to-face Spontaneous Deception: Does Gender Make a Difference?

Generative neural networks for experimental manipulation: Examining dominance-trustworthiness face impressions with data-efficient models

To Tell The Truth: Language of Deception and Language Models

Is interactional dissynchrony a clue to deception? Insights from automated analysis of nonverbal visual cues

Can Deception Detection Go Deeper? Dataset, Evaluation, and Benchmark for Deception Reasoning

Deception Detection in Group Video Conversations using Dynamic Interaction Networks

An Honest Joker reveals stereotypical beliefs about the face of deception

Modulation of financial deprivation on deception and its neural correlates

Fine-Grained Question-Level Deception Detection Via Graph-Based Learning and Cross-Modal Fusion

A Game-Theoretic Foundation of Deception: Knowledge Acquisition and Fundamental Limits

Who Deserves My Trust? Cue-Elicited Feedback Negativity Tracks Reputation Learning in Repeated Social Interactions

The Electrocortical Signature of Successful and Unsuccessful Deception in a Face-to-Face Social Interaction

Decoding trust: A reinforcement learning perspective