Abstract:Lie detection is considered a concern for everyone in their day-to-day life, given its impact on human interactions. Thus, people normally pay attention to both what their interlocutors are saying and to their visual appearance, including the face, to find any signs that indicate whether or not the person is telling the truth. While automatic lie detection may help us to understand these lying characteristics, current systems are still fairly limited, partly due to lack of adequate datasets to evaluate their performance in realistic scenarios. In this work, we collect an annotated dataset of facial images, comprising both 2D and 3D information of several participants during a card game that encourages players to lie. Using our collected dataset, we evaluate several types of machine learning-based lie detectors in terms of their generalization, in person-specific and cross-application experiments. We first extract both handcrafted and deep learning-based features as relevant visual inputs, then pass them into multiple types of classifier to predict respective lie/non-lie labels. Subsequently, we use several metrics to judge the models’ accuracy based on the models predictions and ground truth. In our experiment, we show that models based on deep learning achieve the highest accuracy, reaching up to 57% for the generalization task and 63% when applied to detect the lie to a single participant. We further highlight the limitation of the deep learning-based lie detector when dealing with cross-application lie detection tasks. Finally, this analysis along the proposed datasets would potentially be useful not only from the perspective of computational systems perspective (e.g., improving current automatic lie prediction accuracy), but also for other relevant application fields, such as health practitioners in general medical counselings, education in academic settings or finance in the banking sector, where close inspections and understandings of the actual intentions of individuals can be very important.

The use of artificial intelligence in interrogation: lies and truth

The use of artificial intelligence in interrogations: voluntary confession

Lie Detection Using Brain Imaging Technology and Its Psychophysiological Basis

Can a Robot Catch You Lying? A Machine Learning System to Detect Lies During Interactions

How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated Questions

[The development and application of lie detection in forensic science].

A Review of Automatic Lie Detection from Facial Features

A Review of Applied Techniques of the Detection of Criminal Deceit

Lie Detection Based on Acoustic Analysis

Machine Learning-Based Lie Detector Applied to a Novel Annotated Game Dataset

Detection of Deception Based on Fmri Activation Patterns Underlying the Production of a Deceptive Response and Receiving Feedback about the Success of the Deception after a Mock Murder Crime.

Detecting lies in investigative interviews through the analysis of response latencies and error rates to unexpected questions

Airport artificial intelligence can detect deception: or am i lying?

The Good, the Bad, and the Ugly: The Role of AI Quality Disclosure in Lie Detection

[Technical Development of Detecting Deception].

Deception Detection: Using Machine Learning to Analyze 911 Calls

Analysis of thermal videos for detection of lie during interrogation

Neural Mechanism of Deception and Its Application to Lie Detection: Evidences from Fmri Studies

Detecting Deception through Linguistic Analysis

Enhancing Lie Detection Accuracy: A Comparative Study of Classic ML, CNN, and GCN Models using Audio-Visual Features

Detection of Deception in the Mafia Party Game