Abstract:Several studies applying Machine Learning to deception detection have been published in the last decade. A rich and complex set of settings, approaches, theories, and results is now available. Therefore, one may find it difficult to identify trends, successful paths, gaps, and opportunities for contribution. The present literature review aims to provide the state of research regarding deception detection with Machine Learning. We followed the PRISMA protocol and retrieved 648 articles from ACM Digital Library, IEEE Xplore, Scopus, and Web of Science. 540 of them were screened (108 were duplicates). A final corpus of 81 documents has been summarized as mind maps. Metadata was extracted and has been encoded as Python dictionaries to support a statistical analysis scripted in Python programming language, and available as a collection of Jupyter Lab Notebooks in a GitHub repository. All are available as Jupyter Lab Notebooks. Neural Networks, Support Vector Machines, Random Forest, Decision Tree and K-nearest Neighbor are the five most explored techniques. The studies report a detection performance ranging from 51% to 100%, with 19 works reaching accuracy rate above 0.9. Monomodal, Bimodal, and Multimodal approaches were exploited and achieved various accuracy levels for detection. Bimodal and Multimodal approaches have become a trend over Monomodal ones, although there are high-performance examples of the latter. Studies that exploit language and linguistic features, 75% are dedicated to English. The findings include observations of the following: language and culture, emotional features, psychological traits, cognitive load, facial cues, complexity, performance, and Machine Learning topics. We also present a dataset benchmark. Main conclusions are that labeled datasets from real-life data are scarce. Also, there is still room for new approaches for deception detection with Machine Learning, especially if focused on languages and cultures other than English-based. Further research would greatly contribute by providing new labeled and multimodal datasets for deception detection, both for English and other languages.

Methodologies for Deception Detection Based on Abnormal Behavior

New progress in the paradigm of elicited deception : Application of human-computer interaction in deception detection

Your Eyes Say You're Lying: An Eye Movement Pattern Analysis for Face Familiarity and Deceptive Cognition

Is interactional dissynchrony a clue to deception? Insights from automated analysis of nonverbal visual cues

Intelligent Eye-Tracker-Based Methods for Detection of Deception: A Survey

Introducing Representations of Facial Affect in Automated Multimodal Deception Detection

Advancing Automated Deception Detection: A Multimodal Approach to Feature Extraction and Analysis

Affect-Aware Deep Belief Network Representations for Multimodal Unsupervised Deception Detection

Mining Bodily Cues to Deception

MDPE: A Multimodal Deception Dataset with Personality and Emotional Characteristics

Deception detection with machine learning: A systematic review and statistical analysis

Body Language Detecting Deception

Analysis, Evaluation, and Future Directions on Multimodal Deception Detection

An Honest Joker reveals stereotypical beliefs about the face of deception

Intentional-Deception Detection Based on Facial Muscle Movements in an Interactive Social Context

Constructing Robust Emotional State-based Feature with a Novel Voting Scheme for Multi-modal Deception Detection in Videos

Abnormal Behavior Detection Based on Regional Optical Flow

Statistical Model-based Abnormal Behavior Detection

Deception detection in text and its relation to the cultural dimension of individualism/collectivism

Fine-Grained Question-Level Deception Detection Via Graph-Based Learning and Cross-Modal Fusion

COMPARISON OF METHODS FOR SMILE DECEIT DETECTION BY TRAINING AU6 AND AU12 SIMULTANEOUSLY