Enhanced Detection of Conversational Mental Manipulation Through Advanced Prompting Techniques

Ivory Yang,Xiaobo Guo,Sean Xie,Soroush Vosoughi
2024-08-15
Abstract:This study presents a comprehensive, long-term project to explore the effectiveness of various prompting techniques in detecting dialogical mental manipulation. We implement Chain-of-Thought prompting with Zero-Shot and Few-Shot settings on a binary mental manipulation detection task, building upon existing work conducted with Zero-Shot and Few- Shot prompting. Our primary objective is to decipher why certain prompting techniques display superior performance, so as to craft a novel framework tailored for detection of mental manipulation. Preliminary findings suggest that advanced prompting techniques may not be suitable for more complex models, if they are not trained through example-based learning.
Computation and Language
What problem does this paper attempt to address?
The paper aims to address the issue of psychological manipulation detection in conversations. Specifically, the research team explores different prompting techniques to improve the recognition of manipulative language. Psychological manipulation is a subtle form of psychological influence that affects people's preferences and choices, and its social impact is exacerbated by technological advancements. However, due to the subtle, context-dependent, and complex nature of manipulative language, it poses significant challenges to the field of Natural Language Processing (NLP). To tackle these challenges, the researchers employed a series of advanced prompting techniques, including Zero-Shot and Few-Shot prompting methods, combined with Chain-of-Thought (CoT) prompting strategies, aiming to enhance the accuracy of psychological manipulation detection. The study found that although CoT performs well in various scenarios, it may not perform optimally for complex models without example-based learning configurations. Additionally, the research explored the effects of different prompting strategies and analyzed the impact of increased model complexity on detection performance. Future work plans to further expand the study of CoT performance and consider factors such as gender, stereotypes, and biases on the results.