Abstract:Many processes in psychology are complex, such as dyadic interactions between two interacting partners (e.g. patient-therapist, intimate relationship partners). Nevertheless, many basic questions about interactions are difficult to investigate because dyadic processes can be within a person and between partners, they are based on multimodal aspects of behavior and unfold rapidly. Current analyses are mainly based on the behavioral coding method, whereby human coders annotate behavior based on a coding schema. But coding is labor-intensive, expensive, slow, focuses on few modalities. Current approaches in psychology use LIWC for analyzing couples' interactions. However, advances in natural language processing such as BERT could enable the development of systems to potentially automate behavioral coding, which in turn could substantially improve psychological research. In this work, we train machine learning models to automatically predict positive and negative communication behavioral codes of 368 German-speaking Swiss couples during an 8-minute conflict interaction on a fine-grained scale (10-seconds sequences) using linguistic features and paralinguistic features derived with openSMILE. Our results show that both simpler TF-IDF features as well as more complex BERT features performed better than LIWC, and that adding paralinguistic features did not improve the performance. These results suggest it might be time to consider modern alternatives to LIWC, the de facto linguistic features in psychology, for prediction tasks in couples research. This work is a further step towards the automated coding of couples' behavior which could enhance couple research and therapy, and be utilized for other dyadic interactions as well.

The Language of Dialogue Is Complex

Dialogues Are Not Just Text: Modeling Cognition for Dialogue Coherence Evaluation

Language Is a Complex Network

Understanding computational dialogue understanding

Speaking your language: The psychological impact of dialect integration in artificial intelligence systems

COOPER: Coordinating Specialized Agents towards a Complex Dialogue Goal

Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)

BERT meets LIWC: Exploring State-of-the-Art Language Models for Predicting Communication Behavior in Couples' Conflict Interactions

Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes

Addressing Social Misattributions of Large Language Models: An HCXAI-based Approach

Describing and assessing interactional competence in a second language

Dialogue Games for Benchmarking Language Understanding: Motivation, Taxonomy, Strategy

Shadows of wisdom: Classifying meta-cognitive and morally grounded narrative content via large language models

Understanding the Cognitive Complexity in Language Elicited by Product Images

Illuminating the Black Box: A Psychometric Investigation into the Multifaceted Nature of Large Language Models

The Role of Humanization and Robustness of Large Language Models in Conversational Artificial Intelligence for Individuals With Depression: A Critical Analysis

Real or Robotic? Assessing Whether LLMs Accurately Simulate Qualities of Human Responses in Dialogue

The complexity of ELF

Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs

Modeling Non-Cooperative Dialogue: Theoretical and Empirical Insights

Quantifying Intimacy in Language