Abstract:Humor is a substantial element of human social behavior, affect, and cognition. Its automatic understanding can facilitate a more naturalistic human-AI interaction. Current methods of humor detection have been exclusively based on staged data, making them inadequate for "real-world" applications. We contribute to addressing this deficiency by introducing the novel Passau-Spontaneous Football Coach Humor (Passau-SFCH) dataset, comprising about 11 hours of recordings. The Passau-SFCH dataset is annotated for the presence of humor and its dimensions (sentiment and direction) as proposed in Martin's Humor Style Questionnaire. We conduct a series of experiments employing pretrained Transformers, convolutional neural networks, and expert-designed features. The performance of each modality (text, audio, video) for spontaneous humor recognition is analyzed and their complementarity is investigated. Our findings suggest that for the automatic analysis of humor and its sentiment, facial expressions are most promising, while humor direction can be best modeled via text-based features. Further, we experiment with different multimodal approaches to humor recognition, including decision-level fusion and MulT, a multimodal Transformer approach. In this context, we propose a novel multimodal architecture that yields the best overall results. Finally, we make our code publicly available at <a class="link-external link-https" href="https://www.github.com/lc0197/passau-sfch" rel="external noopener nofollow">this https URL</a>. The Passau-SFCH dataset is available upon request.

Is This a Joke? Detecting Humor in Spanish Tweets

A Crowd-Annotated Spanish Corpus for Humor Analysis

Predicting the Humorousness of Tweets Using Gaussian Process Preference Learning

#HashtagWars: Learning a Sense of Humor

ColBERT: Using BERT sentence embedding in parallel neural networks for computational humor

Humor Detection in English-Hindi Code-Mixed Social Media Content : Corpus and Baseline System

THInC: A Theory-Driven Framework for Computational Humor Detection

Humor Detection: A Transformer Gets the Last Laugh

How Did This Get Funded?! Automatically Identifying Quirky Scientific Achievements

Getting Serious about Humor: Crafting Humor Datasets with Unfunny Large Language Models

Applying a Pre-trained Language Model to Spanish Twitter Humor Prediction

This joke is [MASK]: Recognizing Humor and Offense with Prompting

Beyond Words: Analyzing Emotions and Linguistic Characteristics to Detect Hoax-Related Tweets During Spanish Regional Elections

Humor Detection based on Paragraph Decomposition and BERT Fine-Tuning

Towards Multimodal Prediction of Spontaneous Humour: A Novel Dataset and First Results

Is AI fun? HumorDB: a curated dataset and benchmark to investigate graphical humor

Cards Against AI: Predicting Humor in a Fill-in-the-blank Party Game

"So You Think You're Funny?": Rating the Humour Quotient in Standup Comedy

Who's to say what's funny? A computer using Language Models and Deep Learning, That's Who!

Psycho-linguistic Experiment on Universal Semantic Components of Verbal Humor: System Description and Annotation

The use of humor in Spanish and English compliment responses: A cross-cultural analysis