Abstract:Existing domain adaptation methods for cross-subject emotion recognition are primarily focused on accuracy and suffer from the issues of intensive hyperparameter tunings and high computational complexity. In this paper, we make the first attempt to address these issues by developing a domain-invariant classifier called Easy Domain Adaptation (EasyDA) based on multi-view emotion inputs (multiple modalities or multiple types of features). Firstly, EasyDA uses both the source domain (training subjects) and the target domain (test subject) to generate domain generalization features for each view by leveraging a fast, accurate, and low-memory approximate empirical kernel map (AEKM), followed by a parameterless weighted combination for multi-views. Secondly, EasyDA simultaneously learns an optimal separating hyperplane and the pseudo labels for the target domain such that (a) high classification accuracies are obtained on both labeled source domain data and the pseudo-labeled target domain data; (b) the distribution distance between source and target domain is reduced; (c) the predicted output vector in the target domain changes little over time in short time intervals, based on the biological evidence that emotion varies fluently and smoothly. Eventually, by summarizing these two steps with the ridge regression theory and alternating optimization, EasyDA can transfer knowledge across domains accurately, efficiently, and easily in a unified framework. Experimental results on the SEED and SEED-IV datasets demonstrate that EasyDA significantly outperforms multiple representative domain adaptation methods in terms of accuracy, computational time, and memory consumption. It is noteworthy that EasyDA achieves satisfactory performance under a wide range of parameter settings.

Adversarial Domain Adaption for Multi-Cultural Dimensional Emotion Recognition in Dyadic Interactions

Cross-Culture Multimodal Emotion Recognition With Adversarial Learning

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

A Efficient Multimodal Framework for Large Scale Emotion Recognition by Fusing Music and Electrodermal Activity Signals

Multimodal Continuous Emotion Recognition with Data Augmentation Using Recurrent Neural Networks

Multi-Source EEG Emotion Recognition via Dynamic Contrastive Domain Adaptation

Domain adversarial learning for emotion recognition

End-to-End Modeling and Transfer Learning for Audiovisual Emotion Recognition in-the-Wild

Context-Dependent Domain Adversarial Neural Network for Multimodal Emotion Recognition

Solution for Emotion Prediction Competition of Workshop on Emotionally and Culturally Intelligent AI

MEC 2016: The Multimodal Emotion Recognition Challenge of CCPR 2016.

Cross-Corpus Speech Emotion Recognition Based on Multi-Task Learning and Subdomain Adaptation

Multi-View Common Space Learning For Emotion Recognition In The Wild

Easy Domain Adaptation for cross-subject multi-view emotion recognition

MEC 2017: Multimodal Emotion Recognition Challenge

Unsupervised Cross-Lingual Speech Emotion Recognition Using DomainAdversarial Neural Network

Adversarial Multi-dimensional Distribution Alignment for Cross-domain Sentiment Analysis

Towards Intercultural Affect Recognition: Audio-Visual Affect Recognition in the Wild Across Six Cultures

Multimodal Utterance-level Affect Analysis using Visual, Audio and Text Features

A Cross-Culture Study on Multimodal Emotion Recognition Using Deep Learning