Abstract:We propose PARSE, a novel semi-supervised architecture for learning strong EEG representations for emotion recognition. To reduce the potential distribution mismatch between the large amounts of unlabeled data and the limited amount of labeled data, PARSE uses pairwise representation alignment. First, our model performs data augmentation followed by label guessing for large amounts of original and augmented unlabeled data. This is then followed by sharpening of the guessed labels and convex combinations of the unlabeled and labeled data. Finally, representation alignment and emotion classification are performed. To rigorously test our model, we compare PARSE to several state-of-the-art semi-supervised approaches which we implement and adapt for EEG learning. We perform these experiments on four public EEG-based emotion recognition datasets, SEED, SEED-IV, SEED-V and AMIGOS (valence and arousal). The experiments show that our proposed framework achieves the overall best results with varying amounts of limited labeled samples in SEED, SEED-IV and AMIGOS (valence), while approaching the overall best result (reaching the second-best) in SEED-V and AMIGOS (arousal). The analysis shows that our pairwise representation alignment considerably improves the performance by reducing the distribution alignment between unlabeled and labeled data, especially when only 1 sample per class is labeled.

A Novel Alignment-based Approach for PARSEVAL Measures

jp-evalb: Robust Alignment-based PARSEVAL Measures

A Sentence Meaning Based Alignment Method for Parallel Text Corpora Preparation

Evaluating automatic sentence alignment approaches on English-Slovak sentences

Learning Personalized Alignment for Evaluating Open-ended Text Generation

Evaluating Scoped Meaning Representations

Structured Tree Alignment for Evaluation of (Speech) Constituency Parsing

PARSE: Pairwise Alignment of Representations in Semi-Supervised EEG Learning for Emotion Recognition

Sentence alignment using hybrid model

Word Alignment Based Recognizing Textural Entailment

Word Alignment by Fine-tuning Embeddings on Parallel Corpora

SpeechAlign: a Framework for Speech Translation Alignment Evaluation

Locally Measuring Cross-lingual Lexical Alignment: A Domain and Word Level Perspective

Scene Text Recognition with Permuted Autoregressive Sequence Models

Labeled Alignment for Recognizing Textual Entailment.

Fast-Champollion: a fast and robust sentence alignment algorithm

Towards Structure-aware Paraphrase Identification with Phrase Alignment Using Sentence Encoders

Evaluation of an Algorithmic‐Level Left‐Corner Parsing Account of Surprisal Effects

Towards Addressing the Misalignment of Object Proposal Evaluation for Vision-Language Tasks via Semantic Grounding

A Hybrid Semantic Parsing Approach for Tabular Data Analysis

Spoken Language Understanding from Unaligned Data Using Discriminative Classification Models