Abstract:Facial expression-based Emotion Recognition (FER) is crucial in human–computer interaction and affective computing, particularly when addressing diverse age groups. This paper introduces the Multi-Scale Vision Transformer with Contrastive Learning (MViT-CnG), an age-adaptive FER approach designed to enhance the accuracy and interpretability of emotion recognition models across different classes. The MViT-CnG model leverages vision transformers and contrastive learning to capture intricate facial features, ensuring robust performance despite diverse and dynamic facial features. By utilizing contrastive learning, the model's interpretability is significantly enhanced, which is vital for building trust in automated systems and facilitating human–machine collaboration. Additionally, this approach enriches the model's capacity to discern shared and distinct features within facial expressions, improving its ability to generalize across different age groups. Evaluations using the FER-2013 and CK + datasets highlight the model's broad generalization capabilities, with FER-2013 covering a wide range of emotions across diverse age groups and CK + focusing on posed expressions in controlled environments. The MViT-CnG model adapts effectively to both datasets, showcasing its versatility and reliability across distinct data characteristics. Performance results demonstrated that the MViT-CnG model achieved superior accuracy across all emotion recognition labels on the FER-2013 dataset with a 99.6% accuracy rate, and 99.5% on the CK + dataset, indicating significant improvements in recognizing subtle facial expressions. Comprehensive evaluations revealed that the model's precision, recall, and F1-score are consistently higher than those of existing models, confirming its robustness and reliability in facial emotion recognition tasks.

Facial Expression Recognition Based on Multi-Scale Convolutional Vision Transformer

Enhanced Hybrid Vision Transformer with Multi-Scale Feature Integration and Patch Dropping for Facial Expression Recognition

Facial Expression Recognition With Visual Transformers and Attentional Selective Fusion

Facial expression-based emotion recognition across diverse age groups: a multi-scale vision transformer with contrastive learning approach

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

Facial Expression Recognition Based on Fine-Tuned Channel–Spatial Attention Transformer

Facial Expression Recognition with Grid-Wise Attention and Visual Transformer

MViT: Mask Vision Transformer for Facial Expression Recognition in the Wild

Multi-Scale Attention Learning Network for Facial Expression Recognition

Facial Expression Recognition Based On Multi-Scale Vector Triangle

MFEViT: A Robust Lightweight Transformer-based Network for Multimodal 2D+3D Facial Expression Recognition

FER-former: Multi-modal Transformer for Facial Expression Recognition

Facial expression recognition through multi-level features extraction and fusion

A Multi-Scale Feature Fusion Network for Facial Expression Recognition

A convolution-transformer dual branch network for head-pose and occlusion facial expression recognition

Multi-scale multi-modal micro-expression recognition algorithm based on transformer

Robust facial expression recognition with Transformer Block Enhancement Module

Facial Expression Recognition from Occluded Images Using Deep Convolution Neural Network with Vision Transformer

Attention on Emotions: A Vision Transformer Approach to Advancing Facial Expression Recognition

Facial micro-expression recognition using three-stream vision transformer network with sparse sampling and relabeling