Abstract:In recent years, the electronic devices and wireless network are seen everywhere, generating a massive amount of online surveillance video data that can be applied to recognize facial expressions to sustain the smart education cloud deployment. However, research highlights of existing Facial Expression Recognition (FER) methods mainly focus on the global or local facial expression separately, but pay less attention to the co-operation relationships among them. To relieve the problem, this paper has proposed a Multi-region Attention Transformation Framework (MATF) to blend the global and local facial details for expression recognition. The proposed framework is structured with a multi-region attention transformation network and a pseudo label generation module. The former is used to fuse the rough global feature and local detail information, which divides the original facial image into multi-region sub-blocks for multi-region expression association. Specifically, it includes the facial local segmentation network, the attention transformation network and the feature weight allocation mechanism for facial expression feature extraction. The pseudo label generation strategy is proposed to enhance the performance of multi-region facial expression integration with a semi-supervised way. Further, a unified training strategy is exploited to optimize the proposed framework to ensure a high FER accuracy. Experiments have been conducted on several public FER datasets (RAF-DB, FERPlus, CAER-S) and results indicate that the proposed method outperforms existing algorithms by 3%-8% in accuracy. Based on the multi-region divided attention network learned by the proposed framework, the algorithm for recognizing the expressions can achieve a time complexity as low as O(n), which can be deployed in the mobile electronic devices like the FaceReader series smart facial expression analysis sever. In addition, our facial expression recognition algorithm can be also deployed into the smart education cloud for E-learning.

A lightweight facial expression recognition model for automated engagement detection

SDNET: Lightweight Facial Expression Recognition For Sample Disequilibrium.

Cgan Based Facial Expression Recognition for Human-Robot Interaction

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement

LiteFer: An Approach Based on MobileViT Expression Recognition

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

Facial expression recognition through multi-level features extraction and fusion

Robust Lightweight Facial Expression Recognition Network with Label Distribution Training

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Light-FER: A Lightweight Facial Emotion Recognition System on Edge Devices

Facial Expression Recognition Network with Slow Convolution and Zero-parameter Attention Mechanism

Facial expressions recognition with multi-region divided attention networks for smart education cloud applications

Multi-Attention Module for Dynamic Facial Emotion Recognition

A-MobileNet: An approach of facial expression recognition

UFace: Your Smartphone Can "hear" Your Facial Expression!

Facial Expression Recognition with Contrastive Learning and Uncertainty-Guided Relabeling

FER-YOLO - Detection and Classification Based on Facial Expressions.

A feature boosted deep learning method for automatic facial expression recognition

Highly Robust and Wearable Facial Expression Recognition via Deep-Learning-Assisted, Soft Epidermal Electronics

Facial Expression Recognition Based on Facial Action Unit