Abstract:In recent years, the electronic devices and wireless network are seen everywhere, generating a massive amount of online surveillance video data that can be applied to recognize facial expressions to sustain the smart education cloud deployment. However, research highlights of existing Facial Expression Recognition (FER) methods mainly focus on the global or local facial expression separately, but pay less attention to the co-operation relationships among them. To relieve the problem, this paper has proposed a Multi-region Attention Transformation Framework (MATF) to blend the global and local facial details for expression recognition. The proposed framework is structured with a multi-region attention transformation network and a pseudo label generation module. The former is used to fuse the rough global feature and local detail information, which divides the original facial image into multi-region sub-blocks for multi-region expression association. Specifically, it includes the facial local segmentation network, the attention transformation network and the feature weight allocation mechanism for facial expression feature extraction. The pseudo label generation strategy is proposed to enhance the performance of multi-region facial expression integration with a semi-supervised way. Further, a unified training strategy is exploited to optimize the proposed framework to ensure a high FER accuracy. Experiments have been conducted on several public FER datasets (RAF-DB, FERPlus, CAER-S) and results indicate that the proposed method outperforms existing algorithms by 3%-8% in accuracy. Based on the multi-region divided attention network learned by the proposed framework, the algorithm for recognizing the expressions can achieve a time complexity as low as O(n), which can be deployed in the mobile electronic devices like the FaceReader series smart facial expression analysis sever. In addition, our facial expression recognition algorithm can be also deployed into the smart education cloud for E-learning.

Efficient lower layers parameter decoupling personalized federated learning method of facial expression recognition for home care robots

SDNET: Lightweight Facial Expression Recognition For Sample Disequilibrium.

Cgan Based Facial Expression Recognition for Human-Robot Interaction

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

Real-time Facial Expression Recognition on Robot for Healthcare

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

Hierarchical Co-Consistency Quantization and Information Refining Binary Network for Facial Expression Recognition in Human–Robot Interaction

A Facial Expression Emotion Recognition Based Human-robot Interaction System

Facial Expression Recognition Based on Zero-Addition Pretext Training and Feature Conjunction-Selection Network in Human–Robot Interaction

Facial expression recognition based on deep convolution long short-term memory networks of double-channel weighted mixture

Facial Expression Recognition and Positive Emotion Incentive System for Human-Robot Interaction

Improved Deep Convolutional Neural Network with Age Augmentation for Facial Emotion Recognition in Social Companion Robotics

Robust Lightweight Facial Expression Recognition Network with Label Distribution Training

Multi-sensor fusion federated learning method of human posture recognition for dual-arm nursing robots

Lightweight Deep Learning Model for Facial Expression Recognition

SferNet: A Novel Network for Static Facial Emotion Recognition

AdaFedFR: Federated Face Recognition with Adaptive Inter-Class Representation Learning

Facial expressions recognition with multi-region divided attention networks for smart education cloud applications

An Effective and Efficient Real-Time Facial Expression Recognition Method in the Wild

Deploying a Human Robot Interaction Model for Dementia Care in Federated Learning

Facial Expression Recognition with Controlled Privacy Preservation and Feature Compensation