Abstract:In recent years, the electronic devices and wireless network are seen everywhere, generating a massive amount of online surveillance video data that can be applied to recognize facial expressions to sustain the smart education cloud deployment. However, research highlights of existing Facial Expression Recognition (FER) methods mainly focus on the global or local facial expression separately, but pay less attention to the co-operation relationships among them. To relieve the problem, this paper has proposed a Multi-region Attention Transformation Framework (MATF) to blend the global and local facial details for expression recognition. The proposed framework is structured with a multi-region attention transformation network and a pseudo label generation module. The former is used to fuse the rough global feature and local detail information, which divides the original facial image into multi-region sub-blocks for multi-region expression association. Specifically, it includes the facial local segmentation network, the attention transformation network and the feature weight allocation mechanism for facial expression feature extraction. The pseudo label generation strategy is proposed to enhance the performance of multi-region facial expression integration with a semi-supervised way. Further, a unified training strategy is exploited to optimize the proposed framework to ensure a high FER accuracy. Experiments have been conducted on several public FER datasets (RAF-DB, FERPlus, CAER-S) and results indicate that the proposed method outperforms existing algorithms by 3%-8% in accuracy. Based on the multi-region divided attention network learned by the proposed framework, the algorithm for recognizing the expressions can achieve a time complexity as low as O(n), which can be deployed in the mobile electronic devices like the FaceReader series smart facial expression analysis sever. In addition, our facial expression recognition algorithm can be also deployed into the smart education cloud for E-learning.

Multi-Net Fusion: Exploring a Brain-Inspired Neural Network Model for Facial Expression Recognition

Multi-feature fusion network for facial expression recognition in the wild

MCF-Net: Fusion Network of Facial and Scene Features for Expression Recognition in the Wild

Facial expression recognition through multi-level features extraction and fusion

CFNet: Facial Expression Recognition Via Constraint Fusion under Multi-Task Joint Learning Network.

A Multi-Scale Feature Fusion Network for Facial Expression Recognition

Two-pathway attention network for real-time facial expression recognition

Multi-relations Aware Network for in-the-wild Facial Expression Recognition

Multimodal 2D+3D Facial Expression Recognition with Deep Fusion Convolutional Neural Network

Facial expressions recognition with multi-region divided attention networks for smart education cloud applications

Facial Expression Recognition Via Region-Based Convolutional Fusion Network.

CF-DAN: Facial-expression recognition based on cross-fusion dual-attention network

The Facial Expression Recognition Method Based on Image Fusion and CNN

Brain-Machine Coupled Learning Method for Facial Emotion Recognition

Multi-Attention Module for Dynamic Facial Emotion Recognition

Multi-level Spatial and Semantic Enhancement Network for Expression Recognition

Facial Expression Recognition Based on Multi-scale Feature Fusion Convolutional Neural Network and Attention Mechanism

Facial Expression Recognition Based On Global And Local Feature Fusion With Cnns

Machine to brain: facial expression recognition using brain machine generative adversarial networks

Facial Expression Recognition Using Visible, IR, and MSX Images by Early and Late Fusion of Deep Learning Models

Multi-level Feature Fusion Facial Expression Recognition Network