Abstract:Facial expression recognition (FER) in the wild is an active and challenging field of research. A system for automatic FER finds use in a wide range of applications related to advanced human–computer interaction (HCI), human–robot interaction (HRI), human behavioral analysis, gaming and entertainment, etc. Since their inception, convolutional neural networks (CNNs) have attained state‐of‐the‐art accuracy in the facial analysis task. However, recognizing facial expressions in the wild with high confidence running on a low‐cost embedded device remains challenging. To this end, this study presents an efficient dual‐channel ensembled deep CNN (DCE‐DCNN) for FER in the wild. Initially, two DCNNs, namely the DCNNG and DCNNS , are trained separately on the grayscale and Scharr‐convolved vertical gradient facial images, respectively. The proposed network later integrates the two pre‐trained DCNNs to obtain the dual‐channel integrated DCNN (DCI‐DCNN). Finally, all three neural networks, namely the DCNNG , DCNNS , and DCI‐DCNN, are jointly fine‐tuned to get a single dual‐channel‐multi‐output model. The multi‐output model produces three prediction scores for the given input facial image. The prediction scores are thus fused using the max‐voting ensemble scheme to obtain the DCE‐DCNN with the final classification label. On the FER2013, RAF‐DB, NCAER‐S, AffectNet, and CKPlus benchmark FER datasets, the proposed DCE‐DCNN consistently outperforms the two individual DCNNs and numerous state‐of‐the‐art CNNs. Moreover, the network achieves competitive recognition accuracy on all four FER in the wild datasets with reduced memory storage size and parameters. The proposed DCE‐DCNN model with high throughput on resource‐limited embedded devices is suitable for applications that seek real‐time classification of facial expressions in the wild with high confidence.

An Improved SimAM Based CNN for Facial Expression Recognition

SDNET: Lightweight Facial Expression Recognition For Sample Disequilibrium.

Enhanced Hybrid Vision Transformer with Multi-Scale Feature Integration and Patch Dropping for Facial Expression Recognition

The Facial Expression Recognition Method Based on Image Fusion and CNN

Facial Expression Recognition Based on A Lightweight CNN Model

Facial Expression Recognition Based on Convolutional Neural Network with Sparse Representation

Lightweight Attention Convolutional Neural Network Through Network Slimming for Robust Facial Expression Recognition

An Efficient Channel Attention CNN for Facial Expression Recognition

Facial Expression Recognition Based on Attention Mechanism ResNet Lightweight Network

Facial Expression Recognition Model Based on CNN and Data Augmentation Method

Facial Expression Recognition Based on Multi-scale Feature Fusion Convolutional Neural Network and Attention Mechanism

A Lightweight Attention-based Deep Network via Multi-Scale Feature Fusion for Multi-View Facial Expression Recognition

FERNet: A Deep CNN Architecture for Facial Expression Recognition in the Wild

Adaptive multilayer perceptual attention network for facial expression recognition

Facial Expression Recognition Based On Global And Local Feature Fusion With Cnns

Facial Attention based Convolutional Neural Network for 2D+3D Facial Expression Recognition

A dual‐channel ensembled deep convolutional neural network for facial expression recognition in the wild

Facial Expression Recognition Based on Sparse Autoencoder and Shallow Convolutional Neural Network.

NA-Resnet: neighbor block and optimized attention module for global-local feature extraction in facial expression recognition

Relation and context augmentation network for facial expression recognition

Facial Expression Recognition Based on Local Feature Fusion of Convolutional Neural Network