Abstract:Facial expression recognition (FER) in the wild is an active and challenging field of research. A system for automatic FER finds use in a wide range of applications related to advanced human–computer interaction (HCI), human–robot interaction (HRI), human behavioral analysis, gaming and entertainment, etc. Since their inception, convolutional neural networks (CNNs) have attained state‐of‐the‐art accuracy in the facial analysis task. However, recognizing facial expressions in the wild with high confidence running on a low‐cost embedded device remains challenging. To this end, this study presents an efficient dual‐channel ensembled deep CNN (DCE‐DCNN) for FER in the wild. Initially, two DCNNs, namely the DCNNG and DCNNS , are trained separately on the grayscale and Scharr‐convolved vertical gradient facial images, respectively. The proposed network later integrates the two pre‐trained DCNNs to obtain the dual‐channel integrated DCNN (DCI‐DCNN). Finally, all three neural networks, namely the DCNNG , DCNNS , and DCI‐DCNN, are jointly fine‐tuned to get a single dual‐channel‐multi‐output model. The multi‐output model produces three prediction scores for the given input facial image. The prediction scores are thus fused using the max‐voting ensemble scheme to obtain the DCE‐DCNN with the final classification label. On the FER2013, RAF‐DB, NCAER‐S, AffectNet, and CKPlus benchmark FER datasets, the proposed DCE‐DCNN consistently outperforms the two individual DCNNs and numerous state‐of‐the‐art CNNs. Moreover, the network achieves competitive recognition accuracy on all four FER in the wild datasets with reduced memory storage size and parameters. The proposed DCE‐DCNN model with high throughput on resource‐limited embedded devices is suitable for applications that seek real‐time classification of facial expressions in the wild with high confidence.

FER-Net: Facial Expression Recognition Using Densely Connected Convolutional Network

SDNET: Lightweight Facial Expression Recognition For Sample Disequilibrium.

FERNet: A Deep CNN Architecture for Facial Expression Recognition in the Wild

The Facial Expression Recognition Method Based on Image Fusion and CNN

An Improved SimAM Based CNN for Facial Expression Recognition

CC-CNN: A cross connected convolutional neural network using feature level fusion for facial expression recognition

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network.

FLEPNet: Feature Level Ensemble Parallel Network for Facial Expression Recognition

Two-pathway attention network for real-time facial expression recognition

An Efficient Channel Attention CNN for Facial Expression Recognition

Auto-FERNet: A Facial Expression Recognition Network With Architecture Search

Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks

A convolution-transformer dual branch network for head-pose and occlusion facial expression recognition

Fast and Efficient Facial Expression Recognition Using a Gabor Convolutional Network

A dual‐channel ensembled deep convolutional neural network for facial expression recognition in the wild

DTL-I-ResNet18: facial emotion recognition based on deep transfer learning and improved ResNet18

Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields

Lightweight Attention Convolutional Neural Network Through Network Slimming for Robust Facial Expression Recognition

Facial expression recognition with multi-scale convolution neural network

3D-FERNet: A Facial Expression Recognition Network utilizing 3D information

GCF: Graph Convolutional Networks for Facial Expression Recognition