Abstract:Facial expression recognition (FER) in the wild is an active and challenging field of research. A system for automatic FER finds use in a wide range of applications related to advanced human–computer interaction (HCI), human–robot interaction (HRI), human behavioral analysis, gaming and entertainment, etc. Since their inception, convolutional neural networks (CNNs) have attained state‐of‐the‐art accuracy in the facial analysis task. However, recognizing facial expressions in the wild with high confidence running on a low‐cost embedded device remains challenging. To this end, this study presents an efficient dual‐channel ensembled deep CNN (DCE‐DCNN) for FER in the wild. Initially, two DCNNs, namely the DCNNG and DCNNS , are trained separately on the grayscale and Scharr‐convolved vertical gradient facial images, respectively. The proposed network later integrates the two pre‐trained DCNNs to obtain the dual‐channel integrated DCNN (DCI‐DCNN). Finally, all three neural networks, namely the DCNNG , DCNNS , and DCI‐DCNN, are jointly fine‐tuned to get a single dual‐channel‐multi‐output model. The multi‐output model produces three prediction scores for the given input facial image. The prediction scores are thus fused using the max‐voting ensemble scheme to obtain the DCE‐DCNN with the final classification label. On the FER2013, RAF‐DB, NCAER‐S, AffectNet, and CKPlus benchmark FER datasets, the proposed DCE‐DCNN consistently outperforms the two individual DCNNs and numerous state‐of‐the‐art CNNs. Moreover, the network achieves competitive recognition accuracy on all four FER in the wild datasets with reduced memory storage size and parameters. The proposed DCE‐DCNN model with high throughput on resource‐limited embedded devices is suitable for applications that seek real‐time classification of facial expressions in the wild with high confidence.

A novel modular deep fully convolutional network for efficient low resolution facial expression recognition

A novel Leaky Rectified Triangle Linear Unit based Deep Convolutional Neural Network for facial emotion recognition

Facial Expression Recognition Using Deep Neural Network

Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy

Facial Expression Recognition System Based On Deep Residual Fusion Neural Network

Deep Facial Expression Recognition Using Transfer Learning and Fine-Tuning Techniques

Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network

Improved facial emotion recognition model based on a novel deep convolutional structure

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

Facial emotion recognition based on deep transfer learning approach

ATTENTION BASED CONVOLUTIONAL NEURAL NETWORK FOR FACIAL EXPRESSION RECOGNITION

Efficient Convolutional Neural Network with Multi-Kernel Enhancement Features for Real-Time Facial Expression Recognition

Facial Expression Recognition Via Region-Based Convolutional Fusion Network.

A Novel Attention Residual Network Expression Recognition Method

Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields

Lightweight Attention Convolutional Neural Network Through Network Slimming for Robust Facial Expression Recognition

A dual‐channel ensembled deep convolutional neural network for facial expression recognition in the wild

An efficient facial emotion recognition system using novel deep learning neural network-regression activation classifier

Expression invariant face recognition based on multi-level feature fusion and transfer learning technique

Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks

Facial emotion recognition using hybrid features-novel leaky rectified triangle linear unit activation function based deep convolutional neural network