Abstract:This paper develops a hybrid feature space by integrating the discriminative power of HOG and LBP feature distributions derived from the salient facial regions. Also, a novel feature space is developed by integrating the hybrid feature space derived from the expressive and neutral face images to further amplify the discriminative power of the feature descriptor. A three‐stage stacked deep convolutional autoencoder (SDCA) derives the abstract representation and MSVM for multi‐class classification. To test its generalization power, the proposed work is implemented on three benchmark datasets (CK+, JAFFE, and KDEF). In automatic facial expression recognition (AFER) systems, modelling the spatio‐temporal feature information in a specific manner, coalescing, and its effective utilization is challenging. The state‐of‐the‐art studies have examined integrating multiple features to enhance the recognition rate of AFER systems. However, the feature variations between expressive and neutral face images are not fully explored to identify the expression class. The proposed research presents an innovative approach to AFER by modelling appearance variations in both expressive and neutral face images. The prominent contributions of the work are developing a novel and hybrid feature space by integrating the discriminative feature distribution derived from expressive and neutral face images; preserving the highly discriminative latent feature distribution using autoencoders. Local binary pattern (LBP) and histogram of oriented gradients (HOG) are the feature descriptors employed to derive the discriminative texture and shape information, respectively. The component‐based approach is employed, wherein the features are derived from the salient facial regions instead of the whole face. The three‐stage stacked deep convolutional autoencoder (SDCA) and multi‐class support vector machine (MSVM) are employed to address dimensionality reduction and classification, respectively. The efficacy of the proposed model is substantiated by empirical findings, which establish its superiority in terms of accuracy in AFER tasks on widely recognized benchmark datasets.

Expression-independent Face Recognition Based on Higher-Order Singular Value Decomposition

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Symmetrical Singular Value Decomposition Representation for Pattern Recognition

Person-Independent Facial Expression Recognition Based on Person-Similarity Weighted Distance

Weight-Adapted Convolution Neural Network for Facial Expression Recognition in Human–Robot Interaction

Fast communication: Dominant singular value decomposition representation for face recognition

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Feature Decomposition and Reconstruction Learning for Effective Facial Expression Recognition

A facial expression recognition method based on supervised Isomap

Expression Recognition Based on Variant Sampling Method and Gabor Features

Modelling appearance variations in expressive and neutral face image for automatic facial expression recognition

Singular Value Decomposition Based Virtual Representation for Face Recognition

Dual-channel feature disentanglement for identity-invariant facial expression recognition

Non-frontal view facial expression recognition based on ergodic hidden Markov model supervectors

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

Modified feature extraction techniques to enhance face and expression recognition

Expression recognition from 3D dynamic faces using robust spatio-temporal shape features

Facial Expression Recognition Using Double-Stage Sample-Selected SVM