Abstract:This paper develops a hybrid feature space by integrating the discriminative power of HOG and LBP feature distributions derived from the salient facial regions. Also, a novel feature space is developed by integrating the hybrid feature space derived from the expressive and neutral face images to further amplify the discriminative power of the feature descriptor. A three‐stage stacked deep convolutional autoencoder (SDCA) derives the abstract representation and MSVM for multi‐class classification. To test its generalization power, the proposed work is implemented on three benchmark datasets (CK+, JAFFE, and KDEF). In automatic facial expression recognition (AFER) systems, modelling the spatio‐temporal feature information in a specific manner, coalescing, and its effective utilization is challenging. The state‐of‐the‐art studies have examined integrating multiple features to enhance the recognition rate of AFER systems. However, the feature variations between expressive and neutral face images are not fully explored to identify the expression class. The proposed research presents an innovative approach to AFER by modelling appearance variations in both expressive and neutral face images. The prominent contributions of the work are developing a novel and hybrid feature space by integrating the discriminative feature distribution derived from expressive and neutral face images; preserving the highly discriminative latent feature distribution using autoencoders. Local binary pattern (LBP) and histogram of oriented gradients (HOG) are the feature descriptors employed to derive the discriminative texture and shape information, respectively. The component‐based approach is employed, wherein the features are derived from the salient facial regions instead of the whole face. The three‐stage stacked deep convolutional autoencoder (SDCA) and multi‐class support vector machine (MSVM) are employed to address dimensionality reduction and classification, respectively. The efficacy of the proposed model is substantiated by empirical findings, which establish its superiority in terms of accuracy in AFER tasks on widely recognized benchmark datasets.

HDG and HDGG: an extensible feature extraction descriptor for effective face and facial expressions recognition

Robust Feature Extracted by the Generalized Optimal Discriminant Vectors for Face Recognition

Human vision inspired feature extraction for facial expression recognition

Face recognition with the robust feature extracted by the generalized Foley-Sammon transform

Face Recognition Using Novel LDA-Based Algorithms.

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Facial Expression Recognition Based on Gabor Feature and Adaboost

Modified feature extraction techniques to enhance face and expression recognition

Expression-independent Face Recognition Based on Higher-Order Singular Value Decomposition

Discriminant Gaborfaces and Support Vector Machines Classifier for Face Recognition

Expressing Facial Structure and Appearance Information in Frequency Domain for Face Recognition

Facial expression recognition using histogram of oriented gradients based transformed features

Efficient Human Face Recognition Based on Shape and Texture

Gravitational search algorithm based optimized deep learning model with diverse set of features for facial expression recognition

Facial Expression Recognition Based On Gabor Wavelet Transform And Histogram Of Oriented Gradients

A hybrid approach for face recognition using a convolutional neural network combined with feature extraction techniques

Hadoop Small Image Processing Technology Based on Big Data Processing and Its Application Effect in Face Feature Extraction and Face Recognition System Design

Feature Extraction Method Based on the Generalised Fisher Discriminant Criterion and Facial Recognition

A new descriptor of gradients Self-Similarity for smile detection in unconstrained scenarios.

Modelling appearance variations in expressive and neutral face image for automatic facial expression recognition