Abstract:The fusion of discriminative features and deep autoencoders has received limited attention in the facial expression classification problem. The proposed work aims to improve the classification accuracy of facial expression recognition systems by deriving the abstract, robust, and highly discriminative feature space. The salient contributions of the work are, developing a novel and hybrid distribution by integrating the discriminative information derived from the modified local phase quantization feature and histogram of oriented gradients feature; multi-stage stacked deep convolutional autoencoder (SDCA) is reported to extract the expression-specific latent and highly discriminative feature representation. The analysis of the proposed work is carried out in two phases. In the first phase, the feature representation is derived from the whole face irrespective of the contribution of facial regions to the expression of interest (Holistic approach). The facial regions containing highly discriminative feature for expression classification are identified and features are derived only from salient regions in the second phase (Component-based approach). The work is implemented on the benchmark datasets CK + , KDEF, and JAFFE. The misclassification rates can be effectively reduced by stacking more layers into the SDCA network. Extensive testing reveals that the method achieved a remarkable classification accuracy of 96.7% on CK + , 94.7% on KDEF, and 93.5% on the JAFFE datasets. The empirical results support the effectiveness of the proposed model, demonstrating its improved accuracy in expression classification on benchmark datasets.

Discriminant Auto Encoders for Face Recognition with Expression and Pose Variations

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

Stacked Face De-Noising Auto Encoders for Expression-Robust Face Recognition

Face Recognition Using Novel LDA-Based Algorithms.

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

Constrained Linear Discrimination Analysis and Face Recognition

Face Recognition Using Nonlinear Locality Preserving with Deep Networks.

Collaborative Random Faces-Guided Encoders for Pose-Invariant Face Representation Learning

Facial Expression Recognition Via Learning Deep Sparse Autoencoders.

Fuzzy Linear Regression Discriminant Projection for Face Recognition

Effective discriminant feature extraction framework for face recognition

Generalized discriminant analysis model and its extension for facial expression recognition

Locally Linear Discriminant Embedding: an Efficient Method for Face Recognition

Facial Expression Recognition Based on Discriminant Neighborhood Preserving Nonnegative Tensor Factorization and ELM

Two dimensional nonnegative partial least squares for face recognition

Face Recognition Using a Novel Image Representation Scheme and Multi-Scale Local Features

Identity- and Pose-Robust Facial Expression Recognition Through Adversarial Feature Learning

A Novel Discriminant Criterion with Application to Face Recognition

Expression-Robust 3d Face Recognition Based on Feature-Level Fusion and Feature-Region Fusion

Automatic Facial Expression Recognition Using Modified LPQ and HOG Features with Stacked Deep Convolutional Autoencoders