Abstract:Emotion plays an important role in communication. For human–computer interaction, facial expression recognition has become an indispensable part. Recently, deep neural networks (DNNs) are widely used in this field and they overcome the limitations of conventional approaches. However, application of DNNs is very limited due to excessive hardware specifications requirement. Considering low hardware specifications used in real-life conditions, to gain better results without DNNs, in this paper, we propose an algorithm with the combination of the oriented FAST and rotated BRIEF (ORB) features and Local Binary Patterns (LBP) features extracted from facial expression. First of all, every image is passed through face detection algorithm to extract more effective features. Second, in order to increase computational speed, the ORB and LBP features are extracted from the face region; specifically, region division is innovatively employed in the traditional ORB to avoid the concentration of the features. The features are invariant to scale and grayscale as well as rotation changes. Finally, the combined features are classified by Support Vector Machine (SVM). The proposed method is evaluated on several challenging databases such as Cohn-Kanade database (CK+), Japanese Female Facial Expressions database (JAFFE), and MMI database; experimental results of seven emotion state (neutral, joy, sadness, surprise, anger, fear, and disgust) show that the proposed framework is effective and accurate.

Recognizing facial expressions at low resolution

Robust Facial Expression Recognition Using Local Binary Patterns

Facial expression recognition based on Local Binary Patterns: A comprehensive study

Learning Discriminative LBP-Histogram Bins for Facial Expression Recognition.

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Face Recognition on Partial and Holistic LBP Features

A face recognition algorithm using local binary patterns and locality preserving projections

An Enhanced LBP Feature Based on Facial Expression Recognition

A novel facial appearance descriptor based on local binary pattern

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Face Recognition Based on Curvelets and Local Binary Pattern Features Via Using Local Property Preservation

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Low-Resolution Face Recognition Via Sparse Representation of Patches

Facial Image Analysis Based on Local Binary Patterns: A Survey

3D Dynamic Facial Expression Recognition Using Low-Resolution Videos

Accurate and robust facial expressions recognition by fusing multiple sparse representation based classifiers.

Features representation by multiple local binary patterns for facial expression recognition

Robust automatic facial expression detection method based on sparse representation plus LBP map

Facial Expression Recognition with LBP and ORB Features

Face detection on partial and holistic LBP features

Local Binary Patterns and Its Application to Facial Image Analysis: A Survey