Abstract:Aiming at the disadvantages of the traditional machine-based facial expression recognition method that eliminates the feature of manual selection, a feature extraction method based on deep convolutional neural network to learn expression features is proposed. Since the deep convolutional neural network can directly use the original image as the input image, the image abstract feature interpretation is obtained at the fully connected layer of the image, which avoids the inherent error of image preprocessing and artificial selection features. Then, we reconstruct the traditional local binary pattern (LBP) feature operator for facial expression image and fuse the abstract facial expression features learned by the deep convolution neural network with the modified LBP facial expression texture features in the full connection layer. A new facial expression feature can be obtained, and the classification accuracy can be improved. In general, for the recognition of facial expression images, the proposed method based on the fusion LBP expression features and convolutional neural network expression features is used to obtain the best performance of 91.28% in the comparative experiment. An efficient extension of the expression feature texture expression channel is carried out. On the other hand, convolutional neural networks have incomparable advantages over other methods in abstract information representation of two-dimensional images.

An Enhanced LBP Feature Based on Facial Expression Recognition

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

Features representation by multiple local binary patterns for facial expression recognition

Feature Representation for Facial Expression Recognition Based on FACS and LBP

LBP feature extraction for facial expression recognition

Facial expression recognition based on Local Binary Patterns: A comprehensive study

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Facial expression recognition method based on deep convolutional neural network combined with improved LBP features

Facial Expression Analysis Using LBP Features

Design and Experiment of Facial Expression Recognition Method Based on LBP and CNN

LBP-like Feature Based on Gabor Wavelets for Face Recognition.

Robust Facial Expression Recognition Using Local Binary Patterns

Face Recognition Based on LBP Algorithm

3D face recognition using local binary patterns

Facial expression recognition with LBP and SLPP combined method

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Automatic facial expression recognition using local binary pattern

Face expression recognition fusion LBP and local sparse represen-tation

A Feature Extraction Method Based on Local Binary Pattern Preprocessing and Wavelet Transform

Extracting Local Binary Patterns From Image Key Points: Application To Automatic Facial Expression Recognition

FACIAL EXPRESSION RECOGNITION BASED ON SPARSE REPRESENTATION AND IMPROVED LBP OPERATOR