Abstract:To better understand the expression of human smile, there have been considerable studies about automatic smile detection. Despite all the research, few attention is paid to analyze a smile in a comprehensive way. In this paper, a smile analysis system is presented to detailedly measure a person's smile, which consists of three main modules: smile detection, smile intensity estimation and spontaneous versus posed (SVP) smile recognition. Firstly, our recent proposed feature, Self-Similarity of Gradients (GSS), is employed to detect smiling facial images in unconstrained scenarios. Secondly, the smile intensity is estimated in terms of different facial regions rather than merely the mouth region, which is also applied in the temporal phase segmentation of a smile. Finally, in SVP smile recognition module, a discriminative learning model (DLM) is proposed based on a local spatial-temporal feature, which devotes to obtaining most robust and discriminative patterns of interest. The first two modules are the bases of the last, preparing a deeper understanding of a smile. Experiments on benchmark databases are carried out and compared with the state-of-the-art methods respectively, which validate the advantages of our approach of SVP smile recognition. Moreover, a comprehensive analysis of human smile is given for the first time to the best of our knowledge, which could pave the way for computers that better assess the emotional states of their users and provide useful and important information in helping the research of psychology and behavior science.

Smile detection in unconstrained scenarios using self-similarity of gradients features

A new descriptor of gradients Self-Similarity for smile detection in unconstrained scenarios.

An Efficient Approach to Smile Detection

Smile Detection by Boosting Pixel Differences

Smile detection in the wild based on transfer learning

How Do You Smile? Towards a Comprehensive Smile Analysis System

Facial Smile Detection Based On Deep Learning Features

Smile Recognition Based on Support Vector Machine and Local Binary Pattern

A Novel Feature Extraction Method Using Pyramid Histogram of Orientation Gradients for Smile Recognition

Spontaneous Versus Posed Smile Recognition Via Region-Specific Texture Descriptor and Geometric Facial Dynamics

Spontaneous Versus Posed Smile Recognition Using Discriminative Local Spatial-Temporal Descriptors

Methods of Recognizing True and Fake Smiles by Using Au6 and Au12 in A Holistic Way

Gender identification in unconstrained scenarios using Self-Similarity of Gradients features

Facial Image Smile Detection Based on Multi-class Model Weighted Voting

Distinguishing Posed and Spontaneous Smiles by Facial Dynamics

Real-time human detection based on gentle MILBoost with variable granularity HOG-CSLBP

Facial Expression Recognition Algorithm Based on Brightness Detecting and SVM

Smile Recognition Based on PHOG Feature Extraction and Clustering Feature Selection

Automatic Smile Detection of Infants in Mother-Infant Interaction Via CNN-based Feature Learning

Realistic Smile Expression Recognition Using Biologically Inspired Features

Partially Occluded Head Posture Estimation for 2D Images Using Pyramid HoG Features