Abstract:This paper proposes a semantic concept method to recognize multi-ethnic people based on Axiomatic fuzzy set (AFS) theory with application to image analysis. There are two advantages of the proposed approach: (i) It can convert the facial features to semantic concepts and in such a way we bridge the semantic gap between low level pixel features and interpretable concepts. (ii) It can implement the logical operation of semantic concepts in the AFS framework. Technically, we first construct facial features utilizing the facial landmarks such as eyes, nose, mouth, and face contour. Second, we establish some corresponding semantic concepts to describe facial features. Finally, a set of the semantic concept rules are extracted to form a classifier aimed at identifying facial ethnic attributes. The efficacy of the proposed approach is verified on Chinese Multi-ethnic face database (CMFD), FEI and CK[Formula: see text]. Meanwhile, we first demonstrate that the selected features have two obvious advantages: (1) these features can achieve better performance for ethical recognition than the features based on pixel values directly. (2) The selected features can be obtained via facial landmark detector regardless of the image resolutions. Then, we compare the proposed approach with some existing classifiers using the selected features, such as principal component analysis (PCA), C4.5, Decision table, Cart, Fuzzy Decision Tree (FDT) and Repeated Incremental Pruning to Produce Error Reduction (Ripper), extensive experiments show that our method exhibits a similar performance with these methods, which is demonstrated by Friedman test, however, our proposed approach can provide interpretability and comprehension capability.

Semantic and case-based reasoning for facial expression recognition

3D facial expression recognition method based on bimodal and semantic knowledge

A novel facial expression recognition method based on semantic knowledge of analytical hierarchy process

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

Hierarchical Co-Consistency Quantization and Information Refining Binary Network for Facial Expression Recognition in Human–Robot Interaction

Facial Expressions Recognition Based on Cognition and Mapped Binary Patterns.

Facial Expression Recognition Algorithm Based on Brightness Detecting and SVM

A Novel Semantic Approach for Multi-Ethnic Face Recognition

Facial Expression Recognition Based on Semantic Patches

Semantic Knowledge Based On Fuzzy System For Describing Facial Expression

Semantic-Rich Facial Emotional Expression Recognition

Method of Facial Expression Recognition Based on Coarse-to-fine Classification

Recognition of Facial Expression Based on CNN-CBP Features

Facial Expression Recognition Based on Local Binary Patterns and Coarse-to-fine Classification

Facial Expression Recognition Through Modeling Age-Related Spatial Patterns.

Facial Expression Recognition Using a Semantic-Based Bottleneck Attention Module

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

3D Facial Expression Recognition Algorithm Using Local Threshold Binary Pattern and Histogram of Oriented Gradient

An efficient facial emotion recognition system using novel deep learning neural network-regression activation classifier

Facial Expression Recognition Based on Data Field