Abstract:To achieve decision‐level fusion of multi‐regional features and highlight the credibility of different regional evidences, a facial expression recognition method based on multi‐regional evidence fusion is proposed. A block histogram of gradient Gabor features in three regions, namely eyebrows, eyes, and mouth, is extracted from a facial image and regarded as evidence in expression classification. Then, category membership and regional contribution are solved with the region‐weighted semisupervised fuzzy c‐means clustering algorithm to construct initial basic probability assignment (BPA) and emphasize the importance of different evidences, respectively. The initial BPA of evidence is further reassigned by combining region contribution and evidence supportability to reduce evidential conflict. Finally, the final decision‐level fusion of multi‐regional evidences is obtained based on the Dempster–Shafer (D–S) combination rule. The experimental results for the Cohn–Kanade expression database show that the BPA construction method based on category‐membership degree and the reassignment strategy based on region contribution and evidence supportability improves the recognition rate and maintains good robustness for all types of expressions. Compared with existing decision‐level fusion strategies and classification methods, the proposed recognition framework based on D–S evidences theory has the advantages in recognition performance and reliability, particularly in increasing the recognition rate for expressions that are difficult to distinguish, such as fear, sadness, and disgust. © 2016 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.

Expression Recognition Method Based on Evidence Theory and Local Texture.

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Facial Expression Recognition Based on Multi‐regional D–S Evidences Theory Fusion

Expression Recognition Based on Fusion Features Extraction and LLE Method

Dual-modality Emotion Recognition Model Based on Temporal-spatial LBP Moment and Dempster-Shafer Evidence Fusion

Object recognition method based on multi-feature fusion of D-S evidence theory

Facial Expression Recognition Using a New Image Representation and Multiple Feature Fusion.

Feature Representation for Facial Expression Recognition Based on FACS and LBP

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Based on local feature region fusion of facial expression recognition

Feature Fusion Of Hog And Wld For Facial Expression Recognition

CLASSIFIER FUSION BASED ON EVIDENCE THEORY AND ITS APPLICATION IN FACE RECOGNITION

Facial Expression Recognition by Fusing Local Facial Regions

Facial expression recognition based on combination of global and local expression recognitions

Features representation by multiple local binary patterns for facial expression recognition

Face Recognition Algorithm Using Multiple Feature Fusion Based on Evidence Reasoning

Fusion of Multiple Facial Regions for Expression-Invariant Face Recognition

Facial Expression Recognition Based on the Fusion of Spatio-temporal Features in Video Sequences

Facial Expression Recognition Based on Local–global Information Reasoning and Spatial Distribution of Landmark Features

Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern