Abstract:Facial expression recognition is crucial in analyzing an individual's emotional state. Ensemble pruning becomes essential to enhance the effectiveness of this recognition by selecting appropriate classifiers from a pool of base classifiers. However, outliers and noise within the classifiers can adversely affect the final recognition results and the generalization performance of the selected subset of classifiers. Additionally, effectively combining accuracy and low redundancy of base classifiers remains a challenging problem that requires further investigation. In this paper, we propose a novel algorithm called Pairwise Dependency-based Robust Ensemble Pruning (PDREP) to address these issues. The PDREP algorithm treats the predicted results of classifiers for sample instances as features of the classifier and evaluates their dependencies between pairs of classifiers using mutual information. By incorporating this dependency measure into the regression-based objective equation, we can assess the redundancy of a subset of base classifiers and prune redundant classifiers. We use the -norm in PDREP's objective equation to perform robust classifier pruning while considering the base classifiers' dependencies and accuracy. Furthermore, we introduce weight control parameters to balance accuracy and dependencies, facilitating the elimination of ineffective and redundant classifiers. The results show significant improvements when evaluating the proposed method's recognition accuracy on five public face sentiment datasets (FER2013, JAFFE, CK+, RaFD, and KDEF). Specifically, the proposed method achieves 3.15%, 9.39%, 1.72%, 3.70%, and 4.70% higher accuracy than integrating all base classifiers, respectively. Extensive experiments conducted on five facial expression datasets demonstrate that the proposed method consistently outperforms existing state-of-the-art ensemble pruning algorithms in most cases.

Diversity Regularized Ensemble Pruning.

An Integrated Pruning Criterion for Ensemble Learning Based on Classification Accuracy and Diversity.

Margin distribution and structural diversity guided ensemble pruning

When does Diversity Help Generalization in Classification Ensembles?

Ensemble Pruning: A Submodular Function Maximization Perspective.

Diversity regularized machine

Dynamically building diversified classifier pruning ensembles via canonical correlation analysis

On the Diversity-Performance Relationship for Majority Voting in Classifier Ensembles.

Pareto Ensemble Pruning

An optimal pruning algorithm of classifier ensembles: dynamic programming approach

Hierarchical Pruning of Deep Ensembles with Focal Diversity

Developing parsimonious ensembles using ensemble diversity within a reinforcement learning framework

Learning to Diversify via Weighted Kernels for Classifier Ensemble

A Unified Theory of Diversity in Ensemble Learning

A Probabilistic Ensemble Pruning Algorithm

Ensemble Pruning Via Constrained Eigen-Optimization

Interpretability Diversity for Decision-Tree-Initialized Dendritic Neuron Model Ensemble

Predictive Ensemble Pruning by Expectation Propagation

Ensemble Learning through Diversity Management: Theory, Algorithms, and Applications

An ensemble pruning method considering classifiers' interaction based on information theory for facial expression recognition

Pairwise dependency-based robust ensemble pruning for facial expression recognition