Abstract:Automatic facial action unit detection from video is a long-standing problem in facial expression analysis. Research has focused on registration, choice of features, and classifiers. A relatively neglected problem is the choice of training images. Nearly all previous work uses one or the other of two standard approaches. One approach assigns peak frames to the positive class and frames associated with other actions to the negative class. This approach maximizes differences between positive and negative classes, but results in a large imbalance between them, especially for infrequent AUs. The other approach reduces imbalance in class membership by including all target frames from onsets to offsets in the positive class. However, because frames near onsets and offsets often differ little from those that precede them, this approach can dramatically increase false positives. We propose a novel alternative, dynamic cascades with bidirectional bootstrapping (DCBB), to select training samples. Using an iterative approach, DCBB optimally selects positive and negative samples in the training data. Using Cascade Adaboost as basic classifier, DCBB exploits the advantages of feature selection, efficiency, and robustness of Cascade Adaboost. To provide a real-world test, we used the RU-FACS (a.k.a. M3) database of nonposed behavior recorded during interviews. For most tested action units, DCBB improved AU detection relative to alternative approaches.

Towards the Optimal Training of Cascades of Boosted Ensembles

On the Design of Cascades of Boosted Ensembles for Face Detection

LACBoost and FisherBoost: Optimally Building Cascade Classifiers

Optimally Training a Cascade Classifier

Improving Detector Of Viola And Jones Through Svm

Boosted Cascade of Scattered Rectangle Features for Object Detection.

Efficiently Learning a Detection Cascade with Sparse Eigenvectors

Face Detection Based on Minimum Feature Number Expectation

Training Effective Node Classifiers for Cascade Classification

Dynamic Cascades For Face Detection

Boosting 2-Thresholded Weak Classifiers over Scattered Rectangle Features for Object Detection.

Learning A Rare Event Detection Cascade by Direct Feature Selection

Training Boosting-Like Algorithms with Semi-Supervised Subspace Learning

Two-Stage Multi-Class Adaboost for Facial Expression Recognition

Dynamic Cascades with Bidirectional Bootstrapping for Action Unit Detection in Spontaneous Facial Behavior

BoostTree and BoostForest for Ensemble Learning

Hybrid Cascade of Active/lazy Boosting

Fast Asymmetric Learning for Cascade Face Detection

Z-Adaboost: Boosting 2-thresholded weak classifiers for object detection

Submodular Asymmetric Feature Selection in Cascade Object Detection.