Abstract:This paper proposes a regional adaptive correlation network (RACN) to explore more effective description of structural information of faces and enrich the expression feature representation. The network consists of two branches. The proposed second‐order regional correlation network (SRCN) is composed of autocorrelation matrix calculation modules and network layers, and the obtained regional correlation features are united with the global features extracted from the parallel branch; finally, expression classification is performed after assigning weights to the features of both branches through a channel attention mechanism. To address the problem that the features extracted by CNN‐based facial expression recognition (FER) do not consider structural information, a region adaptive correlation deep network (RACN) is proposed. The network consists of two branches. In one branch, the features obtained by applying CNN to facial sub‐blocks are used as the input of the proposed second‐order region correlation network (SRCN), which obtains structural features by adaptively learning the correlation of facial regions. Furthermore, they are fused with the parallel branch‐extracted global features to obtain a comprehensive high‐semantic feature representation. Finally, weights are assigned to the two features through the channel attention mechanism for more accurate expression classification. Experimental results show that our method can effectively extract expression features in an end‐to‐end manner, improve the accuracy of FER, and achieve competitive performance without relying on any a priori knowledge. And the region‐adaptive correlation feature extraction branch RACN can be applied to other deep learning networks to extract discriminative structural‐adaptive features. To the best of our knowledge, our work is the first to enrich the feature representation for end‐to‐end static FER by adaptively obtaining more discriminative regional adaptive correlation feature vectors via the autocorrelation matrix combined with CNN compared to the existing literature.

Robust Facial Expression Recognition Using Revised Canonical Correlation

Facial Expression Recognition Based on Modular Two Dimensional Canonical Correlation Analysis

Facial Expression Recognition Using Spectral Supervised Canonical Correlation Analysis

Facial Expression Recognition Using Kernel Canonical Correlation Analysis (KCCA)

Improving CCA Via Spectral Components Selection for Facial Expression Recognition

Capturing Correlations among Facial Parts for Facial Expression Analysis.

Two-Dimensional Canonical Correlation Analysis and Its Application to Face Recognition

Automatic Analysis of Facial Expressions Based on Deep Covariance Trajectories

Facial expression recognition based on regional adaptive correlation

Sparse Representation Based Discriminative Canonical Correlation Analysis for Face Recognition

Facial Expression Recognition Considering Individual Differences in Facial Structure and Texture.

Orthogonal Canonical Correlation Analysis and Its Application in Feature Fusion

Real-Time Facial Expression Recognition Based on Attention Mechanism

Fuzzy Label Canonical Correlation Analysis and Its Application to Face Recognition

Facial Expression Recognition Via Region-Based Convolutional Fusion Network.

Facial Expression Recognition-You Only Look Once-Neighborhood Coordinate Attention Mamba: Facial Expression Detection and Classification Based on Neighbor and Coordinates Attention Mechanism

Facial expression recognition based on fuzzy-LDA/CCA

Local and Correlation Attention Learning for Subtle Facial Expression Recognition

Feature Extraction Based on Canonical Correlation Analysis Using FMEDA and DPA for Facial Expression Recognition with RNN

Facial Expression Recognition Using Local Binary Covariance Matrices

Learning Parallel Canonical Correlations for Scale-Adaptive Low Resolution Face Recognition