Abstract:The aim of this research is to develop efficient algorithms for facial image analysis. Our research focuses on three areas: face recognition, illumination models and compensation, and facial expression recognition. We have proposed two methods for face recognition under various conditions: Elastic Shape-Texture Matching (ESTM) and Doubly nonlinear mapping kernel Principal Component Analysis (DKPCA). ESTM uses not only the shape information but also the texture information in comparison of two faces without establishing any precise pixel-wise correspondence. DKPCA proposes a doubly nonlinear mapping kernel PCA to perform feature transformation and face recognition, which not only considers the statistical property of the input features, but also emphasizes those important facial feature points. We also investigate and propose two model-based methods for modeling illumination on the human face. The first method can compensate for the uneven illuminations on human faces and reconstruct face images in normal lighting conditions, where a 2D face shape model is used to obtain a shape-free texture image. The second illumination compensation method aims to reduce or even remove the effect of these factors. In this method, a local normalization technique is applied to an image, which can effectively and efficiently eliminate the effect of uneven illuminations. We have also presented an efficient method for facial expression recognition. We first propose a representation model for facial expressions, namely spatially maximum occurrence model (SMOM). The ESTM algorithm is then used to measure the similarity between images for facial expression recognition. By combining SMOM and ESTM, the algorithm is called SMOM-ESTM and can achieve a higher recognition performance level. To reduce the computational complexity when face recognition is applied to a large-scale database, it is necessary to filter the large database to form a smaller one that contains face images similar to the query input. Therefore, we propose an efficient indexing structure for searching a human face in a large database, which can produce a condensed database including the target image and therefore reduce the search time.

A new approach to appearance-based face recognition

Face recognition using laplacianfaces.

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Gabor Wavelets Transform and Extended Nearest Feature Space Classifier for Face Recognition

Face Recognition Using Gabor-based Complete Kernel Fisher Discriminant Analysis with Fractional Power Polynomial Models

Robust 3D Face Recognition by Local Shape Difference Boosting

Face Recognition Based on Curvelets and Local Binary Pattern Features Via Using Local Property Preservation

Face Image Analysis and Its Applications

Face Recognition under Occlusions and Variant Expressions with Partial Similarity

Robust Facial Expression Recognition Using Local Binary Patterns

Heterogeneous Face Recognition: A Common Encoding Feature Discriminant Approach

Expressing Facial Structure and Appearance Information in Frequency Domain for Face Recognition

2D Gaborface Representation Method for Face Recognition with Ensemble and Multichannel Model.

Face Recognition Based on Face‐specific Subspace

Efficient Human Face Recognition Based on Shape and Texture

Fusing Local Patterns of Gabor and Non-subsampled Contourlet Transform for Face Recognition

Patch Based Collaborative Representation with Gabor Feature and Measurement Matrix for Face Recognition

Local Gabor Binary Pattern Histogram Sequence (LGBPHS): a Novel Non-Statistical Model for Face Representation and Recognition

Modified feature extraction techniques to enhance face and expression recognition

Local Gabor Binary Patterns Based on Mutual Information for Face Recognition

A new approach for small sample face recognition with pose variation by fusing Gabor encoding features and deep features