Abstract:The aim of this research is to develop efficient algorithms for facial image analysis. Our research focuses on three areas: face recognition, illumination models and compensation, and facial expression recognition. We have proposed two methods for face recognition under various conditions: Elastic Shape-Texture Matching (ESTM) and Doubly nonlinear mapping kernel Principal Component Analysis (DKPCA). ESTM uses not only the shape information but also the texture information in comparison of two faces without establishing any precise pixel-wise correspondence. DKPCA proposes a doubly nonlinear mapping kernel PCA to perform feature transformation and face recognition, which not only considers the statistical property of the input features, but also emphasizes those important facial feature points. We also investigate and propose two model-based methods for modeling illumination on the human face. The first method can compensate for the uneven illuminations on human faces and reconstruct face images in normal lighting conditions, where a 2D face shape model is used to obtain a shape-free texture image. The second illumination compensation method aims to reduce or even remove the effect of these factors. In this method, a local normalization technique is applied to an image, which can effectively and efficiently eliminate the effect of uneven illuminations. We have also presented an efficient method for facial expression recognition. We first propose a representation model for facial expressions, namely spatially maximum occurrence model (SMOM). The ESTM algorithm is then used to measure the similarity between images for facial expression recognition. By combining SMOM and ESTM, the algorithm is called SMOM-ESTM and can achieve a higher recognition performance level. To reduce the computational complexity when face recognition is applied to a large-scale database, it is necessary to filter the large database to form a smaller one that contains face images similar to the query input. Therefore, we propose an efficient indexing structure for searching a human face in a large database, which can produce a condensed database including the target image and therefore reduce the search time.

Kernel-Based Multifactor Analysis for Image Synthesis and Recognition

Facial Expression Synthesis and Recognition Using a Kernel-Based Factorization Model

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

Multi-View Face Image Synthesis Using Factorization Model

Facial expressive image analysis by using nonlinear factorization model.

Self-representative kernel concept factorization

An ICA-Based Other-Race Effect Elimination for Facial Expression Recognition.

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Tied Factors Analysis for High-Dimensional Image Feature Extraction and Recognition Application

Improved kernel direct Fisher discriminant analysis and face recognition

A Robust Face and Ear Based Multimodal Biometric System Using Sparse Representation

Kernel Nonnegative Matrix Factorization Without the Curse of the Pre-image - Application to Unmixing Hyperspectral Images

An approach to facial expression recognition integrating radial basis function kernel and multidimensional scaling analysis

Multiple Riemannian Manifold-valued Descriptors based Image Set Classification with Multi-Kernel Metric Learning

Mutual Component Analysis for Heterogeneous Face Recognition.

Coupled kernel embedding for low resolution face image recognition

Face Image Analysis and Its Applications

Multi-attribute balanced dataset generation framework AutoSyn and KinFace Channel-Spatial Feature Extractor for kinship recognition

Kernelized Sparse Bayesian Matrix Factorization

<Bold>An Implementation Framework For Kernel Methods With High-Dimensional Patterns</Bold>

A unified SWSI-KAMs framework and performance evaluation on face recognition