Feature Level Fusion Of Face And Gait At A Distance

Bir Bhanu,Ju Han

DOI: https://doi.org/10.1007/978-0-85729-124-0_11

2011-01-01

Abstract:Video-based human recognition at a distance remains a challenging problem for the fusion of multi-modal biometrics. As compared to the approach based on match score level fusion (Chap. 10), in this chapter, we present an approach that utilizes and integrates information from side face and gait at the feature level. The features of face and gait are obtained separately using principal component analysis (PCA) from enhanced side face image (ESFI) and gait energy image (GEI), respectively. Multiple discriminant analysis (MDA) is employed on the concatenated features of face and gait to obtain discriminating synthetic features. This process allows the generation of better features and reduces the curse of dimensionality. The proposed scheme is tested using two comparative data sets to show the effect of changing clothes and face changing over time. Moreover, the proposed feature level fusion is compared with the match score level fusion and another feature level fusion scheme. The experimental results demonstrate that the synthetic features, encoding both side face and gait information, carry more discriminating power than the individual biometrics features, and the proposed feature level fusion scheme outperforms the match score level and another feature level fusion scheme. The performance of different fusion schemes is also shown as cumulative match characteristic (CMC) curves. They further demonstrate the strength of the proposed fusion scheme.The chapter is organized as follows. Section 11.2 presents the overall technical approach. It describes feature extraction from ESFI and GEI. It explains the proposed scheme to generate synthetic features for feature level fusion and classification. Section 11.3 provides a description of the related fusion methods [207, 209] to be compared in the experimental section. In Sect. 11.4, a number of dynamic video sequences are tested using the approach presented. Experimental results are compared and discussed. Section 11.5 concludes this chapter.