Expression invariant face recognition based on multi-level feature fusion and transfer learning technique
Kumar, P. M. Ashok,Raj, L. Arun,Sagayam, K. Martin,Ram, N. Sree
DOI: https://doi.org/10.1007/s11042-022-13538-z
IF: 2.577
2022-08-11
Multimedia Tools and Applications
Abstract:Face Recognition is always considered to be one of the attractive areas of study among researchers even today, due to many of its Internet of Things (IoT) applications. Recently deep learning methods gained huge popularity due to its excellent performance in visual identification and classification challenges. However Deep networks has still lot of challenges like expression variations, limited training dataset and network training complexity, which is to be addressed in the field of face recognition. To solve the aforementioned problems, we present a new methodology based on Multi-Level Feature Fusion and Transfer Learning Convolutional Neural Network (MLFFTL-CNN). First, we construct Expression based CNN (E-CNN) classifier with fine tuning of pre-trained VGG-face model on emotion database. During the training phase, we used E-CNN features to fuse at the intermediate layers in the proposed MLFFTL-CNN, then fine-tuned the suggested MLFFTL-CNN model with Neutral/Limited datasets to recognise human faces. In the testing phase, the proposed MLFFTL-CNN model is applied on facial images containing different expressions (belonging to limited dataset) to recognize faces. Experiments were performed out on the Cohn-Kanade Dataset, which is a standard data set containing facial expressions. Our greatest classification accuracy rating in the Cohn-Kanade Dataset is 99.7%. Furthermore, Receiver Operating Characteristic (ROC) curves and Precision-Recall Curves are drawn for the proposed MLFFTL-CNN method and achieves better performance than the state of art algorithms like Light CNN [35], Deep id2 [28], Deep face [29].
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering