A deep-learning-based facial expression recognition method using textural features

Moutan Mukhopadhyay,Aniruddha Dey,Sayan Kahali
DOI: https://doi.org/10.1007/s00521-022-08005-7
2022-11-22
Neural Computing and Applications
Abstract:Human facial expression and emotion play pivotal roles in our day-to-day communication, and detecting them are one of the formidable tasks in the field of human–computer interfaces (HCI). This paper presents a new facial expressions detection method by exploiting textural image features such as local binary patterns (LBP), local ternary patterns (LTP) and completed local binary pattern (CLBP). This paper utilizes the advantages of textural features which are highly correlated with the facial expression changes and thereby trains a convolution neural network (CNN) model to detect facial expressions. The CNN model is trained on the images from the extended Cohn-Kanade (CK +), JAFEE and FER2013 datasets that are converted into LBP, LTP and CLBP image features. The performance of our facial expression recognition system is validated on modified CK+, JAFEE and FER2013 dataset. The results reported here illustrates that the CNN model yields better efficiency when we train the model with textural images. Moreover, we have shown that the CNN model trained with CLBP outperforms than that of with LBP and LTP images. In case of CLBP images, accuracies are 91.0%, 82.2% and 64.5% for CK+, JAFFE and FER2013 dataset, respectively. In case of LBP, accuracies are 79.5%, 75% and 58.45% and in case of LTP images accuracies are 89.2%, 77.3% and 62.79% for the datasets CK+, JAFFE and FER2013, respectively.
computer science, artificial intelligence
What problem does this paper attempt to address?