Emotion Analysis Based on Facial Expression Recognition in Smart Learning Environment

Bo Sun,Yongna Liu,Jiubing Chen,Jihong Luo,Di Zhang

DOI: https://doi.org/10.3969/j.issn.1009-5195.2015.02.010

2015-01-01

Abstract:Emotion has many relative connections with cognition. Affective states in learning have certain influence on learning effect. Learners' emotion analysis in smart learning environment is beneficial to smart learning. At present, locating human face in complex background has already been actualized by face detective technology, and some available algorithms have also been applied to expression classification. Hence, the research into expression feature extraction has become the major issue in the expression recognition area. The feature extracted by existing methods is the combination of individual's facial feature and expressional feature, which greatly obstruct the expression recognition. In an optimal situation, the related individual facial feature can be separated during the process of expression recognition. According to FACS (Facial Action Coding System) proposed by Ekman, a famous psychologist, we constructed an emotion analysis framework based on facial expression recognition in smart learning environment. We used feature decomposition method to decompose the facial feature and the expressional feature into face subspace and expression subspace respectively. After that, expression recognition will be done in the expression subspace and the interference of facial features will be eliminated. Experimental results on JAFFE database suggest that our method is effective. Facial expression recognition for emotional intervention has been performed in Magic Learning, which is an emotional interaction subsystem between learners and virtual teachers in 3D virtual learning environment.