Gesture Based Fear Recognition Using Non-Performance Dataset from VR Horror Games

Xinyi Fu,Cheng Xue,Qiuyi Yin,Yu Jiang,Ye Li,Yichen Cai,Weilin Sun
DOI: https://doi.org/10.1109/acii52823.2021.9597450
2021-01-01
Abstract:Emotion recognition is a rising trend in related fields. Existing research mainly aims at the emotion recognition based on single or multi modalities on performance datasets. However, there is little research focusing on gesture-based emotion recognition using non-performance emotional datasets. In this article, we proposed a non-performance emotional data collection scheme using VR to construct a high-quality non-performance dataset in gesture modality with fear labels. Then we proposed an optimized algorithm for gesture-based fear recognition using BLSTM on this dataset with the accuracy of up to 71.43%. Our work could be applied in many domains such as potentially domestic violence detection and VR game evaluation.
What problem does this paper attempt to address?