Sleep Gesture Detection In Classroom Monitor System

Wen Li,Fei Jiang,Ruimin Shen
DOI: https://doi.org/10.1109/ICASSP.2019.8683116
2019-01-01
Abstract:This paper proposes a novel method to detect sleep persons in real classroom scenes, which is useful for detecting the attention of students. There are several challenges for sleep gesture detection, including occlusion, various sleep gestures, interference terms with similar features like writing, and small sleep gesture targets. To solve these challenges, we first build a sleep gesture dataset from hundreds of real classes among schools in Shanghai. Second, to detect sleep gestures we propose a modified R-FCN integrated with feature pyramid and deformable convolution. Moreover, we design an efficient local multiscale testing algorithm to address small sleep gesture detection. Experiments on our sleep dataset have shown that our approach significantly outperforms the basic R-FCN and reaches 0.74 AP@0.5. Especially, for small-size sleep gestures, our method gets an impressive improvement at 90% on our hard-samples dataset with just little additional time consumption. Besides, experiments on a large number of real video streams have proven our algorithm is applicable in real classroom scenes.
What problem does this paper attempt to address?