Sign Language Recognition from Digital Videos Using Deep Learning Methods

Jia Lu,Minh Nguyen,Wei Qi Yan
DOI: https://doi.org/10.1007/978-3-030-72073-5_9
2021-01-01
Abstract:In this paper, we investigate the state-of-the-art deep learning methods for sign language recognition. In order to achieve this goal, Capsule Network (CapsNet) is proposed in this paper, which shows positive result. We also propose a Selective Kernel Network (SKNet) with attention mechanism in order to extract spatial information. Sign language as an important means of communications, the problems of recognizing sign language from digital videos in real time have become the new challenge of this research field. The contributions of this paper are: (1) The CapsNet attains the accuracy of overall recognition up to 98.72% based on our own dataset. (2) SKNet with attention mechanism is able to achieve the best recognition accuracy 98.88%.
What problem does this paper attempt to address?