Sign Language Recognition Using Microsoft Kinect

Simran Kaur,Akshit Gupta,Ashutosh Aggarwal,Deepak Gupta,Ashish Khanna
DOI: https://doi.org/10.1007/978-981-15-5113-0_51
2020-08-02
Abstract:Sign language is a language used by people with hearing impairments to communicate using gestures. Hand motion is one of the strategies utilized in gesture-based communication. Through the years, many researchers have put forth their models for automatic sign language recognition. The use of an RGB camera for recognition was a development, some of the models required signers to wear cyber gloves, etc., for ease in recognition. Despite the fact that the utilization of gesture-based communication is mainstream among the hard of hearing individuals yet different groups do not attempt to learn it, this hinders communication and thus turns into a reason for the disconnection of certain groups in society. There is a necessity of a framework that can encourage a method for communication between these two groups. This paper provides a model that overcomes issues with using just an RGB camera. The framework makes use of Kinect, an RGB camera and a depth sensor. The model was developed using a convolutional neural network.
What problem does this paper attempt to address?