Research on the improved gesture tracking algorithm in sign language synthesis

Rong Lu,Quanyu Song
DOI: https://doi.org/10.1007/s11227-022-04705-y
IF: 3.3
2022-07-20
The Journal of Supercomputing
Abstract:Sign language synthesis technology is a bridge of communication between deaf and non-deaf people, and has important social value. Sign language recognition is the key to sign language synthesis technology, which is to acquire gesture data containing sign language information through hardware equipment and convert it into corresponding sound or text through relevant technology. The representation of sign language by computer virtual 3D mannequin is sign language synthesis. This paper reports on the construction of a video frame sequence based on interpolation transition video frame to improve the readability of the composition of sign language. Transfer of video frames is traditionally performed via the target tracking algorithm for gesture tracking arithmetic, but this can lead to several tracking errors because of the complexity of the hand background environment, the covering of the hand, multiple perspectives, the great similarity of different sign language words, and the interaction between the hand and other parts of the body. Therefore, in the present paper, in order to improve the accuracy of target tracking, a more accurate gesture tracking method is studied. Particle filter and optical flow algorithms are combined to build a more natural and smooth 3D transition frame image, which makes video-based sign language synthesis more realistic.
computer science, theory & methods,engineering, electrical & electronic, hardware & architecture
What problem does this paper attempt to address?