A Survey on Neural Machine Translation Applied to Sign Language Generation

Yue Zhang,Lihong Cao
DOI: https://doi.org/10.1109/icaml54311.2021.00093
2021-01-01
Abstract:Sign languages are the primary medium of communication for the deaf and hearing-impaired community, and the number of human beings with hearing impairment is increasing at a rapid rate. There is a significant communication barrier between the hearing-impaired and normal-hearing communities. One solution to this issue is to offload the effort of text understanding for the deaf and hearing-impaired community in the form of Sign Language Generation (SLG). In this paper, first of all, we systematically review the mainstream Neural Machine Translation (NMT)-based SLG approaches. Specifically, according to their model architectures, we divide them into two categories: the Recurrent Neural Networks (RNNs)-based and Transformer-based models, and discuss their advantages and limitations. Next, we introduce the existing publicly available datasets and the data preprossessing methods in the field of SLG. Then, we summarize the performance evaluation methods for NMT-based SLG models. Finally, we offer two possible future research directions for better development in the field of SLG.
What problem does this paper attempt to address?