Abstract:Chinese Sign Language (CSL) offers the main means of communication for the hearing impaired in China. Sign Language Recognition (SLR) can shorten the distance between the hearing-impaired and healthy people and help them integrate into the society. Therefore, SLR has become the focus of sign language application research. Over the years, the continuous development of new technologies provides a source and motivation for SLR. This paper aims to cover the most recent approaches in Chinese Sign Language Recognition (CSLR). With a thorough review of superior methods from 2000 to 2019 in CSLR researches, various techniques and algorithms such as scale-invariant feature transform, histogram of oriented gradients, wavelet entropy, Hu moment invariant, Fourier descriptor, gray-level co-occurrence matrix, dynamic time warping, principal component analysis, autoencoder, hidden Markov model (HMM), support vector machine (SVM), random forest, skin color modeling method, k-NN, artificial neural network, convolutional neural network (CNN), and transfer learning are discussed in detail, which are based on several major stages, that is, data acquisition, preprocessing, feature extraction, and classification. CSLR was summarized from some aspect as follows: methods of classification and feature extraction, accuracy/performance evaluation, and sample size/datasets. The advantages and limitations of different CSLR approaches were compared. It was found that data acquisition is mainly through Kinect and camera, and the feature extraction focuses on hand’s shape and spatiotemporal factors, but ignoring facial expressions. HMM and SVM are used most in the classification. CNN is becoming more and more popular, and a deep neural network-based recognition approach will be the future trend. However, due to the complexity of the contemporary Chinese language, CSLR generally has a lower accuracy than other SLR. It is necessary to establish an appropriate dataset to conduct comparable experiments. The issue of decreasing accuracy as the dataset increases needs to resolve. Overall, our study is hoped to give a comprehensive presentation for those people who are interested in CSLR and SLR and to further contribute to the future research.

Study on Translating Chinese into Chinese Sign Language

Machine Translation Oriented Understanding and Synthesis of Chinese Sign Language

A Method to Synthesize Chinese Sign Language Based on Virtual Human Technologies

Human-Computer Chinese Sign Language Interaction System

A Fast Sign Word Recognition Method for Chinese Sign Language

A two-way translation system of Chinese sign language based on computer vision

American Sign Language Translation Using Wearable Inertial and Electromyography Sensors for Tracking Hand Movements and Facial Expressions

Improvement of Chinese sign language translation system based on collaboration of arm and finger sensing nodes

Sign language translation system based on micro-inertial measurement units and ZigBee network

HandTalker II: a Chinese sign language recognition and synthesis system

SignFind: A Synchronized Sign Language and Chinese Character Teaching Game for Chinese Deaf Children Using Gesture Recognition

Deep Learning Methods for Sign Language Translation

Generalizations of Wearable Device Placements and Sentences in Sign Language Recognition With Transformer-Based Model

A Survey on Artificial Intelligence in Chinese Sign Language Recognition

CSLDS: Chinese Sign Language Dialog System

Chinese Sign Language Recognition Based on DTW-Distance-Mapping Features

Building Language Communication between Deaf People and Hearing Society through Multimodal Human-Computer Interface

A Study of Bilingual Sign Translation——Theory and Method

Improving Sign Language Translation with Monolingual Data by Sign Back-Translation

Exploring the Impact of Emotional Voice Integration in Sign-to-Speech Translators for Deaf-to-Hearing Communication

A Sign Language Recognition System Applied to Deaf-Mute Medical Consultation