Optimal feature selection and classification of Indian classical dance hand gesture dataset

R. Jisha Raj,Smitha Dharan,T. T. Sunil
DOI: https://doi.org/10.1007/s00371-022-02572-5
IF: 2.835
2022-06-27
The Visual Computer
Abstract:Classical dancers all over the world use various body gestures to communicate to the audience the intended meaning. The study of these gestures can help in better understanding of the dance forms and also for annotation purposes. Bharatanatyam, an Indian classical dance, uses elegant hand gestures (mudras), facial expressions and body movements to convey the meaning to the audience. There are 28 Asamyukta Hastas (single-hand gestures) and 23 Samyukta Hastas (double-hand gestures) in Bharatanatyam. Open datasets on Bharatanatyam dance gestures are not presently available. An exhaustive open dataset of 15,396 distinct single-hand gesture images and 13,035 distinct double-hand gesture images was created. In this paper, we intend to find an optimal feature descriptor for this dataset. Various feature descriptors like scale-invariant feature transform (SIFT), speeded-up robust features (SURF), oriented FAST and rotated BRIEF (ORB), KAZE, KAZE extended, accelerated-KAZE (A-KAZE), binary robust invariant scalable keypoints (BRISK) and SIKA were explored. The feature descriptors were coded using bag of visual words and classified using several classifiers like support vector machines (SVM), multilayer perceptron (MLP), Naive Bayes, logistic regression, decision tree, AdaBoost and random forest. From all these investigations, it is observed that KAZE descriptor and random forest combination has the topmost classification accuracy.
computer science, software engineering
What problem does this paper attempt to address?