Gesture Control Comand Recognition Algorithm for the Book Turning Robot

Jiaqi DONG,Weibing WAN,Tehao ZHU,Tao HE,Qunfei ZHAO
DOI: https://doi.org/10.3969/j.issn.1671-0444.2017.06.015
2017-01-01
Abstract:The book turning robot to be controlled is a kind of service robot to assist the disabled people to read.A gesture control command recognition algorithm based on appearance features was designed for the book turning robot.The method of the minimum depth pixel was used to separate the gesture region from depth images of hands captured by a Kinect(motion-sensor).Then circle trajectories were drawn to extract appearance features of gestures such as numbers of fingertips and angles between fingertips,which were applied in the decision tree to classify the gestures.Meanwhile the skeleton data and trajectories of hands and shoulders were used to determine the direction of turning books.Through lots of experiments,the result shows that the recognition accuracy reaches 98.4%.The algorithm can recognize the gesture control commands quickly and accurately without training samples in complex background environment,and it can be applied in assisting the disabled people to read in practice.
What problem does this paper attempt to address?