Robust Stroke Recognition via Vision and IMU in Robotic Table Tennis

Yapeng Gao,Jonas Tebbe,Andreas Zell
DOI: https://doi.org/10.1007/978-3-030-86362-3_31
2021-01-01
Abstract:Stroke recognition in table tennis is a challenging task, due to the variety of the movements. Many different sensors have been adopted in robotic table tennis, with the goal of detecting the players' movements. In this paper, we propose a two-stage approach to directly recognize the table tennis racket's movement. A bounding box around the racket can be extracted from an RGB image in the first stage. An efficient and lightweight CNN architecture is then developed to regress the racket 3D position by fusion of the cropped image and the 3D rotation data from an IMU in the second stage. Together with the rotation data, a robust 6D racket pose is available at a frame rate 100 Hz. In the experiments, two datasets are collected from our KUKA table tennis robot for evaluation and comparisons, which show a position error of 4.7 cm at a range of 6m. One behavior cloning experiment is performed in order to reveal the potential of this work.
What problem does this paper attempt to address?