Learning Robotic Manipulation from Demonstrations by Combining Deep Generative Model and Dynamic Control System

Xiaojian Ma,Mingxuan Jing,Fuchun Sun,Huaping Liu,Bin Fang
2019-01-01
Abstract:Learning and inferring movement from demonstrations is a challenging problem in robotic manipulation due to the simultaneous demand of the endpoint convergence and the trajectory diversity. It could be even more complex when visual sensing is employed, which leads to high dimensionality and large input variance. In this paper, we propose an effective probabilistic method for learning basic movement in robotic manipulation from demonstrations, which can adapt with visual input and variant target tasks at the same while. Our method builds upon a deep generative model, and the trajectory generation problem is formulated as learning and inferring on a directed graphic model which takes the visual features into account, while the endpoint convergence to an expected target position is guaranteed by a second-order dynamic control system. It incorporates the flexibility of the probabilistic model and the stability of the control system, which suits for vision-based long-term planning and robot control. Experimental validations on robotic approaching path planning tasks demonstrate the advantages of our method over the baseline counterparts when only limited demonstrations are available.
What problem does this paper attempt to address?