FastOrient: Lightweight Computer Vision for Wrist Control in Assistive Robotic Grasping

Mireia Ruiz Maymo,Ali Shafti,A. Aldo Faisal

DOI: https://doi.org/10.48550/arXiv.1807.08275

2018-07-22

Abstract:Wearable and Assistive robotics for human grasp support are broadly either tele-operated robotic arms or act through orthotic control of a paralyzed user's hand. Such devices require correct orientation for successful and efficient grasping. In many human-robot assistive settings, the end-user is required to explicitly control the many degrees of freedom making effective or efficient control problematic. Here we are demonstrating the off-loading of low-level control of assistive robotics and active orthotics, through automatic end-effector orientation control for grasping. This paper describes a compact algorithm implementing fast computer vision techniques to obtain the orientation of the target object to be grasped, by segmenting the images acquired with a camera positioned on top of the end-effector of the robotic device. The rotation needed that optimises grasping is directly computed from the object's orientation. The algorithm has been evaluated in 6 different scene backgrounds and end-effector approaches to 26 different objects. 94.8% of the objects were detected in all backgrounds. Grasping of the object was achieved in 91.1% of the cases and has been evaluated with a robot simulator confirming the performance of the algorithm.

Robotics,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to automatically control the wrist rotation of a robot through computer vision technology in assistive robot grasping, so as to achieve correct grasping of the target object. Specifically, for patients with limited mobility due to paralysis or amputation, existing assistive robot devices usually require users to perform low - level direct control, which may become difficult due to the user's limited residual motor ability or the insufficient number of independent channels in the neural interface. Therefore, the paper proposes a lightweight computer vision algorithm named FastOrient, aiming to reduce the user's cognitive burden and training time by automatically adjusting the orientation of the end - effector (i.e., the robot's hand), thereby increasing user acceptance and technology integration.

The FastOrient algorithm obtains images through a camera installed on the top of the robot's end - effector, segments the images to detect the target object, and calculates the direction of the object. According to the calculated object direction, the algorithm can determine the angle by which the wrist needs to rotate so that the robot's hand is aligned with the long axis of the object, thereby achieving effective grasping. In the paper, the author verified the effectiveness of this algorithm through experiments on 26 different objects under different backgrounds and different approaching methods. The results show that 94.8% of the objects were successfully detected and correct grasping was achieved in 91.1% of the cases.