Abstract:Aiming at the visual measurement requirements of space manipulators for grasping non-cooperative targets, a space target docking ring recognition and center point positioning method based on Tiny Darknet YOLOv3 fusion CenterNet is proposed. First, training network model based on open source ImageNet VOC 2007 and self-built spatial non-cooperative target data set and use optimized Tiny Darknet YOLOv3 fusion CenterNet deep learning algorithm to identify space target docking and obtain two-dimensional pixel coordinates of the docking center point; secondly, using the EnsensoN10-40818 depth camera to obtain the 3*3 neighborhood data of the depth value corresponding to the center point and calculate the neighborhood weighted optimal value to get docking center spatial coordinates in the camera coordinate system. Combined with the hand- eye calibration relationship, the docking center spatial coordinates are converted to the UR5 manipulator base coordinate system. A ground verification system for manipulator to capture the target was built to test the target docking ring identification and center point positioning, and the accuracy error evaluation is completed based on the OptiTrack motion capture global measurement benchmark system. The experimental results show that target positioning accuracy is better than 10mm, and real-time data update rate is better than 2Hz in the dynamic approximation process from 1.5m to 0.2m, which can effectively solve the slow speed and poor accuracy caused by the influence of environmental lighting, target surface material, target attitude scale changes and other factors in traditional feature extraction methods. It lays a foundation for the safe arrival, capture and other manipulator fine operations.

Target positioning method in binocular vision manipulator control based on improved canny operator

The target positioning system of a manipulator based on binocular stereo vision

Robot Target Location Based on the Difference in Monocular Vision Projection

Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

Position-Based Visual Servoing Control for Multi-Joint Hydraulic Manipulator

A binocular camera calibration method based on circle detection

Non-cooperative Target Pose Estimate of Spacecraft Based on Vectors

High-precision target positioning system for unmanned vehicles based on binocular vision

Research on target tracking of binocular vision robot

Space Target Docking Ring Recognition and Center Point Positioning Based on Tiny Darknet YOLOv3 Fusion CenterNet

A Pose Estimation and Optimization Method for Mobile Manipulator’s End-effectors Based on Stereo Vision and ICoP Algorithm*

Research on object recognition and manipulator grasping strategy based on binocular vision

Target Recognition and Localization of Mobile Robot with Monocular PTZ Camera

Research on Key Technologies of target location based on Intelligent Robot

A Novel Concentric Circular Coded Target, and Its Positioning and Identifying Method for Vision Measurement under Challenging Conditions

An Accurate Positioning Method for Robotic Manipulation Based on Vision and Tactile Sensors

Precise pose and radius estimation of circular target based on binocular vision

Target control point position calibration based on coordinate measuring machine and global bundling optimization algorithm

A Ball-Shaped Target Development and Pose Estimation Strategy for a Tracking-Based Scanning System

A High Precision Conical Target Pose Measurement Method Using Monocular Vision

Technique for Positioning Moving Binocular Vision Measurement System and Data Registration with Ball Target