Abstract:Despite the attention marker-less pose estimation has attracted in recent years, marker-based approaches still provide unbeatable accuracy under controlled environmental conditions. Thus, they are used in many fields such as robotics or biomedical applications but are primarily implemented through classical approaches, which require lots of heuristics and parameter tuning for reliable performance under different environments. In this work, we propose MarkerPose, a robust, real-time pose estimation system based on a planar target of three circles and a stereo vision system. MarkerPose is meant for high-accuracy pose estimation applications. Our method consists of two deep neural networks for marker point detection. A SuperPoint-like network for pixel-level accuracy keypoint localization and classification, and we introduce EllipSegNet, a lightweight ellipse segmentation network for sub-pixel-level accuracy keypoint detection. The marker's pose is estimated through stereo triangulation. The target point detection is robust to low lighting and motion blur conditions. We compared MarkerPose with a detection method based on classical computer vision techniques using a robotic arm for validation. The results show our method provides better accuracy than the classical technique. Finally, we demonstrate the suitability of MarkerPose in a 3D freehand ultrasound system, which is an application where highly accurate pose estimation is required. Code is available in Python and C++ at <a class="link-external link-https" href="https://github.com/jhacsonmeza/MarkerPose" rel="external noopener nofollow">this https URL</a>.

Real-Time Marker Localization Learning for GelStereo Tactile Sensing

GVGNet: Gaze-Directed Visual Grounding for Learning Under-Specified Object Referring Intention

Research on marker tracking method for augmented reality.

RASTMTrack: Robust and Adaptive Space-Time Memory Networks for Visual Tracking

Real-time Marker Recognition Using Vision-based Tactile Sensor

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

GelStereo 2.0: An Improved GelStereo Sensor With Multimedium Refractive Stereo Calibration

An Improved Graph-Based Visual Localization System for Indoor Mobile Robot Using Newly Designed Markers

MarkerPose: Robust Real-time Planar Target Tracking for Accurate Stereo Pose Estimation

GelStereo Palm: a Novel Curved Visuotactile Sensor for 3D Geometry Sensing

Real-Time Reconstruction of 3D Tactile Motion Field Via Multi-Task Learning

Grasping Force Estimation for Markerless Visuotactile Sensors

Real-Time Reconstruction of 3-D Tactile Motion Field via Multitask Learning

Contact Volumetric Mesh Simulation of GelStereo Visuotactile Sensors

Robust Stereo-Match Algorithm for Infrared Markers in Image-Guided Optical Tracking System.

Latent Space Representations for Marker-Less Realtime Hand-Eye Calibration

A Locality-based Neural Solver for Optical Motion Capture

Marker or Markerless? Mode-Switchable Optical Tactile Sensing for Diverse Robot Tasks

Marker design and recognition on tiled interaction tabletop

Real-time and Robust Feature Detection of Continuous Marker Pattern for Dense 3-D Deformation Measurement

Continuous Marker Patterns for Representing Contact Information in Vision-Based Tactile Sensor: Principle, Algorithm, and Verification