Abstract:Bucket pose estimation is a key technology for the intelligent mining excavator to realize automatic excavation and loading. The existing estimation methods mainly include two categories. The sensor measurement methods install sensors to detect the bucket pose, which suffer from large cumulative error and short service life caused by strong vibrations. The traditional registration methods estimate the bucket pose by registering its point clouds with the iterative closest point method, which easily fall into a local optimum. Recently, point cloud registration networks have been studied for object pose estimation based on balanced training samples. However, since the bucket speed changes obviously during excavation, the number of bucket samples at different poses is imbalanced. As a result, point cloud registration networks will easily forget the bucket features at some poses which have small samples, also called nondominant pose features, during learning. This will reduce the accuracy of bucket pose estimation. To handle the forgetting problem caused by the sample imbalance, we propose a novel memory-augmented registration network (MARNet) for bucket pose estimation. The MARNet consists of an encoder, a dual-pose-memory module (DPMM), and a decoder. The encoder extracts the global pose features from the input point clouds. The DPMM learns and memorizes the prototypical pose features covering all the samples by using the memory units at the training phase. Then, nondominant pose features are augmented by retrieving the stored prototypical pose features at the testing phase. At last, the decoder calculates the final poses. Our method can effectively alleviate the forgetting problem and strengthen the generalization by using the DPMM. The experimental results demonstrate that our method increases the estimation accuracy of rotation and translation by at least 1.49° and 0.021 m, respectively, for the bucket poses with small samples. This contributes to the development of intelligent mining excavators.

A New Measurement Method of Real-time Pose Estimation for an Automatic Hydraulic Excavator

Vision-based Excavator Pose Estimation for Automatic Control

An ANN-Based Precision Compensation Method for Industrial Manipulators Via Optimization of Point Selection

Modeling and Control of General Hydraulic Excavator for Human-in-the-loop Automation

Calibration of Visual Measurement System for Excavator Manipulator Pose

A Robot Calibration Method Based on Joint Angle Division and an Artificial Neural Network

A vision-based end pose estimation method for excavator manipulator

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

Pose Alignment of Aircraft Structures with Distance Sensors and CCD Cameras

Full-body pose estimation for excavators based on data fusion of multiple onboard sensors

Visual Sensor Target Tracking and Localization Method for Automatic Excavators

Research on Trajectory Planning and Autodig of Hydraulic Excavator

Study of IMU Installation Position for Posture Estimation of Excavators

Real-Time Bucket Pose Estimation Based on Deep Neural Network and Registration Using Onboard 3D Sensor

Static Deformation-Compensation Method Based On Inclination-Sensor Feedback For Large-Scale Manipulators With Hydraulic Actuation

Pose estimation of an aerial construction robot based on motion and dynamic constraints

Low-Budget Real-time Pose Estimation Method for Personal Physical Exercise Assistant

Memory-Augmented Point Cloud Registration Network for Bucket Pose Estimation of the Intelligent Mining Excavator

Construction path tracking and pose estimation of unmanned bulldozer

Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimation

Toward Marker-free 3D Pose Estimation in Lifting: A Deep Multi-view Solution