Autonomous target capturing of free-floating space robot

XuWenfu,LiangBin,LiCheng,LiuYu,XuYangsheng

IF: 2.7

2009-01-01

Robotica

Abstract:Space robotic systems are expected to play an increasingly important role in the future. Unlike on the earth, space operations require the ability to work in the unstructured environment. Some auto...

What problem does this paper attempt to address?

Autonomous Trajectory Planning of Free-floating Robot for Capturing Space Target.

Cheng Li,Bin Liang,Wenfu Xu

DOI: https://doi.org/10.1109/iros.2006.281783

2006-01-01

Abstract:Space target may move in various modes, such as free-floating, tumbling, and so on. In order to capture a space target, autonomous trajectory planning algorithm is studied. The base of the space robot is free-floating for the purpose of safety and saving the fuel. Firstly, the target feature is extracted based on the measured information via the hand-eye camera. Then the target pose (position and orientation) and velocity (linear velocity and angular velocity) relative to the end-effector are estimated using Kalman filtering technology. Thirdly, an autonomous trajectory planning approach is proposed for capturing an space target with unknown motion. Lastly, a semi-physical simulation system is established to verify the planning algorithm. The simulation results show that the algorithm is valid
On the autonomous target capturing of flexible-base space robotic system

Meng Deshan,Liang Bin,Xu Wenfu,Wang Xueqian,Liu Houde,Zhu Xiaojun

DOI: https://doi.org/10.1109/ICARCV.2014.7064605

2014-01-01

Abstract:Autonomous target capturing is the key for space robot to perform on-orbital servicing tasks. To meet the requirement of complex and long-term task, large flexible appendages, such as solar paddles and antenna reflectors are usually mounted on the base of a space robot. Due to the structure vibration, it is very challenging to capture a free-floating target satellite. In this paper, we derived the kinematics equations and proposed the autonomous target capturing method for free-floating flexible-base space robots. The kinematics equation established the mapping from the base velocities, joint rates and elastic motion to the end-effector velocities. Based on this equation, we designed resolved motion rate control with vibration compensation for the space manipulator. Another contribution of this paper is that we modeled the dynamic coupling between the rigid movement of the end-effector and the flexible vibration of the solar paddles. Based on this model, we analyzed the coupling effect which was very important for the design of the manipulator and determining the trajectory planning and control strategy. At last, a simulation system was created and simulation studies of the proposed methods were carried out. The simulation results verify the proposed methods.
A Ground Experiment System of Free-floating Robot for Capturing Space Target

Wenfu Xu,Bin Liang,Yangsheng Xu,Cheng Li,Wenyi Qiang

DOI: https://doi.org/10.1007/s10846-006-9087-8

2006-01-01

Journal of Intelligent & Robotic Systems

Abstract:Technology for the capturing of space target is very important for on-orbit servicing. In order to assure the task is accomplished successfully, ground experimentations are required for the verification of the planning and control algorithms of space robotic system before it is launched. In this paper, an experiment concept is used, which is a hybrid approach, i.e. it combines the mathematical model with the physical model. The key issues of the concept are dynamic emulation and kinematic equivalence, in which the behaviors of the space robotic system are calculated by its dynamic equations. The motion of its end-effector and the space target is realized by two industrial robots. According to different observation spots, two modes of capturing process are emulated: one is observed from the inertial frame, the other is from the space base. Based on the concept proposed above, a ground experiment system is set up, which is composed of two industrial robots, a set of global visual system and five industrial computers. Using the system, algorithms of space robot of any geometry and mass properties can be tested. As an example, the autonomous trajectory planning algorithm is verified by the experiment of capturing a moving target. Moreover, a real-time 3D simulation system is developed to emulate the capturing process in 3D space. Numeric simulation and experiment results show that the ground system is effective in evaluating the planning and control algorithms of space robot.
Safe Tracking Control for Free-Flying Space Robots Via Control Barrier Functions

Chengrui Shi,Tao Meng,Kun Wang,Jiakun Lei,Weijia Wang,Renhao Mao

DOI: https://doi.org/10.1016/j.robot.2024.104865

IF: 3.7

2024-01-01

Robotics and Autonomous Systems

Abstract:Safety is a critical problem for space robots in future complex automomous On-Orbit Services. In this paper, we propose a real-time and guaranteed method for whole-body safe tracking control of free-flying space robots using High Order Control Barrier Functions (HOCBFs).We start by utilizing capsule-shaped safety envelopes for an accurate approximation of space robots. This is followed by the development of HOCBF-based safety filters to ensure simultaneous collision avoidance and compliance with specified joint limits. To mitigate feasibility issues, we incorporate the optimal decay method into our safety filter design. Furthermore, we introduce a data-driven re-planning mechanism to avoid local minimums of control barrier functions. Such a mechanism primarily operates through anomaly detection of tracking behavior using One-Class Support Vector Machines.Numerical experiments demonstrate that our method effectively ensures safety of space robots under complicated circumstances without compromising the system’s ability to achieve its intended goals.
A Modelling and Simulation System of Space Robot for Capturing Non-Cooperative Target

Wenfu Xu,Bin Liang,Cheng Li,Yu Liu,Xueqian Wang

DOI: https://doi.org/10.1080/13873950903036724

2009-01-01

Mathematical and Computer Modelling of Dynamical Systems

Abstract:Space robotic systems are expected to play an increasingly important role in the future. The applications include repairing, refuelling or the de-orbiting of a satellite, or removal of space debris. Such objects are generally non-cooperative, i.e. neither any artificial patterns used for the measurement nor grappling fixtures applied for the capture are mounted on the targets. In this article, we propose a method for autonomous rendezvous with and capturing of a non-cooperative object in space and develop a modelling and simulation system to verify the corresponding algorithms. The system, realized in VC® (Microsoft Visual C++) environment, is composed of seven modules: Image Processing and 3D Reconstruction, the Planning and Control of the Chaser, the Target Controller, the Dynamic Model, the Geometry Model, the Binocular Cameras Model and the Stereo Calibration Module. With the system, the closed-loop simulations, including image grabbing, image processing, pose measurement, chaser guidance, navigation and control (GNC) and the system's dynamic motion, were conducted and the key algorithms validated.
Autonomous Planning and Experiments of Space Robot Based on Hand-eye Measurement

Liang Bin,Li Cheng,Xu Wenfu

DOI: https://doi.org/10.1109/ICIA.2007.4295796

2007-01-01

Abstract:The robotic on-orbital service, whose key is the capturing technology, becomes research hot in recent years. In this paper, the authors propose an autonomous path planning method for target capturing. The term autonomous means that "to predict the target motion autonomously", "to avoid the dynamic singularities autonomously" and "to adjust the manipulator motion without excess disturbance on the base autonomously". First, the target feature is extracted based on the measured information via the hand-eye camera, and the target velocities are estimated using extended Kalman filtering technology. Then, a practical approach is presented to plan the manipulator motion and avoid the dynamic singularities, which transforms them into real-time kinematic singularities avoiding problem. Third, the manipulator motion is adjusted according to the predicted disturbance on the base, to limit the base angular velocity. At last, a ground experiment system is set up based on the concept of dynamic emulation and kinematic equivalence. With the experiment system, the autonomous capturing of space target is examined. The experiment results validate the proposed algorithm.
Autonomous Capturing of Moving Target with Optimal Rendezvous Attitude and Manipulator Configuration.

Wenfu Xu,Bin Liang,Cheng Li,Yangsheng Xu

DOI: https://doi.org/10.2316/journal.206.2010.4.206-3209

2010-01-01

Abstract:Robotic capturing of target is one of the key technologies for on-orbital servicing. The target. may move from the outside of the workspace; and its trajectory may not cross the "guaranteed workspace" (GWS). In this paper, we propose a coordinated method to plan the motions of the base attitude and manipulator joints for autonomous rendezvous with and capturing a moving target. First, we analyzed the workspace of the space robot and discussed the capturing problem for different cases. Then we presented the concept, of optimal capturing, i.e., the capturing with the "optimal rendezvous attitude" and the "optimal capturing configuration". An autonomous method was used to realize the optimal capturing. This method has these traits: (1) it can generate coordinated motion of the base and the manipulator to capture moving target; (2) the reaction jet fuel is not used; and (3) the manipulator captures the target, with most dexterous configuration. Simulation results verify the proposed method.
Autonomous Path Planning of Dual-arm Space Robot for Capturing Moving Target

徐文福,刘厚德,李成,张金涛,梁斌

DOI: https://doi.org/10.3724/sp.j.1218.2012.00704

2012-01-01

ROBOT

Abstract:For the case of dual-arm space robotic system capturing moving target,an autonomous path planning method is proposed corresponding to the two modes,i.e.the free-floating mode and the base attitude controlled mode.Firstly,the end-effector velocities of each arm are planned according to the hand-eye cameras’ measurement.Then,the damped least squares(DLS) algorithm is used to solve the differential kinematics equations derived in this paper,and the desired angle and rate of each joint are determined.These desired values are utilized as the inputs of joint controllers.The process above will not end until the capturing condition is satisfied.Finally,the multi-body dynamic model of a dual-arm space robotic system is developed and simulation study is carried out.The simulation results verify the proposed methods.
Autonomous Path Planning and Experiment Study of Free-Floating Space Robot for Spinning Satellite Capturing

Houde Liu,Bin Liang,Xueqian Wang,Bo Zhang

DOI: https://doi.org/10.1109/icarcv.2014.7064550

2014-01-01

Abstract:Robotic systems are expected to play an increasingly important role in future space activities with the development of space technology. The robotic on-orbital service, whose key is the capturing technology, becomes research hot in recent years. This paper focuses on the guidance of a robot manipulator to capture a spinning satellite with unknown dynamics parameters. In capturing a spinning satellite, a reference trajectory for control of the manipulator is generated with time delay due to the processing time of the target motion estimator and the manipulator controller. Consequently, the control system shows a poor performance and the end-effector sometimes fails to capture the target satellite. To solve this problem, the motion characteristics and motion prediction of the spinning satellite is analyzed Firstly, and using Unscented Kaiman Filter (UKF) to predict its movement. Then, a method of autonomous path planning of a free-floating space robot for target capturing is proposed, which is based on motion prediction and speed compensation. Finally, a ground experiment system is set up based on the concept of dynamic emulation and kinematic equivalence. With the experiment system, the autonomous target capturing experiments are conducted. The experiment results validate the proposed algorithm.
Unified multi-domain modelling and simulation of space robot for capturing a moving target

Wenfu Xu,Yu Liu,Bin Liang,Xueqian Wang,Yangsheng Xu

DOI: https://doi.org/10.1007/s11044-009-9184-0

IF: 3.4

2009-01-01

Multibody System Dynamics

Abstract:Space robotic systems are expected to play an increasingly important role in the future on-orbit service. The applications include repairing, refueling or de-orbiting of a satellite, or removal of the space debris. The dynamical performances of space robotic system result from the multi-physics interactions between mechanical, electrical, electronic, control, etc. In this paper, we developed a unified multi-domain modelling and simulation system. The system is composed of the following modules: the path planner, joint controllers, motor and its driver, gearing mechanism of the space manipulators, the Guidance, Navigation, and Control (GNC) system, the actuators of the base, and the orbital environment, orbital dynamic and the multi-body dynamic of the whole system, etc. Based on this system, the operation during different stages, including far range rendezvous, close range rendezvous (is usually divided into two sub-phases: closing and final approach) and target capturing can be studied from the view of multi-physics domains. The key algorithms, such as pose (position and attitude) measurement, GNC of the base, path planning and control of the space manipulator, and so on, can be validated using the system. As examples, the capturing processes of a moving target under free-floating and attitude-controlled modes are simulated and the simulation results are given.
Dynamics and control of capture of a floating rigid body by a spacecraft robotic arm

Xiao-Feng Liu,Hai-Quan Li,Yi-Jun Chen,Guo-Ping Cai,Xi Wang

DOI: https://doi.org/10.1007/s11044-014-9434-7

IF: 3.4

2014-10-31

Multibody System Dynamics

Abstract:It is well known that space robots play a significant role in the human space activities. Capturing a free floating object in space is one of important missions assigned to space robots and it has increasingly attracted researchers’ attention recently. In this paper, the dynamics and control of capturing a floating rigid body using a space robot are investigated. The dynamic model of the system is established by the single direction recursive construction method and the Jourdain’s velocity variation principle. The contact force between space robots and targets has been set up based on the Hertz contact theory. Then the influence on the whole system incurred by this contact force has been thoroughly analyzed through simulations of both central and eccentric impact. Our simulation result verified the impact on the whole system caused by the contact force, and it also indicated the extreme complexity of the dynamic response caused by impact during the capture process. The space robot base attitude has been controlled using the controller based on the nonlinear decoupling method. Our simulation results showed adequate effectiveness.

mechanics
An experiment system of space robot for capturing target

Li C,Xu W,Liang B,Qiang W,Xu Y.

2006-01-01

Abstract:Ground experimentations are required to verify the planning and control algorithms of space robotic system before it is launched. In this paper, a ground experiment system is setup based on a new concept, whose key issues are dynamic emulation and kinematic equivalence. The behaviors of the space robotic system are calculated by its dynamic equations and the motion of the end-effector and the target is realized by two industrial robots. According to different observation spots, two modes of capturing process are emulated: one is observed from the inertial frame, the other is from the space base. With the system, algorithms of space robot of any geometry and mass properties can be tested. Moreover, a real-time 3D simulation system is developed to emulate the capturing process in 3D space. Numeric simulation and experiment results show that the ground system is effective in evaluating the planning and control algorithms of space robot.
Control of Free-Floating Space Robots to Capture Targets Using Soft Q-Learning.

Changzhi Yan,Qiyuan Zhang,Zhaoyang Liu,Xueqian Wang,Bin Liang

DOI: https://doi.org/10.1109/robio.2018.8665049

2018-01-01

Abstract:In this work, a new control method for free-floating space robots to capture targets is proposed. This method can efficiently train a variety of target capturing policies without knowing the dynamic models of the robot system. We use soft Q-learning (SQL) algorithm to train stochastic energy based policies for space manipulator motion planning. Firstly, the soft Q-network and the state-conditioned stochastic policy network are constructed based on the maximum entropy objective. Then, the experience replay pool is built to store the training samples with which the both networks are trained under SQL procedures. Finally, soft Q-learning trains policies that maximize both accumulated reward and policy entropy such that the robot can successfully perform the task while act as randomly as possible. We have validated this method on the free-floating space robot with single-arm and duel-arm manipulator in simulation respectively and the results show that the free-floating space robots with stochastic energy based policies can manage to capture the target in different ways.
The Novel Infrared Target Localization Algorithm for Free Floating Space Robot

Xiong Luo,Xiaolu Jie,Huaping Liu,Fuehun Sun

2011-01-01

Abstract:With regards to the complicated characteristic of outer space, the infrared target recognition system has been investigated for free floating space robot. A novel algorithm is proposed based on visual location method for free floating space robot. Firstly, we set an omnidirectional camera with fixed lens on the ceiling. Here, the free floating robot is moving on the platform. Especially, in order to reduce image noise, we fix an infrared filter in the lens. Then, we place a number of infrared-emitting diodes on the free floating space robot and the targets. Finally, we can get the accurate positions and angle information of the robot and the target according to the location of the infrared light. The experimental results prove that this approach presented in this paper is an effective method for target detection and static target capture for free floating space robot.
Study on Intelligent Visual Servoing of Space Robot for Cooperative Target Capturing

Ye Shi,Bin Liang,Xueqian Wang,Wenfu Xu,Houde Liu

DOI: https://doi.org/10.1109/icinfa.2012.6246915

2012-01-01

Abstract:One important area for the application of space robotics is autonomous On-Orbit Servicing (OOS) of failed spacecrafts. Visual servo of eye-in-hand type system is one of the most promising approaches to perform this task. This paper describes research and development of a visual servoing system for autonomous satellite capture using an on-board manipulator with binocular hand-eye cameras. Taking account of the special aspects of space environment such as lighting and available computing power, to realize a safe and reliable real-time visual servoing operation, cooperative visual marker search processing, time delay processing, and capture strategy have been carefully designed. Some critical constraints such as FOV limit, joint range limits, kinematic singularities, and joint velocity limits are concerned during visual servoing. A ground experiment system based on air-bearing table is set up. With the system, experiments of autonomous capturing target are conducted. The results validate the effectiveness of our research.
Modeling and Planning of a Space Robot for Capturing Tumbling Target by Approaching the Dynamic Closest Point

Wenfu Xu,Zhonghua Hu,Lei Yan,Han Yuan,Bin Liang

DOI: https://doi.org/10.1007/s11044-019-09683-3

IF: 3.4

2019-01-01

Multibody System Dynamics

Abstract:Space debris or uncontrolled satellites bring new and critical challenges for space robots to capture and remove them, especially when the targets are tumbling. In the face of these challenges, most existing research only focused on capturing a fixed point on the target. Distinguished from previous research, this paper attempts to investigate an autonomous tumbling target capturing method by approaching the “Dynamic Closest Point” (DCP), that is, the most suitable point on the target to be grasped and always closest to the end effector. First, an uncontrolled space object and a space robotic system are modeled, and the existence of the DCP is proved. For a practical malfunction spacecraft, the motion characteristics of the DCP and a fixed point are theoretically analyzed and compared as regards different motion types and rotation vectors. Furthermore, the desired trajectory is generated for the end effector of the space robot to approach the DCP autonomously, based on the position and velocity of the DCP estimated in real-time by hand-eye cameras. The joint velocities and angles are then resolved by combining the differential kinematics and movement constraints on the end effector. Finally, an Adams-Simulink co-simulation system is developed. Based on this, the proposed method is verified by single-arm and dual-arm capturing cases. Simulation results demonstrate that the capture time and movement ranges of the end effector are both greatly reduced with the DCP method. In contrast with traditional capturing methods, the efficiency of this proposed method is largely improved.
Coordinated control of dual-arm robot on space structure for capturing space targets

Shuji Yang,Yonglei Zhang,Hao Wen,Dongping Jin

DOI: https://doi.org/10.1016/j.asr.2022.10.027

IF: 2.611

2022-10-15

Advances in Space Research

Abstract:This paper presents a coordinated control scheme for two capture tasks via a dual-arm space robot with its base on a flexible space structure. The robot system consists of a base, a mission arm for capture, and a balance arm for removing disturbance forces to the base. To counteract the impact of structural vibration, a two-stage strategy containing a vibration control stage and a target capture stage is proposed. In the first stage, the robot and structure are treated as a mass-spring system in which the coupling effect between the robot and the flexible structure is exploited to suppress structural vibration. Notably, the collision avoidance between two arms is achieved by a velocity inequality constraint, wherein the reactionless motion is utilized. In the second stage, a reactionless trajectory is planned for the mission arm to reach the target location and attitude, as the balance arm remove the coupling disturbance to the base. Afterwards, the balance arm becomes the new mission arm for capture and the other arm is defined as the new balance arm. Finally, numerical simulations are given to validate the efficiency of the proposed coordinated control strategy.

geosciences, multidisciplinary,meteorology & atmospheric sciences,astronomy & astrophysics,engineering, aerospace
Modeling and simulation of space robot visual servoing for autonomous target capturing

Ye Shi,Bin Liang,Xueqian Wang,Wenfu Xu,Houde Liu

DOI: https://doi.org/10.1109/icma.2012.6285698

2012-01-01

Abstract:In the past decades, autonomous on-orbit servicing has become a priority for the space industry. Visual servo of eye-in-hand type system is one of the most promising approaches to perform this task. In order to ensure that the task was implemented successfully, mathematical simulation and ground experiments are required to thoroughly explore the capabilities and limitations of the planning and control algorithms before it is launched. In this paper, we propose a hybrid 2D/3D visual servoing of space robot for target capturing. We consider the image based visual servo as the core of our scheme due to its simplicity and low sensitivity to camera calibration errors. Position based visual servoing is only used when the target is close to the end effector of space robot. Taking account of the special aspects of space environment such as lighting and available computing power, to realize a safe and reliable realtime visual servoing operation, cooperative visual marker, time delay processing, and capture strategy have been carefully designed. A 3D simulation platform for space robot visual servoing is developed to verify the corresponding algorithms. The results validate the effectiveness of our research.
Autonomous reinforcement learning control for space robot to capture non-cooperative targets

LIU Shuai,ShuNan WU,YuFei LIU,ZhiGang WU,ZiMing MAO,Shuai LIU

DOI: https://doi.org/10.1360/sspma2018-00287

2019-01-01

Abstract:In recent years, space robot on-orbit service has become a research hotspot in many countries. Aiming at the task of capturing non-cooperative targets for space robot, a dual loop control method consisting of reinforcement learning control and PD control is proposed in this paper, which is used to control the attitude of space robot platform and the motion of manipulator arm. Firstly, a coupled dynamic model of the space robot including the motion of the base platform and the robot arm is established. Then, a dual loop control system is designed to control the movement of the robot arm and the attitude of the base platform. In the inner loop, the controller is designed by combining the reinforcement learning and fuzzy theory to control the motion of the end of the robot arm. In the outer loop, the attitude of the base platform is stabilized by PD control. Finally, the proposed control method is used for numerical simulation and compared with the traditional PD control method to verify the effectiveness of the proposed control method. The results show that the robot arm movement process under the control of reinforcement learning is stable and the control precision is high. Compared with the traditional PD control method, it has a certain self-learning ability and is more suitable for the non-cooperative characteristics of the catching targets.

astronomy & astrophysics,physics, multidisciplinary
Shared Control Teleoperation for Targets Acquisition

Wang Dongli,Liu Huaping,Sun Fuchun,Du Yonggui

DOI: https://doi.org/10.1109/ccdc.2012.6244584

2012-01-01

Abstract:It is very difficult to capture the target in the microgravity environment, simply by relying on ground operators. Based on shared control theory, this paper effectively combines the decision-making ability of ground operators and the independent ability of space robot, through making full use of independent control ability of the space robot, and reducing operators' workload and working time, to achieve more valid capture for targets. Shared control is more accurate capture of the target compared with teleoperation in experimental.

Autonomous target capturing of free-floating space robot

Autonomous Trajectory Planning of Free-floating Robot for Capturing Space Target.

On the autonomous target capturing of flexible-base space robotic system

A Ground Experiment System of Free-floating Robot for Capturing Space Target

Safe Tracking Control for Free-Flying Space Robots Via Control Barrier Functions

A Modelling and Simulation System of Space Robot for Capturing Non-Cooperative Target

Autonomous Planning and Experiments of Space Robot Based on Hand-eye Measurement

Autonomous Capturing of Moving Target with Optimal Rendezvous Attitude and Manipulator Configuration.

Autonomous Path Planning of Dual-arm Space Robot for Capturing Moving Target

Autonomous Path Planning and Experiment Study of Free-Floating Space Robot for Spinning Satellite Capturing

Unified multi-domain modelling and simulation of space robot for capturing a moving target

Dynamics and control of capture of a floating rigid body by a spacecraft robotic arm

An experiment system of space robot for capturing target

Control of Free-Floating Space Robots to Capture Targets Using Soft Q-Learning.

The Novel Infrared Target Localization Algorithm for Free Floating Space Robot

Study on Intelligent Visual Servoing of Space Robot for Cooperative Target Capturing

Modeling and Planning of a Space Robot for Capturing Tumbling Target by Approaching the Dynamic Closest Point

Coordinated control of dual-arm robot on space structure for capturing space targets

Modeling and simulation of space robot visual servoing for autonomous target capturing

Autonomous reinforcement learning control for space robot to capture non-cooperative targets

Shared Control Teleoperation for Targets Acquisition