Abstract:Abstract Contrary to the stunning feats observed in birds of prey, aerial manipulation and grasping with flying robots still lack versatility and agility. Conventional approaches using rigid manipulators require precise positioning and are subject to large reaction forces at grasp, which limit performance at high speeds. The few reported examples of high-speed aerial grasping rely on motion capture systems, or fail to generalize across environments and grasp targets. We describe the first example of a soft aerial manipulator equipped with a fully onboard perception pipeline, capable of robustly localizing and grasping visually and morphologically varied objects. The proposed system features a novel passively closed tendon-actuated soft gripper that enables fast closure at grasp, while compensating for position errors, complying to the target-object morphology, and dampening reaction forces. The system includes an onboard perception pipeline that combines a neural-network-based semantic keypoint detector, a state-of-the-art robust 3D object pose estimator, and a fixed-lag smoother to estimate the pose of known objects. The resulting pose estimate is passed to a minimum-snap trajectory planner, tracked by an adaptive controller that fully compensates for the added mass of the grasped object. Finally, a finite-element-based controller determines optimal gripper configurations for grasping. Experiments on three different targets confirm that our approach enables dynamic, high-speed, and versatile grasping, all of which are necessary capabilities for tasks such as rapid package delivery or emergency relief. We demonstrate fully onboard vision-based grasps of a variety of objects, in both indoor and outdoor environments, and up to speeds of 2.0 m/s—the fastest vision-based grasp reported in the literature. Finally, we take a major step in expanding the utility of our platform beyond stationary targets, by demonstrating motion-capture-based grasps of targets moving up to 0.3 m/s, with relative speeds up to 1.5 m/s.

Aerial Grasping: Modeling and Control of a Flying Hand

Dynamic Modeling and Controller Design of a Novel Aerial Grasping Robot

Aerial Grasping Based on VR Perception and Haptic Control.

An Integrated Approach to Aerial Grasping: Combining a Bistable Gripper with Adaptive Control

Grasp a Moving Target from the Air: System & Control of an Aerial Manipulator

Aerial Grasping of an Object in the Strong Wind: Robust Control of an Aerial Manipulator

Autonomous Vision-Based Aerial Grasping for Rotorcraft Unmanned Aerial Vehicles

Modeling and Controlling of Quadrotor Aerial Vehicle Equipped with a Gripper

Modeling and Controlling the Dynamic Behavior of an Aerial Manipulator

Modeling and Control of an Omnidirectional Micro Aerial Vehicle Equipped with a Soft Robotic Arm

A Modular Pneumatic Soft Gripper Design for Aerial Grasping and Landing

High-speed aerial grasping using a soft drone with onboard perception

Intercontinental Haptic Teleoperation of a Flying Vehicle: A Step Towards Real-Time Applications

Modelling and control of an aerial manipulator consisting of an autonomous helicopter equipped with a multi-link robotic arm

Aerial Grasping with a Lightweight Manipulator Based on Multi-Objective Optimization and Visual Compensation.

Design and Implementation of Rotor Aerial Manipulator System

Design and Control of Roller Grasper V2 for In-Hand Manipulation

Control and Trajectory Optimization for Soft Aerial Manipulation

Modeling and Application of an SMA-Actuated Lightweight Human-Inspired Gripper for Aerial Manipulation

Mechanical Design, Modelling and Control of a Novel Aerial Manipulator

Finite State Machine and Ultrasonic Ranging-Based Approach for Automatic Grasping by Aerial Manipulator