Abstract:Abstract Contrary to the stunning feats observed in birds of prey, aerial manipulation and grasping with flying robots still lack versatility and agility. Conventional approaches using rigid manipulators require precise positioning and are subject to large reaction forces at grasp, which limit performance at high speeds. The few reported examples of high-speed aerial grasping rely on motion capture systems, or fail to generalize across environments and grasp targets. We describe the first example of a soft aerial manipulator equipped with a fully onboard perception pipeline, capable of robustly localizing and grasping visually and morphologically varied objects. The proposed system features a novel passively closed tendon-actuated soft gripper that enables fast closure at grasp, while compensating for position errors, complying to the target-object morphology, and dampening reaction forces. The system includes an onboard perception pipeline that combines a neural-network-based semantic keypoint detector, a state-of-the-art robust 3D object pose estimator, and a fixed-lag smoother to estimate the pose of known objects. The resulting pose estimate is passed to a minimum-snap trajectory planner, tracked by an adaptive controller that fully compensates for the added mass of the grasped object. Finally, a finite-element-based controller determines optimal gripper configurations for grasping. Experiments on three different targets confirm that our approach enables dynamic, high-speed, and versatile grasping, all of which are necessary capabilities for tasks such as rapid package delivery or emergency relief. We demonstrate fully onboard vision-based grasps of a variety of objects, in both indoor and outdoor environments, and up to speeds of 2.0 m/s—the fastest vision-based grasp reported in the literature. Finally, we take a major step in expanding the utility of our platform beyond stationary targets, by demonstrating motion-capture-based grasps of targets moving up to 0.3 m/s, with relative speeds up to 1.5 m/s.

A deployable articulated mechanism enabled in-flight morphing aerial gripper

High Actuation Capability and Smooth-Deformation Piezo Morphing Wing Based on Multi-Layer Parallel Pre-Compressed MFC Bimorph

Biomimetic Morphing Quadrotor Inspired by Eagle Claw for Dynamic Grasping

TIE: an Autonomous and Adaptive Terrestrial-Aerial Quadrotor

Flying Hydraulically Amplified Electrostatic Gripper System for Aerial Object Manipulation

Ring-Rotor: A Novel Retractable Ring-shaped Quadrotor with Aerial Grasping and Transportation Capability

Bistable Aerial Transformer (BAT): A Quadrotor Fixed-Wing Hybrid that Morphs Dynamically via Passive Soft Mechanism

A Modular Pneumatic Soft Gripper Design for Aerial Grasping and Landing

A Robust Aerial Gripper for Passive Grasping and Impulsive Release using Scotch Yoke Mechanism

Aerial Mobile Manipulator System to Enable Dexterous Manipulations with Increased Precision

Design of an Anthropomorphic, Compliant, and Lightweight Dual Arm for Aerial Manipulation

Design of a High Performance Dual Arm Aerial Manipulator

Modeling and Control of an Omnidirectional Micro Aerial Vehicle Equipped with a Soft Robotic Arm

Customizable Power Grasps From Uncrewed Aerial Vehicles via a Soft “Wrapping” Gripper

MorphoGear: An UAV with Multi-Limb Morphogenetic Gear for Rough-Terrain Locomotion

Powerful UAV manipulation via bioinspired self-adaptive soft self-contained gripper

A Novel Flexure-Based 3-DOF Micro-Parallel Manipulator with a Gripper for Micro/nano Manipulation

Anthropomorphic, compliant and lightweight dual arm system for aerial manipulation

High-speed aerial grasping using a soft drone with onboard perception

Dynamic Modeling and Controller Design of a Novel Aerial Grasping Robot