Abstract:Cyborg insects have attracted great attention as the flight performance they have is incomparable by micro aerial vehicles and play a critical role in supporting extensive applications. Approaches to construct cyborg insects consist of two major issues: 1) the stimulating paradigm and 2) the control policy. At present, most cyborg insects are constructed based on invasive methods, requiring the implantation of electrodes into neural or muscle systems, which would harm the insects. As the control policy is basically manual control, the shortcomings of which lie in the requirement of excessive amount of experiments and focused attention. This paper presents the design and implementation of a noninvasive and much safer cyborg insect system based on visual stimulation. The tethered paradigm is adopted here and we look at controlling the flight behavior of bumblebees, especially the abdominal-waving behavior, in the context of a model-free reinforcement learning problem. The problem is formulated as a finite and deterministic Markov decision process, where the agent is designed to change the abdominal-waving behavior from the initial state to the target state. Sarsa with transformed reward function which can speed up the learning process is employed to learn the optimal control policy. Learned policies are compared to the stochastic one by evaluating the results of ten bumblebees, demonstrating that abdominal-waving state can be modulated to approximate the target state quickly with small deviation.

Representation and Computation Method for Bumblebee’s Abdomen Movements

A Posture Recognition System for Rat Cyborg Automated Navigation

A Simplified Computational Model of Mushroom Body for Tethered Bees' Abdominal Swing Behavior Induced by Optic Flow

Smooth 3D Trajectory Segmentation for Flying Insects

A Bio-inspired Model for Bee Simulations

Automatic analysis of segmentwise locomotion details of Drosophila larva

Integrative techniques for insect behavior analysis using micro-CT and Blender

A novel bioinspired mechanism to elucidate the movement flexibility of the honeybee abdomen driven by muscles.

Path Guided Motion Synthesis for Drosophila Larvae

Abdominal-Waving Control of Tethered Bumblebees Based on Sarsa with Transformed Reward

BSwarm

Movement Analysis of Flexion and Extension of Honeybee Abdomen Based on an Adaptive Segmented Structure

BIOLOGICALLY INSPIRED QUADRUPED ROBOT BIOSBOT: MODELING, SIMULATION AND EXPERIMENT

A Practical Model for Realistic Butterfly Flight Simulation

Whole-body kinematic and dynamic modeling for quadruped robot under different gaits and mechanism topologies

Modeling of swimming posture dynamics for a beaver-like robot

Self Model for Embodied Intelligence: Modeling Full-Body Human Musculoskeletal System and Locomotion Control with Hierarchical Low-Dimensional Representation

Dynamics Modeling and Simulation of a Hexapod Robot with a Focus on Trajectory Prediction

Research on the Jumping Control Methods of a Quadruped Robot that Imitates Animals

Simulating Flying Insects Using Dynamics and Data-Driven Noise Modeling to Generate Diverse Collective Behaviors

Hopping Motion on Heavy-Legged Bipedal Robot Based on SLIP Model and Whole Body Control