Direct learning of home vector direction for insect-inspired robot navigation

Michiel Firlefyn,Jesse Hagenaars,Guido de Croon

2024-05-07

Abstract:Insects have long been recognized for their ability to navigate and return home using visual cues from their nest's environment. However, the precise mechanism underlying this remarkable homing skill remains a subject of ongoing investigation. Drawing inspiration from the learning flights of honey bees and wasps, we propose a robot navigation method that directly learns the home vector direction from visual percepts during a learning flight in the vicinity of the nest. After learning, the robot will travel away from the nest, come back by means of odometry, and eliminate the resultant drift by inferring the home vector orientation from the currently experienced view. Using a compact convolutional neural network, we demonstrate successful learning in both simulated and real forest environments, as well as successful homing control of a simulated quadrotor. The average errors of the inferred home vectors in general stay well below the 90° required for successful homing, and below 24° if all images contain sufficient texture and illumination. Moreover, we show that the trajectory followed during the initial learning flight has a pronounced impact on the network's performance. A higher density of sample points in proximity to the nest results in a more consistent return. Code and data are available at

Robotics,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to make robots imitate the learning flight behaviors of insects (such as bees and wasps) and directly learn the direction home through visual cues. Specifically, the paper proposes a new robot navigation method, which can directly learn the direction of the home vector from the visual perception obtained during the learning flight. This method aims to overcome the limitations in traditional route - following methods, such as the difficulty in resuming navigation after deviating from the route and the inaccuracy when navigating in complex environments. By training a compact convolutional neural network (CNN), the robot can successfully learn and return to the nest in both simulated and real forest environments, and can effectively compensate for the drift caused by the odometer even in places far away from the learning flight range. In addition, the paper also explores the influence of the initial learning flight trajectory on the network performance, and finds that when the density of sample points near the nest is higher, the return consistency is better.