Abstract:In many practical scenarios, a flying insect must search for the source of an emitted cue which is advected by the atmospheric wind. On the macroscopic scales of interest, turbulence tends to mix the cue into patches of relatively high concentration over a background of very low concentration, so that the insect will only detect the cue intermittently and cannot rely on chemotactic strategies which simply climb the concentration gradient. In this work, we cast this search problem in the language of a partially observable Markov decision process (POMDP) and use the Perseus algorithm to compute strategies that are near-optimal with respect to the arrival time. We test the computed strategies on a large two-dimensional grid, present the resulting trajectories and arrival time statistics, and compare these to the corresponding results for several heuristic strategies, including (space-aware) infotaxis, Thompson sampling, and QMDP. We find that the near-optimal policy found by our implementation of Perseus outperforms all heuristics we test by several measures. We use the near-optimal policy to study how the search difficulty depends on the starting location. We discuss additionally the choice of initial belief and the robustness of the policies to changes in the environment. Finally, we present a detailed and pedagogical discussion about the implementation of the Perseus algorithm, including the benefits -- and pitfalls -- of employing a reward shaping function.

On Optimal Tempered Lévy Flight Foraging

Optimal Lévy-Flight Foraging with a Finite Flight Distance

Optimizing the random search of a finite-lived target by a Lévy flight

Emergence of Lévy walks from second order stochastic optimization

A Counterexample to the Lévy Flight Foraging Hypothesis in the Narrow Capture Framework

Optimal search in interacting populations: Gaussian jumps versus Lévy flights

First Order Transition for the Optimal Search Time of Lévy Flights with Resetting

Lévy flight movements prevent extinctions and maximize population abundances in fragile Lotka Volterra systems

Survey of Lévy Flight-Based Metaheuristics for Optimization

Distributed Swarm Trajectory Optimization for Formation Flight in Dense Environments

Geodesic Lévy flights and expected stopping time for random searches

Pre-asymptotic analysis of Lévy flights

Lévy flights and self-similar exploratory behaviour of termite workers: beyond model fitting

Survey of Levy Flight-Based Metaheuristics for Optimization

Search for Food of Birds, Fish and Insects

Collective foraging in heterogeneous landscapes

Optimal policies for Bayesian olfactory search in turbulent flows

Search in Random Media with Lévy Flights

Intermittent Inverse-Square Lévy Walks are Optimal for Finding Targets of All Sizes

Efficient search by optimized intermittent random walks