Abstract:Naturally occurring collective motion is a fascinating phenomenon in which swarming individuals aggregate and coordinate their motion. Many theoretical models of swarming assume idealized, perfect perceptual capabilities, and ignore the underlying perception processes, particularly for agents relying on visual perception. Specifically, biological vision in many swarming animals, such as locusts, utilizes monocular non-stereoscopic vision, which prevents perfect acquisition of distances and velocities. Moreover, swarming peers can visually occlude each other, further introducing estimation errors. In this study, we explore necessary conditions for the emergence of ordered collective motion under restricted conditions, using non-stereoscopic, monocular vision. We present a model of vision-based collective motion for locust-like agents: elongated shape, omni-directional visual sensor parallel to the horizontal plane, and lacking stereoscopic depth perception. The model addresses (i) the non-stereoscopic estimation of distance and velocity, (ii) the presence of occlusions in the visual field. We consider and compare three strategies that an agent may use to interpret partially-occluded visual information at the cost of the computational complexity required for the visual perception processes. Computer-simulated experiments conducted in various geometrical environments (toroidal, corridor, and ring-shaped arenas) demonstrate that the models can result in an ordered or near-ordered state. At the same time, they differ in the rate at which order is achieved. Moreover, the results are sensitive to the elongation of the agents. Experiments in geometrically constrained environments reveal differences between the models and elucidate possible tradeoffs in using them to control swarming agents. These suggest avenues for further study in biology and robotics. Swarm collective motion is a wide-ranging phenomenon in nature, with applications in multi-agent, multi-robot systems. In most natural swarming species, individuals rely on monocular, non-stereoscopic vision as the key sensory modality for their interactions. For example, the desert locust ( Schistocerca gregaria ) displays large swarms of individuals, moving in alignment and relying solely on non-stereoscopic visual perception. Inspired by these locust swarms, we have developed a monocular, non-stereoscopic vision-based model that achieves synchronized motion in a swarm of two-dimensional agents, even with inaccurate estimates of distances and velocities, particularly in the presence of occlusions. We explore three general strategies for handling occlusions, which differ in the requirements they place on the complexity of the visual perception process. We show that strategies may reach a highly ordered motion state but differ in their rate of convergence to this ordered state.

Modeling collective behaviors from optic flow and retinal cues

Visual collective behaviors on spherical robots

Modeling Three-Dimensional Bait Ball Collective Motion.

Vision-based collective motion: A locust-inspired reductionist model

Collective behaviors of animal groups may stem from visual lateralization—Tending to obtain information through one eye

Collective behavior of self-steering active particles with velocity alignment and visual perception

Zebrafish collective behaviour in heterogeneous environment modeled by a stochastic model based on visual perception

Selective decision-making and collective behavior of fish by the motion of visual attention

Modeling, Analysis, and Optimization of Three-Dimensional Restricted Visual Field Metric-Free Swarms

Body orientation change of neighbors leads to scale-free correlation in collective motion

Boltzmann approach to collective motion via non-local visual interaction

Boltzmann approach to collective motion via nonlocal visual interaction

The visual coupling between neighbours explains local interactions underlying human 'flocking'

The Emergence of Collective Obstacle Avoidance Based on a Visual Perception Mechanism

A collective perception model for neighbor selection in groups based on visual attention mechanisms

Emergence of Collective Adaptive Response Based on Visual Variation

Collective Dynamics of Intelligent Active Brownian Particles with Visual Perception and Velocity Alignment in 3D: Spheres, Rods, and Worms

Emergence of Adaptation of Collective Behavior Based on Visual Perception

An agent-based approach for modelling collective dynamics in animal groups distinguishing individual speed and orientation

Intrinsically motivated collective motion

Purely vision-based collective movement of robots