Abstract:Abstract Although methods for tracking animals underwater exist, they frequently involve costly infrastructure investment, or capture and manipulation of animals to affix or implant tags. These practical concerns limit the taxonomic coverage of aquatic movement ecology studies and implementation in areas where high infrastructure investment is impossible. Here we present a method based on deep-learning and structure-from-motion, with which we can accurately determine the 3D location of animals, the structure of the environment in which they are moving. Further behavioural decomposition of the body position and contour of animals subsequently allow quantifying the behavioural states of each interacting animal. This approach can be used with minimal infrastructure and without confining animals to to a fixed area, or capturing and interfering with them in any way. With this approach, we are able to track single individuals (Conger Eel, Conger oceanus ), small heterospecific groups ( Mullus surmuletus, Diplodus sp .), and schools of animals (Tanganyikan cichlids Lamprologus callipterus ) in freshwater and marine systems, and in habitats ranging in environmental complexity. Positional information was highly accurate, with errors as low as 1.67% of body length. Tracking data was embedded in 3D environmental models that could be used to examine collective decision making, obstacle avoidance, and visual connectivity of groups. By analyzing body contour and position, we were also able to use unsupervised classification to quantify the kinematic behavioural states of each animal. The proposed framework allows us to understand animal behaviour in aquatic systems at an unprecedented resolution and a fraction of the cost of established methodologies, with minimal domain expertise at the data acquisition or analysis phase required. Implementing this method, research can be conducted in a wide range of field contexts to collect laboratory standard data, vastly expanding both the taxonomic and environmental coverage of quantitative animal movement analysis with a low-cost, open-source solution.

: A Low-Cost, Open, Autonomous Tracking Microscope for Long-Term Observations of Microscale Organisms

Underwater Three-Dimensional Microscope for Marine Benthic Organism Monitoring

Motile microorganism tracking system using micro-visual servo control

A low-cost, open-source framework for tracking and behavioural analysis of animals in aquatic ecosystems

Orthogonal-view Microscope for the Biomechanics Investigations of Aquatic Organisms

An oblique plane microscope for mesoscopic imaging of freely moving organisms with cellular resolution

Swimming Microrobot Optical Nanoscopy

Aquavert: Imaging and Microfluidics for Vertical Swimming of Microorganisms

Millisecond insect tracking system

High-resolution, non-invasive animal tracking and reconstruction of local environment in aquatic ecosystems

An Agar Gel Membrane-Pdms Hybrid Microfluidic Device for Long Term Single Cell Dynamic Study

Automated Tracking System for Time Lapse Observation of C. Elegans

A three-camera imaging microscope for high-speed single-molecule tracking and super-resolution imaging in living cells

MEMTRACK: A Deep Learning-Based Approach to Microrobot Tracking in Dense and Low-Contrast Environments

Design and Experiments with a Robot-Driven Underwater Holographic Microscope for Low-Cost In Situ Particle Measurements

MSBOTS: a Multiple Small Biological Organism Tracking System Robust Against Non-Ideal Detection and Segmentation Conditions.

Tracking Motile Algal Cells with a Deformable Model

Simultaneous Behavioral and Neuronal Imaging by Tracking Microscopy

Automated Single Particle Detection and Tracking for Large Microscopy Datasets.

Tracking and navigation of a microswarm under laser speckle contrast imaging for targeted delivery

Real-time 3D tracking of swimming microbes using digital holographic microscopy and deep learning