Abstract:ABSTRACT Robust quantification of animal behavior is fundamental in experimental neuroscience research. Systems providing automated behavioral assessment are an important alternative to manual measurements avoiding problems such as human bias, low reproducibility and high cost. Integrating these tools with closed-loop control systems creates conditions to correlate environment and behavioral expressions effectively, and ultimately explain the neural foundations of behavior. We present an integrated solution for automated behavioral analysis of rodents using deep learning networks on video streams acquired from a depth-sensing camera. The use of depth sensors has notable advantages: tracking/classification performance is improved and independent of animals’ coat color, and videos can be recorded in dark conditions without affecting animals’ natural behavior. Convolutional and recurrent layers were combined in deep network architectures, and both spatial and temporal representations were successfully learned for a 4- classes behavior classification task (standstill, walking, rearing and grooming). Integration with Arduino microcontrollers creates an easy-to-use control platform providing low-latency feedback signals based on the deep learning automatic classification of animal behavior. The complete system, combining depth-sensor camera, computer, and Arduino microcontroller, allows simple mapping of input-output control signals using the animal’s current behavior and position. For example, a feeder can be controlled not by pressing a lever but by the animal behavior itself. An integrated graphical user interface completes a user-friendly and cost-effective solution for animal tracking and behavior classification. This open-software/open-hardware platform can boost the development of customized protocols for automated behavioral research, and support ever more sophisticated, reliable and reproducible behavioral neuroscience experiments.

DeepLabStream enables closed-loop behavioral experiments using deep learning-based markerless, real-time posture detection

DeepBhvTracking: A Novel Behavior Tracking Method for Laboratory Animals Based on Deep Learning

DeepLabCut: markerless pose estimation of user-defined body parts with deep learning

Deep learning-based system for real-time behavior recognition and closed-loop control of behavioral mazes using depth sensing

Real-Time Closed-Loop Feedback in Behavioral Time Scales Using DeepLabCut

BehaviorDEPOT is a simple, flexible tool for automated behavioral detection based on markerless pose tracking

Using DeepLabCut-Live to probe state dependent neural circuits of behavior with closed-loop optogenetic stimulation

Deep learning tools for the measurement of animal behavior in neuroscience

The Lab Streaming Layer for Synchronized Multimodal Recording

Markerless tracking of user-defined features with deep learning

Real-Time Selective Markerless Tracking of Forepaws of Head Fixed Mice Using Deep Neural Networks

DeepRod: A human-in-the-loop system for automatic rodent behavior analysis

Automatic mapping of multiplexed social receptive fields by deep learning and GPU-accelerated 3D videography

SLEAP: Multi-animal pose tracking

A Portable Telemetry System for Brain Stimulation and Neuronal Activity Recording in Freely Behaving Small Animals

SLEAP: A Deep Learning System for Multi-Animal Pose Tracking

PMotion: An advanced markerless pose estimation approach based on novel deep learning framework used to reveal neurobehavior

Markerless Mouse Tracking for Social Experiments

RpiBeh: a multi-purpose open-source solution for real-time tracking and behavior-driven closed-loop interventions in rodent neuroethology

DeepEthogram, a machine learning pipeline for supervised behavior classification from raw pixels

Behavioral tracking gets real