Abstract:ABSTRACT Robust quantification of animal behavior is fundamental in experimental neuroscience research. Systems providing automated behavioral assessment are an important alternative to manual measurements avoiding problems such as human bias, low reproducibility and high cost. Integrating these tools with closed-loop control systems creates conditions to correlate environment and behavioral expressions effectively, and ultimately explain the neural foundations of behavior. We present an integrated solution for automated behavioral analysis of rodents using deep learning networks on video streams acquired from a depth-sensing camera. The use of depth sensors has notable advantages: tracking/classification performance is improved and independent of animals’ coat color, and videos can be recorded in dark conditions without affecting animals’ natural behavior. Convolutional and recurrent layers were combined in deep network architectures, and both spatial and temporal representations were successfully learned for a 4- classes behavior classification task (standstill, walking, rearing and grooming). Integration with Arduino microcontrollers creates an easy-to-use control platform providing low-latency feedback signals based on the deep learning automatic classification of animal behavior. The complete system, combining depth-sensor camera, computer, and Arduino microcontroller, allows simple mapping of input-output control signals using the animal’s current behavior and position. For example, a feeder can be controlled not by pressing a lever but by the animal behavior itself. An integrated graphical user interface completes a user-friendly and cost-effective solution for animal tracking and behavior classification. This open-software/open-hardware platform can boost the development of customized protocols for automated behavioral research, and support ever more sophisticated, reliable and reproducible behavioral neuroscience experiments.

Real-Time Closed-Loop Feedback in Behavioral Time Scales Using DeepLabCut

DeepBhvTracking: A Novel Behavior Tracking Method for Laboratory Animals Based on Deep Learning

Real-Time Selective Markerless Tracking of Forepaws of Head Fixed Mice Using Deep Neural Networks

DeepLabStream enables closed-loop behavioral experiments using deep learning-based markerless, real-time posture detection

Deep learning-based system for real-time behavior recognition and closed-loop control of behavioral mazes using depth sensing

Using DeepLabCut-Live to probe state dependent neural circuits of behavior with closed-loop optogenetic stimulation

Behavioral tracking gets real

Markerless tracking of user-defined features with deep learning

Pixying Behavior: A Versatile Real-Time and Post Hoc Automated Optical Tracking Method for Freely Moving and Head Fixed Animals

KineWheel-DeepLabCut Automated Paw Annotation Using Alternating Stroboscopic UV and White Light Illumination

Deep-learning two-photon fiberscopy for video-rate brain imaging in freely-behaving mice

Automatic mapping of multiplexed social receptive fields by deep learning and GPU-accelerated 3D videography

High-Precision, Three-Dimensional Tracking of Mouse Whisker Movements with Optical Motion Capture Technology

DeepLabCut: markerless pose estimation of user-defined body parts with deep learning

Murine Motion Behavior Recognition Based on DeepLabCut and Convolutional Long Short-Term Memory Network

Multimodal Deep Learning Model Unveils Behavioral Dynamics of V1 Activity in Freely Moving Mice

High-resolution in vivo kinematic tracking with injectable fluorescent nanoparticles

Markerless Mouse Tracking for Social Experiments

Automated measurement of mouse social behaviors using depth sensing, video tracking, and machine learning

A deep learning-based approach for real-time rodent detection and behaviour classification

A Head-Mounted Multi-Camera System for Electrophysiology and Behavior in Freely-Moving Mice