Abstract:Automated behavior quantification in socially interacting animals requires accurate tracking. While many methods have been very successful and highly generalizable to different settings, issues of mistaken identities and lost information on key anatomical features are common, although they can be alleviated by increased human effort in training or post-processing. We propose a markerless video-based tool to simultaneously track two interacting mice of the same appearance in controlled settings for quantifying behaviors such as different types of sniffing, touching, and locomotion to improve tracking accuracy under these settings without increased human effort. It incorporates conventional handcrafted tracking and deep-learning-based techniques. The tool is trained on a small number of manually annotated images from a basic experimental setup and outputs body masks and coordinates of the snout and tail-base for each mouse. The method was tested on several commonly used experimental conditions including bedding in the cage and fiberoptic or headstage implants on the mice. Results obtained without any human corrections after the automated analysis showed a near elimination of identities switches and a ~15% improvement in tracking accuracy over pure deep-learning-based pose estimation tracking approaches. Our approach can be optionally ensembled with such techniques for further improvement. Finally, we demonstrated an application of this approach in studies of social behavior of mice by quantifying and comparing interactions between pairs of mice in which some lack olfaction. Together, these results suggest that our approach could be valuable for studying group behaviors in rodents, such as social interactions.

BeCAPTCHA-Mouse: Synthetic mouse trajectories and improved bot detection

DMTG: A Human-Like Mouse Trajectory Generation Bot Based on Entropy-Controlled Diffusion Networks

A Deep Learning Approach to Web Bot Detection Using Mouse Behavioral Biometrics

Poster: Can It Be More Practical? Improving Mouse Dynamics Biometric Performance

SapiMouse: Mouse Dynamics-based User Authentication Using Deep Feature Learning

A Posture Recognition System for Rat Cyborg Automated Navigation

User Authentication and Identity Inconsistency Detection via Mouse-trajectory Similarity Measurement

User Authentication Through Mouse Dynamics

Creating a Bot-tleneck for malicious AI: Psychological methods for bot detection

MouseIdentity: Modeling Mouse-Interaction Behavior for a User Verification System

Continuous Authentication Using Mouse Clickstream Data Analysis

T-Detector: A Trajectory Based Pre-trained Model for Game Bot Detection in MMORPGs

Intrusion detection using mouse dynamics

An Efficient User Verification System Using Angle-Based Mouse Movement Biometrics

Continuous authentication for mouse dynamics: A pattern-growth approach

Continuous Authentication Using Mouse Movements, Machine Learning, and Minecraft

Feature analysis of mouse dynamics in identity authentication and monitoring

Comparing classification algorithm for mouse dynamics based user identification

Continuous User Authentication Using Mouse Dynamics, Machine Learning, and Minecraft

Markerless Mouse Tracking for Social Experiments

From Clicks to Security: Investigating Continuous Authentication via Mouse Dynamics