Abstract:Automated analysis of mouse behaviours is crucial for many applications in neuroscience. However, quantifying mouse behaviours from videos or images remains a challenging problem, where pose estimation plays an important role in describing mouse behaviours. Although deep learning based methods have made promising advances in human pose estimation, they cannot be directly applied to pose estimation of mice due to different physiological natures. Particularly, since mouse body is highly deformable, it is a challenge to accurately locate different keypoints on the mouse body. In this paper, we propose a novel Hourglass network based model, namely Graphical Model based Structured Context Enhancement Network (GM-SCENet) where two effective modules, i.e., Structured Context Mixer (SCM) and Cascaded Multi-level Supervision (CMLS) are subsequently implemented. SCM can adaptively learn and enhance the proposed structured context information of each mouse part by a novel graphical model that takes into account the motion difference between body parts. Then, the CMLS module is designed to jointly train the proposed SCM and the Hourglass network by generating multi-level information, increasing the robustness of the whole network. Using the multi-level prediction information from SCM and CMLS, we develop an inference method to ensure the accuracy of the localisation results. Finally, we evaluate our proposed approach against several baselines on our Parkinson's Disease Mouse Behaviour (PDMB) and the standard DeepLabCut Mouse Pose datasets. The experimental results show that our method achieves better or competitive performance against the other state-of-the-art approaches.

Mouse Pose Estimation From Depth Images

3D mouse pose from single-view video and a new dataset

Estimate Hand Poses Efficiently from Single Depth Images

Optical Mouse: 3D Mouse Pose From Single-View Video

A Large-Scale Mouse Pose Dataset for Mouse Pose Estimation

Of Mice and Pose: 2D Mouse Pose Estimation from Unlabelled Data and Synthetic Prior

Hand pose estimation in depth image using CNN and random forest

3D Human Pose Estimation by Depth Map

Human Pose Estimation Combined With Depth Information

Monocular 3D Human Pose Estimation by Predicting Depth on Joints

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning

Human pose estimation method based on single depth image

Real-time human pose recognition in parts from single depth images

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

3D Human Body Shape and Pose Estimation from Depth Image.

Single Image Depth Map Estimation for Improving Posture Recognition

Real-Time Head Pose Estimation and Face Modeling from a Depth Image

Cascaded 3D Full-body Pose Regression from Single Depth Image at 100 FPS

Structured Context Enhancement Network for Mouse Pose Estimation

3D Hand Pose Estimation Using Randomized Decision Forest with Segmentation Index Points

Robust Estimation of 3D Human Poses from a Single Image