Abstract:Human motion detection in complex scenarios poses challenges due to occlusions. This paper presents an integrated approach for accurate human motion detections by combining Adapted Canny Edge detection as a preprocessing step, backbone-modified Mask R-CNN for precise segmentation, Hybrid RDA-WOA-based RNN as a classification, and a Multiple-hypothesis model for effective occlusion handling. Adapted Canny Edge detection is utilized as an initial preprocessing step to highlight significant edges in the input image. The resulting edge map enhances object boundaries and highlights structural features, simplifying subsequent processing steps. The improved image is then passed through backbone-modified Mask R-CNN for the pixel-level segmentation of humans. Backbone-modified Mask R-CNN along with IoU, Euclidean Distance, and Z-Score recognizes moving objects in complex scenes exactly. After recognizing moving objects, the optimized Hybrid RDA-WOA-based RNN classifies humans. To handle the self-occlusion, Multiple Hypothesis Tracking (MHT) is used. Real-world situations frequently include occlusions where humans can be partially or completely hidden by objects. The proposed approach integrates a Multiple-hypothesis model into the detection pipeline to address this challenge. Moreover, the proposed human motion detection approach includes an optimized Hybrid RDA-WOA-based RNN trained with 2D representations of 3D skeletal motion. The proposed work was evaluated using the IXMAS, KTH, Weizmann, NTU RGB + D, and UCF101 Datasets. It achieved an accuracy of 98% on the IXMAS, KTH, Weizmann, and UCF101 Datasets and 97.1% on the NTU RGB + D Dataset. The simulation results unveil the superiority of the proposed methodology over the existing approaches.

Multi-view Moving Human Detection and Correspondence Based on Object Occupancy Random Field

Tracking Multiple People under Occlusion and Across Cameras Using Probabilistic Models

A Novel Method For Real-Time Object Detection And Multiple Persons Tracking

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

Multi-view Aggregation for Real-Time Accurate Object Detection of a Moving Camera

Multiple Human Tracking Based on Multi-view Upper-Body Detection and Discriminative Learning

Multiple Human Association and Tracking from Egocentric and Complementary Top Views

Omni-directional Vision Based Human Motion Detection for Autonomous Mobile Robots

Human Posture Tracking in a Multi-Camera Environment

Deep Occlusion Reasoning for Multi-camera Multi-target Detection

Unveiling personnel movement in a larger indoor area with a non-overlapping multi-camera system

A Robust Approach for Person Localization in Multi-camera Environment

Omnidirectional Vision for Mobile Robot Human Body Detection and Localization

Human detection and tracking using apparent features under multi-cameras with non-overlapping

Human Motion Tracking by Multiple RGBD Cameras.

Learning Occupancy for Monocular 3D Object Detection

Detecting and tracking people in real time with RGB-D camera

Occupancy Measurement by Object Tracking at Building Entrances

Multiple Human Association between Top and Horizontal Views by Matching Subjects' Spatial Distributions

Enhanced human motion detection with hybrid RDA-WOA-based RNN and multiple hypothesis tracking for occlusion handling