Abstract:The constructive need for robots to coexist with humans requires human-machine interaction. It is a challenge to operate these robots in such dynamic environments, which requires continuous decision-making and environment-attribute update in real-time. An autonomous robot guide is well suitable in places such as museums, libraries, schools, hospital, etc. This paper addresses a scenario where a robot tracks and follows a human. A neural network is utilized to learn the skin and nonskin colors. The skin-color probability map is utilized for skin classification and morphology-based preprocessing. Heuristic rule is used for face-ratio analysis and Bayesian cost analysis for label classification. A face-detection module, based on a 2D color model in the and YUV color space, is selected over the traditional skin-color model in a 3D color space. A modified continuously adaptive mean shift tracking mechanism in a 1D hue, saturation, and value color space is developed and implemented onto the mobile robot. In addition to the visual cues, the tracking process considers 16 sonar scan and tactile sensor readings from the robot to generate a robust measure of the person's distance from the robot. The robot thus decides an appropriate action, namely, to follow the human subject and perform obstacle avoidance. The proposed approach is orientation invariant under varying lighting conditions and invariant to natural transformations such as translation, rotation, and scaling. Such a multimodal solution is effective for face detection and tracking.

Human-Robot Teaming and Coordination in Day and Night Environments

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

Robot recognizing humans intention and interacting with humans based on a multi-task model combining ST-GCN-LSTM model and YOLO model

Fusing monocular vision and laser range data for human detection and tracking via multi-robot collaboration

Towards Efficient Human-Robot Collaboration With Robust Plan Recognition and Trajectory Prediction

Day and night collaborative dynamic mapping in unstructured environment based on multimodal sensors

Human-robot Interaction Method Combining Human Pose Estimation and Motion Intention Recognition

Towards Better Human Robot Collaboration with Robust Plan Recognition and Trajectory Prediction

A Vision-Based Measure of Environmental Effects on Inferring Human Intention During Human Robot Interaction

Towards safe robot-human collaboration systems using human pose detection

Multimodal Approach to Human-Face Detection and Tracking

Towards a Safe Human-Robot Collaboration Using Information on Human Worker Activity

Human-robot cooperation using Kinect

Human-Robot Teams in Entertainment and Other Everyday Scenarios

Enabling Human-Robot Collaboration via Holistic Human Perception and Partner-Aware Control

Robot Skill Learning and Generalization Based on Human-robot Collaboration and Computer Vision

Human-robot collaboration in a Mobile Visual Sensor Network

A Robot-in-the-loop Face Detection and Recognition System with Coordinaive Control Platform

On the Evaluation of Diverse Vision Systems towards Detecting Human Pose in Collaborative Robot Applications

An Integrated Vision-Based System for Efficient Robot Arm Teleoperation