Abstract:Perception capability assumes significant importance for human–robot interaction. The forthcoming industrial environments will require a high level of automation to be flexible and adaptive enough to comply with the increasingly faster and low-cost market demands. Autonomous and collaborative robots able to adapt to varying and dynamic conditions of the environment, including the presence of human beings, will have an ever-greater role in this context. However, if the robot is not aware of the human position and intention, a shared workspace between robots and humans may decrease productivity and lead to human safety issues. This paper presents a survey on sensory equipment useful for human detection and action recognition in industrial environments. An overview of different sensors and perception techniques is presented. Various types of robotic systems commonly used in industry, such as fixed-base manipulators, collaborative robots, mobile robots and mobile manipulators, are considered, analyzing the most useful sensors and methods to perceive and react to the presence of human operators in industrial cooperative and collaborative applications. The paper also introduces two proofs of concept, developed by the authors for future collaborative robotic applications that benefit from enhanced capabilities of human perception and interaction. The first one concerns fixed-base collaborative robots, and proposes a solution for human safety in tasks requiring human collision avoidance or moving obstacles detection. The second one proposes a collaborative behavior implementable upon autonomous mobile robots, pursuing assigned tasks within an industrial space shared with human operators.

Towards seamless human robot collaboration: integrating multimodal interaction

User-Interactive Robot Skin with Large-Area Scalability for Safer and Natural Human-Robot Collaboration in Future Telehealthcare

A Human-Robot Collaboration System for Object Handover

Seamless Human–Robot Collaborative Assembly Using Artificial Intelligence and Wearable Devices

Safe Multimodal Communication in Human-Robot Collaboration

Collaborative Conversation in Safe Multimodal Human-Robot Collaboration

IoT-Enabled Robot Skin System for Enhancement of Safe Human-Robot Interaction

Human-Robot Perception in Industrial Environments: A Survey

Progress and prospects of the human–robot collaboration

Advancing human-robot collaboration: Predicting operator trajectories through AI and infrared imaging

AR-based interaction for safe human-robot collaborative manufacturing

Towards Safe Multi-Level Human-Robot Interaction in Industrial Tasks

Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

Taking Charge of One's Own Safety While Collaborating with Robots: Enhancing Situational Awareness for a Safe Environment

Towards a Safe Human-Robot Collaboration Using Information on Human Worker Activity

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

Multimodal perception-fusion-control and human–robot collaboration in manufacturing: a review

Real time enhancement of operator's ergonomics in physical human-robot collaboration scenarios using a multi-stereo camera system

A Mixed-Perception Approach for Safe Human–Robot Collaboration in Industrial Automation