Abstract:A flexible production model in which humans and robots collaborate has become an urgent need for industrial production. Therefore, research on human-machine integration systems has received more and more attention in recent years. Human-computer interaction is widely used in industrial production and entertainment life, such as industrial control, VR games, etc. In this article, we designed and implemented a human-machine fusion system that meets different interactive tasks. Human movement estimation and robot interactive control are the key technologies. First, we propose a human posture solution method based on information fusion of multiple cameras and inertial measurement units. This method constructs an optimization problem, fuses the 2D joint detection information under multiple cameras and the measurement information of the worn inertial measurement unit, and optimizes the estimation of human kinematic posture, which improves the problems of incomplete posture information and sensitivity to noise under a single sensor. Therefore, this method improves the accuracy of pose estimation. Secondly, combining the kinematic characteristics of the robot and the characteristics of human-computer interaction, we designed a robot control strategy based on target point tracking and model predictive control, so that the robot can adapt to dynamic environments and different interaction needs by adjusting control parameters. At the same time, our design ensures the safety of robots and operators. Finally, we conducted human-computer interaction experiments such as action following, item delivery, and active obstacle avoidance. The experimental results show the effectiveness and reliability of the designed robot interaction system in a human-machine fusion environment.

Human-robot Interaction Control for Industrial Robot Arm Through Software Platform for Agents and Knowledge Management.

Platform-Based Teleoperation Control of Symbiotic Human-Robot System.

Knowledge-Based Autonomous Behavior Control of Robots in A Symbiotic Human-Robot System

Knowledge Model-Based Adaptive Intelligent Control Of Robots For A Symbiotic Human-Robot System

Liberating Humanity from Heavy Labor: Dual-Arm Coordination and Teleoperation Control for an Assistive Robot

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

A Haptic Shared Control Architecture for Tracking of a Moving Object.

Knowledge-based Person-Centric Human-Robot Interaction Using Facial and Hand Gestures

Knowledge-based multiple robots coordinative operation using software platform

Adaptive Visual Gesture Recognition for Human-Robot Interaction

Knowledge model-based heterogeneous multi-robot system implemented by a software platform

The 18 th Annual Conference of the Japanese Society for Artificial Intelligence , 2004 Cooperative Operation of Symbiotic Human-Robot System Through SPAK 3 G 203

A Universal Self-Adaption Workspace Mapping Method for Human–Robot Interaction Using Kinect Sensor Data

Gesture Recognition for Human-Robot Interaction Through a Knowledge Based Software Platform

Proactive Robot Control for Collaborative Manipulation Using Human Intent

Progress and prospects of the human–robot collaboration

Improving human-robot interactivity for tele-operated industrial and service robot applications

Construction of Heterogeneous Multi-Robot System Based on Knowledge Model

Gesture Based Human-Robot Interaction Using a Frame Based Software Platform

Design of Human-Machine Integration System to Meet Diverse Interactive Tasks

A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information