Abstract:In recent years, there has been a significant amount of research on algorithms and control methods for distributed collaborative robots. However, the emergence of collective behavior in a swarm is still difficult to predict and control. Nevertheless, human interaction with the swarm helps render the swarm more predictable and controllable, as human operators can utilize intuition or knowledge that is not always available to the swarm. Therefore, this paper designs the Dynamic Visualization Research Platform for Multimodal Human-Swarm Interaction (DVRP-MHSI), which is an innovative open system that can perform real-time dynamic visualization and is specifically designed to accommodate a multitude of interaction modalities (such as brain-computer, eye-tracking, electromyographic, and touch-based interfaces), thereby expediting progress in human-swarm interaction research. Specifically, the platform consists of custom-made low-cost omnidirectional wheeled mobile robots, multitouch screens and two workstations. In particular, the mutitouch screens can recognize human gestures and the shapes of objects placed on them, and they can also dynamically render diverse scenes. One of the workstations processes communication information within robots and the other one implements human-robot interaction methods. The development of DVRP-MHSI frees researchers from hardware or software details and allows them to focus on versatile swarm algorithms and human-swarm interaction methods without being limited to fixed scenarios, tasks, and interfaces. The effectiveness and potential of the platform for human-swarm interaction studies are validated by several demonstrative experiments.

A Multichannel Human-Swarm Robot Interaction System in Augmented Reality.

Design of Kinect-Based Human Robot Interaction Systems for A Robocup Middle Size League Soccer Robot

DVRP-MHSI: Dynamic Visualization Research Platform for Multimodal Human-Swarm Interaction

Omnipotent Virtual Giant for Remote Human-Swarm Interaction

A 3D Mixed Reality Interface for Human-Robot Teaming

Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Control

Development of a Synchronized Human-Robot-Virtuality Interaction System Using Cooperative Robot and Motion Capture Device

A Multimodal Emotional Communication Based Humans-Robots Interaction System

Mixed Reality as Communication Medium for Human-Robot Collaboration

A multimodal interface to situated assembly robot systems

A wearable general-purpose solution for Human-Swarm Interaction

Eye Movement-Based Human—Swarm Interaction for Coverage Control of Mobile Robots with Constraints

Human-Robot Interaction in a Shared Augmented Reality Workspace

ARROCH: Augmented Reality for Robots Collaborating with a Human

A Multi-sensor Gesture Interaction System for Human-robot Cooperation

Amplifying robotics capacities with a human touch: An immersive low-latency panoramic remote system

Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

Towards Decentralized Human-Swarm Interaction by Means of Sequential Hand Gesture Recognition

Real-Time Multi-modal Human-Robot Collaboration Using Gestures and Speech

Personalized Human-Swarm Interaction through Hand Motion

Swarm Robotics Platform for Intelligent Interaction.