Abstract:Interface design for Human-Robot Interaction (HRI) will soon become one of the toughest challenges that the field of robotics faces (Thrun 2004). As HRI interfaces mature it will become more common for humans and robots to work together in a collaborative manner. Although robotics is well established as a research field, there has been relatively little work on human-robot collaboration. There are many application domains that would benefit from effective human-robot collaborative interaction. For example, in space exploration, recent research has pointed out that to reduce human workload, costs, fatigue driven errors and risks, intelligent robotic systems will need to be a significant part of mission design (Fong and Nourbakhsh 2005). Fong and Nourbakhsh also observe that scant attention has been paid to joint human-robot teams, and that making human-robot collaboration natural and efficient is crucial to future space exploration. Effective human–robot collaboration will also be required for terrestrial applications such as Urban Search and Rescue (US&R) and tasks completed robotically in hazardous environments, such as removal of nuclear waste. There is a need for research on different types of HRI systems. This chapter reports on the development of the Augmented Reality Human-Robot Collaboration (AR-HRC) system (Green, Billinghurst et al. 2008). Fundamentally, this system enables humans to communicate with robotic systems in a natural manner through spoken dialog and gesture interaction, using Augmented Reality technology for visual feedback. This approach is in contrast to the typical reliance on a narrow communication link. Truly effective collaboration among any group can take place only when the participants are able to communicate in a natural and effective manner. Communicating in a natural manner for humans typically means using a combination of speech, gesture and non-verbal cues such as gaze. Grounding, the common understanding between conversational participants (Clark and Brennan 1991), shared spatial referencing and spatial awareness are well-known crucial components of communication and therefore collaboration.

Alternative Interfaces for Human-initiated Natural Language Communication and Robot-initiated Haptic Feedback: Towards Better Situational Awareness in Human-Robot Collaboration

Human–robot interaction via voice-controllable intelligent user interface

Intuitive Spatial Tactile Feedback for Better Awareness about Robot Trajectory during Human-Robot Collaboration

Improved Mutual Understanding for Human-Robot Collaboration: Combining Human-Aware Motion Planning with Haptic Feedback Devices for Communicating Planned Trajectory

See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot

Robots Taking Initiative in Collaborative Object Manipulation: Lessons from Physical Human-Human Interaction

An Augmented Reality Human-Robot Collaboration System

Towards seamless human robot collaboration: integrating multimodal interaction

Communicating Inferred Goals with Passive Augmented Reality and Active Haptic Feedback

Adapting to Human Preferences to Lead or Follow in Human-Robot Collaboration: A System Evaluation

Haptic-ACT: Bridging Human Intuition with Compliant Robotic Manipulation via Immersive VR

Hands-On Robotics: Enabling Communication Through Direct Gesture Control

Real-Time Adaptive Industrial Robots: Improving Safety And Comfort In Human-Robot Collaboration

Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Control

Facilitating Human-Robot Collaboration through Natural Vocal Conversations

Progress and prospects of the human–robot collaboration

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

Robot System Assistant (RoSA): Towards Intuitive Multi-Modal and Multi-Device Human-Robot Interaction

Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

Experimental study on haptic communication of a human in a shared human-robot collaborative task

Spoken language interaction with robots: Recommendations for future research