Abstract:In remote collaboration for emergency maintenance or training, since local workers may lack relevant experience and knowledge, it is very important to support remote experts to annotate 3D spatial areas for local workers in their workspace, such as risky spatial areas that need to be avoided for safe operation when assembling replacement parts. Recently, many researchers have studied various visual communication cues for expressing spatial information in Mixed Reality (MR) remote collaboration systems for physical tasks. However, the expression and transmission of 3D spatial area information have not been well explored, especially in tasks that need to annotate specific spatial areas in 3D space (such as risky 3D spatial areas). In the study, we developed a novel MR remote collaboration system that supports remote experts using 3D spatial area cues and visual notification to create Augmented Reality (AR) instructions for local workers on the shared 3D stereoscopic scene of the local workspace in the Virtual Reality (VR) space. We performed a user study to explore the effect of three interfaces on remote collaborative physical assembly tasks in the workspace with risky 3D spatial areas: 3D sketch cue (3DS) which is the baseline solution, 3D sketch cue combines the novel 3D spatial area cue (3DSA), and 3D sketch cue combines 3D spatial area cue and visual notification (3DSAN). We found the 3DSAN can significantly improve collaboration efficiency, reduce operation errors, and improve the usability and collaboration experience (especially the level of awareness), among industrial remote collaborative physical tasks requiring 3D spatial area reference.

PiMarking: co-located collaborative digital annotating on large tabletops

Multi-user collaborative exploration of map and decision-making on a multi-touch tabletop

Using the CAT for 3D Sketching in Front of Large Displays

Marker design and recognition on tiled interaction tabletop

CSPM: A Novel Curtain Style Pictorial Marker for Enhancing Augmented Reality Experiences.

MixPad: augmenting interactive paper with mice & keyboards for cross-media and fine-grained interaction with documents.

Multi-Objects Online Individual Marking For Operational Test

Umeeting, An Efficient Co-Located Meeting System On The Large-Scale Tabletop

MarkIt: A Collaborative Artificial Intelligence Annotation Platform Leveraging Blockchain For Medical Imaging Research

Finger Gesture Interaction On Large Tabletop For Sharing Digital Documents Among Multiple Users

pPen: enabling authenticated pen and touch interaction on tabletop surfaces

Interactive 3D Editing on Tiled Display Wall

Synchronous Multi-Objects Individual Marking Model

A Novel Approach for Sharing White Board Between PC and PDAs with Multi-users.

An Intelligent Interactive Pen-Based Whiteboard For Dynamic Geometry Teaching

A Novel MR Remote Collaboration System Using 3D Spatial Area Cue and Visual Notification

A Pen Locating Scheme for Large-Size Electronic Whiteboards

coisTable: An Individual-and-Spatial-Aware Tabletop System for Co-located Collaboration

Design and Implementation of Software of Online Marking Based on SQL Database

KD-ARES:Registration Based on Markers in Wide-area

Do You Know What I Mean? an MR-Based Collaborative Platform