VRtefacts: Performative Substitutional Reality with Museum Objects

Jocelyn Spence,Dimitrios Paris Darzentas,Yitong Huang,Harriet R. Cameron,Eleanor Beestin,Steve Benford

DOI: https://doi.org/10.1145/3357236.3395459

2020-01-01

Abstract:We explore how a combination of manipulations and transitions can extend Substitutional Reality to create a highly personal Virtual Reality experience. Our design aimed to meet two challenges faced by museums: the limitations of object handling and the desire for visitors to create their own interpretations. Using a Research-through-Design methodology, we built a performance-led Mixed Reality experience that lets museum visitors physically handle 3D prints or scans of museum objects and share personal stories about them. They can then donate their stories to the museum. We reflect on the complex design and findings gained from an in-the-wild deployment to explore engagement and disruption through manipulations of physicality, visuals, and scale; transitions between spaces; and a trajectory of storytelling performance. We chart a wide scope for Performative Substitutional Reality and draw implications for VR, MR, and performance-led research.