Mixed reality and digital twins for astronaut training

Octavio Piñal,Amadeo Arguelles
DOI: https://doi.org/10.1016/j.actaastro.2024.01.034
IF: 2.954
2024-02-01
Acta Astronautica
Abstract:Astronaut training is a complex activity given its nature; the infrastructure and equipment required are very specific and expensive. Immersive technologies have the capability to simulate complete environments and allow users to interact with them. The effectiveness of immersive technologies for training and learning activities has already been addressed in various works. However, merely simulating scenarios is not enough; participants need to interact with vehicles, machines, and spacecraft systems to see how they affect the environment and surrounding objects. This study develops four scenarios across three modules, inspired by NASA and ESA astronaut training programs. The first module introduces a theoretical scenario visualized through mixed reality (MR) with topics from ESA’s training module. The second module presents two practical scenarios: an ISS emergency simulation involving Hohmann transfer and circular motion concepts, and a spacewalk for repair and maintenance tasks, in these scenarios, the digital twins of the ISS propulsion and navigation systems were developed as well as the digital twin of a space suit. The third module simulates a spaceship launch, utilizing 3D models from SpaceX’s Falcon Heavy and digital twins of the propulsion and navigation systems. During the interaction of the participants with the digital twins and the scenarios, the data generated is stored in a database so it can be analyzed and compared against the ISS dataset from the Jet Propulsion Laboratory (JPL) and the telemetry from SpaceX Falcon heavy launch. In the first phase of this work, the main goal was to check if digital twins can be implemented in conjunction with immersive technologies and therefore be suitable for training activities. We used a mean squared error metric between the digital twins and the physic object data, demonstrating that developed digital twins closely align with physical systems, validating their efficacy for astronaut training.
engineering, aerospace
What problem does this paper attempt to address?