Review Ecosystems to access Educational XR Experiences: a Scoping Review

Shaun Bangay,Adam P.A. Cardilini,Sophie McKenzie,Maria Nicholas,Manjeet Singh
2024-03-26
Abstract:Educators, developers, and other stakeholders face challenges when creating, adapting, and utilizing virtual and augmented reality (XR) experiences for teaching curriculum topics. User created reviews of these applications provide important information about their relevance and effectiveness in supporting achievement of educational outcomes. To make these reviews accessible, relevant, and useful, they must be readily available and presented in a format that supports decision-making by educators. This paper identifies best practices for developing a new review ecosystem by analyzing existing approaches to providing reviews of interactive experiences. It focuses on the form and format of these reviews, as well as the mechanisms for sharing information about experiences and identifying which ones are most effective. The paper also examines the incentives that drive review creation and maintenance, ensuring that new experiences receive attention from reviewers and that relevant information is updated when necessary. The strategies and opportunities for developing an educational XR (eduXR) review ecosystem include methods for measuring properties such as quality metrics, engaging a broad range of stakeholders in the review process, and structuring the system as a closed loop managed by feedback and incentive structures to ensure stability and productivity. Computing educators are well-positioned to lead the development of these review ecosystems, which can relate XR experiences to the potential opportunities for teaching and learning that they offer.
Computers and Society,Social and Information Networks
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the challenges faced by educators, developers, and other stakeholders when creating, adapting, and using virtual reality (VR) and augmented reality (AR) experiences (collectively known as XR) for teaching. Specifically, user - generated reviews of these applications provide important information regarding their relevance and effectiveness, but currently, the access to these reviews is limited, and the format is not uniform, making it difficult to support educators in making decisions. Therefore, the paper aims to design and build an effective educational XR (eduXR) review ecosystem to ensure that reviews are easily accessible, properly formatted, and can support educators in quickly identifying and deploying XR experiences suitable for specific course content. ### Core Issues of the Paper 1. **The Current Situation of the Review Ecosystem**: The existing XR review ecosystems are either a sub - category of game reviews or still in the development stage, mainly existing as rating and ranking systems. Educational XR experiences are hardly represented in such systems. 2. **Challenges Faced by Teachers**: Teachers need to quickly identify and deploy XR experiences suitable for specific course content, but the existing review ecosystems cannot provide sufficiently specific and relevant information. Teachers need reviews created and formatted specifically for educational purposes to evaluate whether these experiences are suitable for their teaching environment and devices. 3. **Functional Requirements of the Review Ecosystem**: In order to make the review ecosystem operate effectively, it is necessary to consider how to represent reviews (form and format), ensure that the process of creating and presenting reviews meets the needs of stakeholders (utilization), and establish mechanisms for maintaining a stable and complex control system (ecosystem management). ### Solutions The paper solves the above problems in the following ways: - **Literature Review**: Analyze the existing game review ecosystems, extract best practices to determine strategies and opportunities that can be applied to the eduXR review ecosystem. - **Design Guidelines**: Propose a series of practical guidelines for establishing and enhancing the eduXR review ecosystem, thereby supporting further research and development. - **Community Building**: Emphasize the construction of a supportive peer community to ensure the authenticity and accuracy of reviews and verify the educational value of specific applications. ### Explanation of Formulas and Charts Although this article does not involve complex mathematical or physical formulas, charts are used when describing certain concepts. For example, Figure 1 shows the search trend of virtual reality reviews, indicating that "virtual reality" and "game reviews" are common terms, while "virtual reality reviews" are relatively rare. This shows that there is a gap in this area and an opportunity to create a specialized review ecosystem. Through these methods, the paper provides a theoretical basis and practical guidance for building an XR review ecosystem focused on educational needs.