Augmented Reality and Cross-Device Interaction for Seamless Integration of Physical and Digital Scientific Papers

Md Ochiuddin Miah,Jun Kong

DOI: https://doi.org/10.1101/2024.02.05.578116

2024-02-18

Abstract:Researchers face the challenge of efficiently navigating vast scientific literature while valuing printed papers in the digital age. Printed materials facilitate deeper engagement and comprehension, leading to superior exam performance and enhanced retention. However, existing digital tools often need to pay more attention to the needs of researchers who value the tactile benefits of printed documents. In response to this gap, we introduce AR-PaperSync, a transformative solution that leverages Augmented Reality (AR) and cross-device interaction technology. AR-PaperSync seamlessly integrates the physical experience of printed papers with the interactive capabilities of digital tools. Researchers can effortlessly navigate inline citations, manage saved references, and synchronize reading notes across mobile, desktop, and printed paper formats. Our user-centric approach, informed by in-depth interviews with six researchers, ensures that AR-PaperSync is tailored to its target users’ needs. A comprehensive user study involving 28 participants evaluated AR-PaperSync’s significantly improved efficiency, accuracy, and cognitive load in academic reading tasks compared to conventional methods. These findings suggest that AR-PaperSync enhances the reading experience of printed scientific papers and provides a seamless integration of physical and digital reading environments for researchers.

Scientific Communication and Education

What problem does this paper attempt to address?

The problem this paper attempts to address is: In the digital age, how can researchers efficiently browse through a large volume of scientific literature while retaining the depth of engagement and comprehension that paper-based literature provides? Although existing digital tools offer many convenient features, they often overlook the needs of researchers who value the tactile experience of paper documents. Specifically, the paper identifies the following major issues:

1. **Difficulty in citation navigation**: When reading paper-based literature, the manual process of locating inline citations is time-consuming and disrupts the flow of reading.
2. **Cumbersome citation management**: Saving and managing citations from paper-based literature requires a significant amount of manual labor. Traditional methods usually involve manual cataloging and organization, which are inefficient and lack flexibility.
3. **Difficulty in note synchronization**: Synchronizing reading notes and insights between paper and digital formats is highly challenging, leading to fragmented research workflows, increased cognitive load, and a higher likelihood of missing critical information.

To address these challenges, the paper introduces an innovative solution called AR-PaperSync. AR-PaperSync leverages augmented reality (AR) and cross-device interaction technologies to seamlessly integrate the physical experience of paper-based literature with the interactive capabilities of digital tools. Specifically, AR-PaperSync can:

- Easily access inline citations in paper-based literature through a mobile AR application.
- Enable real-time management and organization of citations.
- Synchronize reading notes across mobile, desktop, and paper formats, ensuring continuity and consistency in research activities.

Through these features, AR-PaperSync aims to enhance researchers' reading efficiency and accuracy, reduce cognitive load, and provide a seamless integration of physical and digital reading environments.