Abstract:Visually impaired (VI) people encounter difficulties in their regular activities including learning. Providing them equal opportunity is crucial, especially in virtual learning environment (VLE), as limited applications are available. A variety of technology-assisted and non-technology-assisted tools are available for the VI to assist in their daily activities. However, VI learners do not use virtual learning applications due to rich media involvement, which is unsuitable for them. Haptic or sense of touch is one of the technologies useful in VLE for VI learners. It can be used with audio sense and olfactory as additional senses to enhance the learning experience. This research aims to design a learning framework to develop a virtual learning environment for the VI learner. The study aims to design a framework to develop an application for the VI in a VLE, and validate the framework by conducting usability testing. The questionnaire for adult VI was adopted from the USE questionnaire, which tests the Usability, Satisfaction as well as Ease of Use, and Ease of Learning of the application. Questionnaire for children VI tested the application's effectiveness, operability, efficiency, and satisfaction. A total of 26 VI participated, and 21 of them are VI adults while 5 are VI children. Based on the usability with VI adults, average ratings are above 5 out of 7, and for the usability testing with VI children, average ratings are 3.7 and above out of 5. Hence, the rating obtained from usability tests were above average. The research was solely based on the Malaysian context and used only one haptic device. Thus, different haptic devices can be used to compare their effectiveness. The research can also be enhanced in other countries for learners with disabilities such as deaf, blind, and mute learners in learning calligraphy-based languages.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
What problem does this paper attempt to address?
The problem this paper attempts to address is the difficulties faced by visually impaired individuals in their daily activities and learning, especially in virtual learning environments, due to the lack of applications suitable for them to fully utilize the rich media content available. To provide equal learning opportunities for visually impaired individuals, this study aims to design a multisensory learning framework and develop a virtual learning environment suitable for visually impaired individuals. Specifically, this study aims to enhance the learning experience and effectiveness of visually impaired individuals in virtual learning environments by combining multisensory technologies such as tactile, auditory, and olfactory senses.
### Main Objectives of the Paper:
1. **Design a Multisensory Learning Framework**: Develop a virtual learning environment that integrates multisensory technologies such as tactile, auditory, and olfactory senses to meet the learning needs of visually impaired individuals.
2. **Validate the Effectiveness of the Framework**: Evaluate the usability, satisfaction, and ease of use of the framework through user testing to ensure its practical help for visually impaired individuals.
### Research Background:
- Visually impaired individuals face numerous challenges in daily life, including learning, walking, reading, and social interactions.
- Although virtual learning environments (VLE) provide rich learning resources, most applications are not suitable for visually impaired individuals as they rely on visual information.
- Multisensory technologies (such as tactile, auditory, and olfactory senses) can compensate for the visual deficiencies of visually impaired individuals, enhancing their engagement and learning effectiveness in virtual learning environments.
### Research Methods:
- **Participants**: A total of 26 visually impaired individuals participated in the study, including 21 adults and 5 children.
- **Tools**: An application combining 3D tactile devices, audio, and olfactory devices was used to help visually impaired individuals recognize object shapes through touch, hearing, and smell.
- **Evaluation Methods**: The usability, satisfaction, ease of use, and learning effectiveness of the application were assessed through questionnaires. The adult group used the USE questionnaire, while the children group used a specially designed questionnaire.
### Main Findings:
- **Adult Group**: Most participants found the application useful and easy to use, especially when combining sound and smell, which allowed for more accurate recognition of object shapes.
- **Children Group**: Similar to the adult group, children were able to recognize object shapes more accurately when using the 3D tactile device combined with sound and smell. However, the recognition was less effective when using the tactile device alone.
### Conclusion:
- This study successfully designed and validated a multisensory learning framework that effectively enhances the learning experience and effectiveness of visually impaired individuals in virtual learning environments.
- Sound is the main influencing factor for recognizing object shapes, but in the absence of sound, olfactory devices can also significantly improve recognition.
- This study provides new learning tools for visually impaired individuals, helping them achieve a better learning experience in virtual learning environments.
### Limitations:
- Participants were mainly from the Malaysian Association for the Blind (MAB), and future research should include participants from more diverse geographical regions.
- Different types and brands of tactile and olfactory devices can be tried to further validate and optimize the effectiveness of the framework.