Research on Intelligent Wheelchair Multimode Human–Computer Interaction and Assisted Driving Technology

Jianwei Cui,Yucheng Shang,Siji Yu,Yuanbo Wang
DOI: https://doi.org/10.3390/act13060230
IF: 2.6
2024-06-21
Actuators
Abstract:The traditional wheelchair focuses on the "human-chair" motor function interaction to ensure the elderly and people with disabilities' basic travel. For people with visual, hearing, physical disabilities, etc., the current wheelchairs show shortcomings in terms of accessibility and independent travel for this group. Therefore, this paper develops an intelligent wheelchair with multimodal human–computer interaction and autonomous navigation technology. Firstly, it researches the multimodal human–computer interaction technology of occupant gesture recognition, speech recognition, and head posture recognition and proposes a wheelchair control method of three-dimensional head posture mapping the two-dimensional plane. After testing, the average accuracy of the gesture, head posture and voice control modes of the motorized wheelchair proposed in this study reaches more than 95 percent. Secondly, the LiDAR-based smart wheelchair indoor autonomous navigation technology is investigated to realize the autonomous navigation of the wheelchair by constructing an environment map, using A* and DWA algorithms for global and local path planning, and adaptive Monte Carlo simulation algorithms for real-time localization. Experiments show that the position error of the wheelchair is within 10 cm, and the heading angle error is less than 5° during the autonomous navigation. The multimode human–computer interaction and assisted driving technology proposed in this study can partially compensate and replace the functional deficiencies of the disabled population and improve the quality of life of the elderly and disabled population.
engineering, mechanical,instruments & instrumentation
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve This paper aims to address the shortcomings of traditional wheelchairs in terms of environmental perception, autonomous navigation, and human-computer interaction. Particularly for groups with visual, auditory, and physical disabilities, existing wheelchairs have significant deficiencies in independent travel. Therefore, this paper develops an intelligent wheelchair with multimodal human-computer interaction technology and autonomous navigation capabilities. Specifically, the research work in this paper includes the following aspects: 1. **Multimodal Human-Computer Interaction Framework**: A multimodal human-computer interaction framework based on the principle of functional substitution is proposed, which controls the wheelchair through gesture recognition, voice recognition, and head posture recognition. 2. **Autonomous Navigation Framework**: An intelligent wheelchair autonomous navigation framework "human-in-the-loop" is proposed, combining sensor modules such as LiDAR and Inertial Measurement Unit (IMU) to achieve precise mapping of indoor environments and real-time motion state perception. Based on the environmental map and path planning algorithm, it outputs precise speed commands. 3. **Remote Control Technology**: Utilizing cloud servers and mobile apps to achieve remote monitoring and control of the wheelchair. Through these technologies, the intelligent wheelchair can partially compensate for and replace the functional deficiencies of disabled individuals, improving the quality of life for the elderly and disabled groups.