Research on Multimodal Interaction System of Lower Limb Exoskeleton Oriented to Competitive Training

QI Wenqian,SUN Shouqian,CHEN Chao,ZHANG Yebingqing,ZHAO Dongwei
DOI: https://doi.org/10.3901/jme.2023.05.029
2023-01-01
Journal of Mechanical Engineering
Abstract:Currently, there is a lack of research on wearable devices that focus on assisting lower limbs to improve physical fitness training. The synergistic research of exoskeleton and virtual reality is an emerging direction in recent years. The exoskeleton system with multimodal information fusion can optimize the training effect and experience. Therefore, a multimodal interaction system of the lower limb exoskeleton for athletic training is developed. Which not only provides a wide variety of standardized training but also realizes a multisensory immersion experience. Firstly, a multi-degree-of-freedom step-by-step action planning method is designed to reproduce training actions based on lower limb movement action points. Second, a multimodal interaction system for the lower limb exoskeleton is proposed to realize the presentation and indication of normative movements in information space through a virtual reality athletic training simulator. The action data set and the lower limb exoskeleton robot are constructed to realize the assistance and correction of basic training in physical space. The system is based on a multimodal interaction execution strategy to give trainers visual, auditory, and tactile multisensory feedback in real-time to achieve an immersive experience that meets safety norms. Finally,the system is evaluated through two experiments on system functionality and user experience. The functional experiment proves that the system can improve the action accuracy rate by 27.62% on average compared with the original traditional training, and has certain generality. The experimental results of user experience show that the system’s function meets the design expectations, and the comfort compared to other indicators needs to be improved.
What problem does this paper attempt to address?