Trackable and Personalized Shortcut Menu Supporting Multi-user Collaboration

Xiaoxi Du,Lesong Jia,Xiaozhou Zhou,Xinyue Miao,Weiye Xiao,Chengqi Xue
DOI: https://doi.org/10.1007/978-3-031-05409-9_3
2022-01-01
Abstract:Large interactive displays play an important role in multi-user collaboration scenarios, such as scheme discussion, situation plotting and brainstorming. Users in multi-user collaboration scenarios may have diverse task allocations and usage preferences. Moreover, users' positions in the interaction process is not fixed and they may move back and forth, because of the larger display and interactive areas. In order to promote the working efficiency and interactive experience of multi-user collaboration for large interactive displays, we have designed and added trackable and personalized shortcut menus to the large multi-touch desktop system--consultation platform. We use aKinect to capture the skeletal information of different people to achieve multi-user recognition and real-time motion tracking. "Trackable" means that the shortcut menu could track the hand positions of different users, and the users could wake up the shortcut menu with touch gestures from anywhere on the screen. "Personalized" means that the users can set their shortcut menu content according to their usage frequency and preference of common functions. After testing, the shortcut menu received good feedback, and users said that this design could well balance the "shareability" and "independence" of large desktop systems. Our attempt to combine motion tracking with touch interaction in the consultation platform can provide ideas for human-computer interaction design for multi-user collaboration.
What problem does this paper attempt to address?