Design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm

Ying Wu,Hongbing Liu,Pengzhen Lu,Lihua Zhang,Fangjian Yuan
DOI: https://doi.org/10.1038/s41598-022-21734-y
IF: 4.6
2022-11-02
Scientific Reports
Abstract:Virtual fitting can bring fast and convenient fitting experience for people. The two core problems of virtual fitting system are human–computer interaction and clothing simulation. Interaction is an important factor in determining the fitting experience. The previous virtual fitting products usually use the mouse and keyboard interaction, and users rarely have a good sense of substitution and interaction. While, the method of using multiple cameras to take user images from different angles and then carry out posture recognition has the defect of low recognition accuracy. In view of clothing simulation and human–computer interaction of virtual fitting system, in order to achieve better customer immersion experience, this paper implemented a real-time interactive virtual fitting system based on Microsoft Kinect motion sensing device, and proposed a gesture determination algorithm based on finger recognition and an image transfer algorithm based on skeleton information matching. Using OpenNI development library and multi-threading technology, we have developed a motion-sensing capture module and a complete real-time virtual fitting system, and the system test results show that it has a good user experience.
multidisciplinary sciences
What problem does this paper attempt to address?