Research on Holographic Communication System Based on 3D Face Reconstruction

Minglan Su,Chaoying Zhang,Qiaoqiao Liu,Mingchuan Yang
DOI: https://doi.org/10.1109/aemcse55572.2022.00171
2022-01-01
Abstract:Holographic communication, as one of the main communication modes in the future, has attracted extensive attention from all walks of life with high immersion and high naturalness interactive experience. The traditional holographic communication system relies too much on the optical principle, which is easy to be disturbed by external light and reduce the resolution of the picture. Therefore, we propose a holographic communication system based on 3D face reconstruction algorithm. The system collects the images and audio data of both sides of communication through the input module, and takes the 3D face reconstruction module as the core to realize the mapping from 2D face data to 3D image. The reconstruction results are transmitted to the rendering module to complete the 3D face rendering and display, so as to realize the transformation from plane graphics to stereo images. At the same time, it realizes real-time voice transmission combined with audio and video synchronization technology, which can meet the needs of formal communication meetings.
What problem does this paper attempt to address?