Real-time 3D human objects rendering based on multiple camera details

W. G. C. W. Kumara,Shwu-Huey Yen,Hui-Huang Hsu,Timothy K. Shih,Wei-Chun Chang,Enkhtogtokh Togootogtokh

DOI: https://doi.org/10.1007/s11042-016-3327-0

IF: 2.577

2016-03-02

Multimedia Tools and Applications

Abstract:Abstract3D model construction techniques using RGB-D information have been gaining a great attention of the researchers around the world in recent decades. The RGB-D sensor, Microsoft Kinect is widely used in many research fields, such as in computer vision, computer graphics, and human computer interaction, due to its capacity of providing color and depth information. This paper presents our research finding on calibrating information from several Kinects in order to construct a 3D model of a human object and to render texture captured from RGB camera. We used multiple Kinect sensors, which are interconnected in a network. High bit rate streams captured at each Kinect are first sent to a centralized PC for the processing. This even can be extended to a remote PC in the Internet. Main contributions of this work include calibration of the multiple Kinects, properly aligning point clouds generated from multiple Kinects, and generation of the 3D shape of the human objects. Experimental results demonstrate that the proposed method provides a better 3D model of the human object being captured.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering

What problem does this paper attempt to address?

This paper aims to solve the problem of how to construct and render 3D human models in real - time using multiple Kinect sensors. Specifically, the researchers attempt to calibrate the information from multiple Kinect sensors, properly align the point clouds generated by these sensors, and generate the 3D shape of the human object. The main contributions of this work include:

1. **Calibration of multiple Kinect sensors**: The researchers developed a method to calibrate multiple Kinect sensors to ensure data consistency among them.
2. **Point cloud alignment**: A method for aligning point clouds generated from multiple Kinect sensors was proposed to ensure that these point clouds can be correctly combined together.
3. **3D human model generation**: Through the above - mentioned calibration and alignment processes, a high - quality 3D human model is generated.

The experimental results show that this method can provide more accurate 3D human models, especially when using multiple Kinect sensors for 360 - degree capture. This technology has broad application prospects in fields such as virtual reality, animation production, and game development.