Abstract:Extracting high-quality 2D and 3D information from real-world objects plays an important role in surveillance, simulation, scientific analysis, virtual reality, entrainment, and other commercial and scientific applications. Such a capturing task should work not only for static and diffuse objects, but also for fast-moving and deforming objects as well as optically-complex objects. Today this task often requires expensive equipments or complicated hardware setup and calibration. This dissertation research aims to develop robust methods that capture high-quality models for real-world dynamic objects efficiently, accurately, and with low cost. One-frame methods are suitable for moving scenes but typically result in low-resolution models. The addition of temporal processing (e.g., multiple frames) achieves higher resolution and quality but is challenging for dynamic objects. In this dissertation, fundamental problems, which appear when using temporal processing to capture moving and deforming objects, are addressed. The key observation is that for certain types of object motion, multiple frames captured at different time instances can be registered together to a given time instance; enabling the use of more than one image, each with different imaging parameters, to capture the virtually static state at the given instance. According to this observation, this research develops a series of methods for acquiring high-resolution time-varying 3D geometric models for moving and deforming objects using simple hardware infrastructures. In addition this dissertation also studies and proposes approaches that capture photographs that are free of motion blur for fast-moving objects. Finally, technique that reconstructs the 3D geometry for optically-complex scenarios is also presented. Collectively, the approaches developed in this dissertation lead to the ultimate goal of high-quality capture of moving and deforming objects.

High-resolution, Real-Time-geometry Video Acquisition

An Intelligent Surveillance System Base on Accelerated Human and Face Detection

Video Based Head Detection and Tracking Surveillance System

Stereo Camera System and Its Application in Networked Virtual Environment

High-resolution Real-Time 3D Absolute Coordinates Measurement Using a Fast Three-Step Phase-Shifting Algorithm

Monocular Real-Time Human Geometry Reconstruction

Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

Full High-Definition Real-Time Depth Estimation for Three-Dimensional Video System

Real-time high resolution 2D-plus-depth video generation using time-of-flight sensor

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

High-fidelity 3D real-time facial animation using infrared structured light sensing system

Capturing real-world dynamic objects using temporally-coded photography

Robust Real-Time Face Tracking And Modeling From Video

High-Resolution Modeling of Moving and Deforming Objects Using Sparse Geometric and Dense Photometric Measurements

Scalable Multi-View Stereo Camera Array for Real-Time Image Capture and 3D Display in Real-World Applications

GPU-assisted High-Resolution, Real-Time 3-D Shape Measurement.

3D Video Representation and Design for Ubiquitous Environments

Real-time 3d reconstruction of dynamic scenes with multiple kinect v2 sensors

A Single-Shot and Real-Time 3D Imaging Technique for Facial Motion Capture Based on Triple-Frequency Color Fringe Projection

UnstructuredFusion: Realtime 4D Geometry and Texture Reconstruction Using Commercial RGBD Cameras.