Abstract:Three-dimensional (3D) model with high-quality texture is a powerful way to interact between virtual and reality 3D scene. It has significant applications in digital preservation of cultural heritage, virtual reality / augmented reality (VR/AR), medical imaging and other domains. High-quality texture reconstruction is one of the essential elements for 3D model. Due to the camera pose error and inaccurate model, current texture reconstruction methods could not eliminate the artifacts like blurring, ghosting and discontinuity. In this work, multi-view high-definition images are captured for texture mapping. Normal-weight, depth-weight and edge-weight parameter are introduced to evaluate texture color confidence, respectively. The normalized weight factors are multiplied to generate a comprehensive weight parameter. By taking a weighted average of projected texture images, discontinuity of texture can be smoothed to a large extent. For large misalignment, bidirectional similarity (BDS) function, which represent the structural similarity between two images, are utilized to improve the texture image. The energy function is composed of two terms. One is Euclidean distance between target texture image and merged texture image. The other is BDS between target texture image and original texture image. By minimizing the energy function, the texture image could generate small local displacement while retaining the original structural information. The target and merged images are optimized alternately, the target image is calculated by patch-match algorithm, and the merged image is derived from weighted average of target images. The method we proposed could produce seamless texture comparing with Markov random field (MRF) algorithm. The definition could be higher than the camera parameter optimization algorithm. The experimental results show that structural similarity (SSIM) between the reconstructed images and the ground truth is higher than traditional algorithms. When dealing with inaccurate models with less than 10,000 facets, the SSIM value could be doubled compared with current algorithms.

Texture Mapping of Multi-View High-Resolution Images and Binocular 3D Point Clouds

Interactive High Resolution Texture Mapping for the 3D Models of Cultural Heritages

3d Reconstruction With Multi-View Texture Mapping

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Vision Based Terrain Reconstruction for Planet Rover Using a Special Binocular Bundle Adjustment

Texture Mapping on Real World Models from Multiple Photographic Images

3D Texture Mapping in Multi-view Reconstruction

High-quality texture reconstruction for three-dimensional multi-view imaging (Conference Presentation)

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Vision System of Mobile Robot Combining Binocular and Depth Cameras

Texture mapping of 3D scenes based on the laser-synchronized visual image

MULTIRESOLUTION PATCH-BASED DENSE RECONSTRUCTION INTEGRATING MULTIVIEW IMAGES AND LASER POINT CLOUD

Key Technologies of Seam Fusion for Multi-view Image Texture Mapping Based on 3D Point Cloud Data

Multi-View Stereo Reconstruction With High Dynamic Range Texture

Triangular Patch Based Texture Fusion for Multi-view 3D Face Model

High-Precision Measurement of Binocular Telecentric Vision System With Novel Calibration and Matching Methods

Texture mapping of large-scale scenes based on the laser-synchronized visual image

Research on TOF camera-based guided binocular fusion technology